2024-02-05T07:00:54.667 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-05T07:00:54.667 DEBUG:teuthology.run:Teuthology command: teuthology --description orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} --owner scheduled_gabrioux@teuthology --name gabrioux-2024-02-05_05:57:01-orch:cephadm-wip-guits-testing-3-2024-02-04-2254-distro-default-smithi --archive /home/teuthworker/archive/gabrioux-2024-02-05_05:57:01-orch:cephadm-wip-guits-testing-3-2024-02-04-2254-distro-default-smithi/7546722 --verbose -- /home/teuthworker/archive/gabrioux-2024-02-05_05:57:01-orch:cephadm-wip-guits-testing-3-2024-02-04-2254-distro-default-smithi/7546722/orig.config.yaml 2024-02-05T07:00:54.699 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T07:00:54.778 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-02-05_05:57:01-orch:cephadm-wip-guits-testing-3-2024-02-04-2254-distro-default-smithi/7546722 branch: wip-guits-testing-3-2024-02-04-2254 description: orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} email: gabrioux@ibm.com first_in_suite: false job_id: '7546722' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: gabrioux-2024-02-05_05:57:01-orch:cephadm-wip-guits-testing-3-2024-02-04-2254-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-guits-testing-3-2024-02-04-2254 ceph: conf: client: debug ms: 1 global: mon election default strategy: 1 ms bind msgr2: false ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) mon_bind_msgr2: false sha1: 164d3be4a527be775f4d3c343ea591122f1b8921 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: cephadm-package install: ceph: flavor: default sha1: 164d3be4a527be775f4d3c343ea591122f1b8921 extra_packages: - cephadm selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-guits-testing-3-2024-02-04-2254 sha1: 164d3be4a527be775f4d3c343ea591122f1b8921 owner: scheduled_gabrioux@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 7317 sha1: 164d3be4a527be775f4d3c343ea591122f1b8921 sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-testing-3-2024-02-04-2254 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_164d3be4a527be775f4d3c343ea591122f1b8921/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 164d3be4a527be775f4d3c343ea591122f1b8921 targets: smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMYlDwTmAq/gFbcKJYIcmZ0Yv8UqzlB90isJu5m6Sv6tnki+ynX4JxbfqI4w7fMTkRh9xN1h9eCo20Ct4XZbp+c= smithi188.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHDl+fVWw9yXREQNWDJwG4zmbmkXjaD4WHDgq7nVWZpJ0TblbB44qr0danR1DS50pVAy7/ep0yUBKQLbl3qYBVY= tasks: - pexec: all: - sudo dnf install runc -y - sudo sed -i 's/^#runtime = "crun"/runtime = "runc"/g' /usr/share/containers/containers.conf - sudo sed -i 's/runtime = "crun"/#runtime = "crun"/g' /usr/share/containers/containers.conf - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: d9fdb2209e15b39d9f061fd85399f352ce0f0894 timestamp: 2024-02-05_05:57:01 tube: smithi user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-05T07:00:54.778 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_164d3be4a527be775f4d3c343ea591122f1b8921/qa; will attempt to use it 2024-02-05T07:00:54.779 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_164d3be4a527be775f4d3c343ea591122f1b8921/qa/tasks 2024-02-05T07:00:54.779 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-05T07:00:54.781 INFO:teuthology.task.internal:Checking packages... 2024-02-05T07:00:54.805 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '164d3be4a527be775f4d3c343ea591122f1b8921' 2024-02-05T07:00:54.806 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-05T07:00:54.806 INFO:teuthology.packaging:ref: None 2024-02-05T07:00:54.806 INFO:teuthology.packaging:tag: None 2024-02-05T07:00:54.806 INFO:teuthology.packaging:branch: wip-guits-testing-3-2024-02-04-2254 2024-02-05T07:00:54.806 INFO:teuthology.packaging:sha1: 164d3be4a527be775f4d3c343ea591122f1b8921 2024-02-05T07:00:54.806 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-guits-testing-3-2024-02-04-2254 2024-02-05T07:00:54.953 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1241.g164d3be4 2024-02-05T07:00:54.955 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-05T07:00:54.962 INFO:teuthology.task.internal:no buildpackages task found 2024-02-05T07:00:54.962 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-05T07:00:55.015 INFO:teuthology.task.internal:Saving configuration 2024-02-05T07:00:55.027 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-05T07:00:55.034 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-05T07:00:55.059 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-02-05_05:57:01-orch:cephadm-wip-guits-testing-3-2024-02-04-2254-distro-default-smithi/7546722', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-05 06:55:54.557556', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMYlDwTmAq/gFbcKJYIcmZ0Yv8UqzlB90isJu5m6Sv6tnki+ynX4JxbfqI4w7fMTkRh9xN1h9eCo20Ct4XZbp+c='} 2024-02-05T07:00:55.079 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-02-05_05:57:01-orch:cephadm-wip-guits-testing-3-2024-02-04-2254-distro-default-smithi/7546722', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-05 06:55:54.556208', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHDl+fVWw9yXREQNWDJwG4zmbmkXjaD4WHDgq7nVWZpJ0TblbB44qr0danR1DS50pVAy7/ep0yUBKQLbl3qYBVY='} 2024-02-05T07:00:55.079 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-05T07:00:55.085 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-02-05T07:00:55.085 INFO:teuthology.task.internal:roles: ubuntu@smithi188.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-02-05T07:00:55.085 INFO:teuthology.run_tasks:Running task console_log... 2024-02-05T07:00:55.160 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f108e56c0d0>, signals=[15]) 2024-02-05T07:00:55.160 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-05T07:00:55.174 INFO:teuthology.task.internal:Opening connections... 2024-02-05T07:00:55.175 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2024-02-05T07:00:55.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T07:00:55.269 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi188.front.sepia.ceph.com 2024-02-05T07:00:55.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T07:00:55.355 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-05T07:00:55.363 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-02-05T07:00:55.380 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-02-05T07:00:55.380 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-02-05T07:00:55.435 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2024-02-05T07:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2024-02-05T07:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2024-02-05T07:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2024-02-05T07:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2024-02-05T07:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2024-02-05T07:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-05T07:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-02-05T07:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2024-02-05T07:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-05T07:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2024-02-05T07:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-05T07:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-05T07:00:55.436 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-05T07:00:55.437 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-02-05T07:00:55.454 DEBUG:teuthology.orchestra.run.smithi188:> uname -m 2024-02-05T07:00:55.471 INFO:teuthology.orchestra.run.smithi188.stdout:x86_64 2024-02-05T07:00:55.471 DEBUG:teuthology.orchestra.run.smithi188:> cat /etc/os-release 2024-02-05T07:00:55.525 INFO:teuthology.orchestra.run.smithi188.stdout:NAME="CentOS Stream" 2024-02-05T07:00:55.526 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION="9" 2024-02-05T07:00:55.526 INFO:teuthology.orchestra.run.smithi188.stdout:ID="centos" 2024-02-05T07:00:55.526 INFO:teuthology.orchestra.run.smithi188.stdout:ID_LIKE="rhel fedora" 2024-02-05T07:00:55.526 INFO:teuthology.orchestra.run.smithi188.stdout:VERSION_ID="9" 2024-02-05T07:00:55.526 INFO:teuthology.orchestra.run.smithi188.stdout:PLATFORM_ID="platform:el9" 2024-02-05T07:00:55.526 INFO:teuthology.orchestra.run.smithi188.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-05T07:00:55.526 INFO:teuthology.orchestra.run.smithi188.stdout:ANSI_COLOR="0;31" 2024-02-05T07:00:55.526 INFO:teuthology.orchestra.run.smithi188.stdout:LOGO="fedora-logo-icon" 2024-02-05T07:00:55.526 INFO:teuthology.orchestra.run.smithi188.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-05T07:00:55.526 INFO:teuthology.orchestra.run.smithi188.stdout:HOME_URL="https://centos.org/" 2024-02-05T07:00:55.526 INFO:teuthology.orchestra.run.smithi188.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-05T07:00:55.526 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-05T07:00:55.526 INFO:teuthology.orchestra.run.smithi188.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-05T07:00:55.527 INFO:teuthology.lock.ops:Updating smithi188.front.sepia.ceph.com on lock server 2024-02-05T07:00:55.593 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-05T07:00:55.603 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-05T07:00:55.611 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-05T07:00:55.611 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2024-02-05T07:00:55.613 DEBUG:teuthology.orchestra.run.smithi188:> test '!' -e /home/ubuntu/cephtest 2024-02-05T07:00:55.632 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-05T07:00:55.640 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-05T07:00:55.640 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2024-02-05T07:00:55.670 DEBUG:teuthology.orchestra.run.smithi188:> test -z $(ls -A /var/lib/ceph) 2024-02-05T07:00:55.765 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-05T07:00:55.818 INFO:teuthology.run_tasks:Running task kernel... 2024-02-05T07:00:55.836 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-05T07:00:55.836 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-05T07:00:55.836 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-05T07:00:55.837 DEBUG:teuthology.orchestra.run.smithi188:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-05T07:00:55.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-05T07:00:55.853 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-02-05T07:00:55.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-05T07:00:55.854 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-02-05T07:00:55.910 INFO:teuthology.orchestra.run.smithi188.stdout:5.14.0-361.el9.x86_64 2024-02-05T07:00:55.910 INFO:teuthology.task.kernel:Running kernel on smithi188: 5.14.0-361.el9.x86_64 2024-02-05T07:00:55.910 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum install -y kernel 2024-02-05T07:00:55.911 INFO:teuthology.orchestra.run.smithi184.stdout:5.14.0-361.el9.x86_64 2024-02-05T07:00:55.911 INFO:teuthology.task.kernel:Running kernel on smithi184: 5.14.0-361.el9.x86_64 2024-02-05T07:00:55.912 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum install -y kernel 2024-02-05T07:00:58.217 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-9 - AppStream 9.6 MB/s | 6.6 MB 00:00 2024-02-05T07:00:58.311 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - AppStream 8.8 MB/s | 6.6 MB 00:00 2024-02-05T07:00:59.668 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-9 - BaseOS 5.4 MB/s | 2.0 MB 00:00 2024-02-05T07:00:59.770 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - BaseOS 5.3 MB/s | 2.0 MB 00:00 2024-02-05T07:01:02.005 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.0 MB 00:01 2024-02-05T07:01:04.972 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - AppStream 10 MB/s | 19 MB 00:01 2024-02-05T07:01:10.820 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 5.9 MB 00:02 2024-02-05T07:01:10.857 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 754 kB/s | 8.0 MB 00:10 2024-02-05T07:01:12.487 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 15 kB 00:00 2024-02-05T07:01:14.754 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 9.5 MB/s | 20 MB 00:02 2024-02-05T07:01:15.383 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 5.4 MB/s | 19 MB 00:03 2024-02-05T07:01:19.687 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-02-05T07:01:21.902 INFO:teuthology.orchestra.run.smithi188.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-05T07:01:21.902 INFO:teuthology.orchestra.run.smithi188.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-05T07:01:21.989 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:01:22.001 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:01:22.001 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-02-05T07:01:22.001 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:01:22.001 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:01:22.001 INFO:teuthology.orchestra.run.smithi188.stdout: kernel x86_64 5.14.0-416.el9 CentOS-BaseOS 6.0 M 2024-02-05T07:01:22.001 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-02-05T07:01:22.001 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-core x86_64 5.14.0-416.el9 CentOS-BaseOS 21 M 2024-02-05T07:01:22.002 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules x86_64 5.14.0-416.el9 CentOS-BaseOS 39 M 2024-02-05T07:01:22.002 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules-core x86_64 5.14.0-416.el9 CentOS-BaseOS 33 M 2024-02-05T07:01:22.002 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:01:22.002 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:01:22.002 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:01:22.002 INFO:teuthology.orchestra.run.smithi188.stdout:Install 4 Packages 2024-02-05T07:01:22.002 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:01:22.003 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 99 M 2024-02-05T07:01:22.003 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 122 M 2024-02-05T07:01:22.003 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:01:22.780 INFO:teuthology.orchestra.run.smithi188.stdout:(1/4): kernel-5.14.0-416.el9.x86_64.rpm 7.7 MB/s | 6.0 MB 00:00 2024-02-05T07:01:23.305 INFO:teuthology.orchestra.run.smithi188.stdout:(2/4): kernel-core-5.14.0-416.el9.x86_64.rpm 16 MB/s | 21 MB 00:01 2024-02-05T07:01:24.522 INFO:teuthology.orchestra.run.smithi188.stdout:(3/4): kernel-modules-5.14.0-416.el9.x86_64.rpm 16 MB/s | 39 MB 00:02 2024-02-05T07:01:24.999 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 987 kB/s | 5.9 MB 00:06 2024-02-05T07:01:27.166 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 15 kB 00:01 2024-02-05T07:01:27.230 INFO:teuthology.orchestra.run.smithi188.stdout:(4/4): kernel-modules-core-5.14.0-416.el9.x86_6 7.5 MB/s | 33 MB 00:04 2024-02-05T07:01:27.233 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:01:27.233 INFO:teuthology.orchestra.run.smithi188.stdout:Total 19 MB/s | 99 MB 00:05 2024-02-05T07:01:27.233 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:01:27.626 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:01:27.626 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:01:28.688 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:01:28.688 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:01:28.959 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2024-02-05T07:01:31.081 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:01:31.744 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-modules-core-5.14.0-416.el9.x86_64 1/4 2024-02-05T07:01:31.889 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-core-5.14.0-416.el9.x86_64 2/4 2024-02-05T07:01:33.925 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 9.1 kB/s | 1.7 kB 00:00 2024-02-05T07:01:34.623 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-core-5.14.0-416.el9.x86_64 2/4 2024-02-05T07:01:34.819 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-modules-5.14.0-416.el9.x86_64 3/4 2024-02-05T07:01:36.157 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-02-05T07:01:36.157 INFO:teuthology.orchestra.run.smithi184.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-02-05T07:01:36.295 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:01:36.305 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:01:36.305 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-05T07:01:36.305 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:01:36.305 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:01:36.305 INFO:teuthology.orchestra.run.smithi184.stdout: kernel x86_64 5.14.0-416.el9 CentOS-BaseOS 6.0 M 2024-02-05T07:01:36.305 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-05T07:01:36.305 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-core x86_64 5.14.0-416.el9 CentOS-BaseOS 21 M 2024-02-05T07:01:36.305 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules x86_64 5.14.0-416.el9 CentOS-BaseOS 39 M 2024-02-05T07:01:36.305 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-core x86_64 5.14.0-416.el9 CentOS-BaseOS 33 M 2024-02-05T07:01:36.305 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:01:36.306 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:01:36.306 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:01:36.306 INFO:teuthology.orchestra.run.smithi184.stdout:Install 4 Packages 2024-02-05T07:01:36.306 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:01:36.306 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 99 M 2024-02-05T07:01:36.306 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 122 M 2024-02-05T07:01:36.306 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:01:36.694 INFO:teuthology.orchestra.run.smithi184.stdout:(1/4): kernel-5.14.0-416.el9.x86_64.rpm 15 MB/s | 6.0 MB 00:00 2024-02-05T07:01:37.227 INFO:teuthology.orchestra.run.smithi184.stdout:(2/4): kernel-core-5.14.0-416.el9.x86_64.rpm 23 MB/s | 21 MB 00:00 2024-02-05T07:01:37.902 INFO:teuthology.orchestra.run.smithi184.stdout:(3/4): kernel-modules-core-5.14.0-416.el9.x86_6 28 MB/s | 33 MB 00:01 2024-02-05T07:01:38.703 INFO:teuthology.orchestra.run.smithi184.stdout:(4/4): kernel-modules-5.14.0-416.el9.x86_64.rpm 16 MB/s | 39 MB 00:02 2024-02-05T07:01:38.706 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:01:38.706 INFO:teuthology.orchestra.run.smithi184.stdout:Total 41 MB/s | 99 MB 00:02 2024-02-05T07:01:38.706 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:01:39.064 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:01:39.064 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:01:39.522 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-modules-5.14.0-416.el9.x86_64 3/4 2024-02-05T07:01:39.705 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : kernel-5.14.0-416.el9.x86_64 4/4 2024-02-05T07:01:40.064 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:01:40.065 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:01:42.445 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:01:43.132 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-modules-core-5.14.0-416.el9.x86_64 1/4 2024-02-05T07:01:43.262 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-core-5.14.0-416.el9.x86_64 2/4 2024-02-05T07:01:44.423 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-modules-core-5.14.0-416.el9.x86_64 4/4 2024-02-05T07:01:46.020 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-core-5.14.0-416.el9.x86_64 2/4 2024-02-05T07:01:46.199 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-modules-5.14.0-416.el9.x86_64 3/4 2024-02-05T07:01:50.891 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-5.14.0-416.el9.x86_64 3/4 2024-02-05T07:01:51.069 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : kernel-5.14.0-416.el9.x86_64 4/4 2024-02-05T07:01:55.756 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-core-5.14.0-416.el9.x86_64 4/4 2024-02-05T07:02:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-core-5.14.0-416.el9.x86_64 4/4 2024-02-05T07:02:13.521 INFO:teuthology.orchestra.run.smithi188.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-05T07:02:13.521 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:02:13.590 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-modules-5.14.0-416.el9.x86_64 4/4 2024-02-05T07:02:14.027 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: kernel-5.14.0-416.el9.x86_64 4/4 2024-02-05T07:02:14.028 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-5.14.0-416.el9.x86_64 1/4 2024-02-05T07:02:14.028 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-core-5.14.0-416.el9.x86_64 2/4 2024-02-05T07:02:14.028 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-modules-5.14.0-416.el9.x86_64 3/4 2024-02-05T07:02:14.434 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : kernel-modules-core-5.14.0-416.el9.x86_64 4/4 2024-02-05T07:02:14.434 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:02:14.434 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:02:14.434 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-5.14.0-416.el9.x86_64 2024-02-05T07:02:14.435 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-core-5.14.0-416.el9.x86_64 2024-02-05T07:02:14.435 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules-5.14.0-416.el9.x86_64 2024-02-05T07:02:14.435 INFO:teuthology.orchestra.run.smithi188.stdout: kernel-modules-core-5.14.0-416.el9.x86_64 2024-02-05T07:02:14.435 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:02:14.435 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:02:14.956 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q kernel | sort -rV | head -n 1 2024-02-05T07:02:15.095 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-5.14.0-416.el9.x86_64 2024-02-05T07:02:15.095 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-416.el9.x86_64 2024-02-05T07:02:15.095 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-416.el9.x86_64 2024-02-05T07:02:15.095 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-05T07:02:15.096 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-05T07:02:15.096 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-02-05T07:02:15.096 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi188.front.sepia.ceph.com, path=None, version=distro) 2024-02-05T07:02:15.096 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q kernel | sort -rV | head -n 1 2024-02-05T07:02:15.203 INFO:teuthology.orchestra.run.smithi188.stdout:kernel-5.14.0-416.el9.x86_64 2024-02-05T07:02:15.203 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-416.el9.x86_64 2024-02-05T07:02:15.203 DEBUG:teuthology.orchestra.run.smithi188:> sudo rpm -qi grub2-tools 2024-02-05T07:02:15.247 INFO:teuthology.orchestra.run.smithi188.stdout:Name : grub2-tools 2024-02-05T07:02:15.247 INFO:teuthology.orchestra.run.smithi188.stdout:Epoch : 1 2024-02-05T07:02:15.247 INFO:teuthology.orchestra.run.smithi188.stdout:Version : 2.06 2024-02-05T07:02:15.247 INFO:teuthology.orchestra.run.smithi188.stdout:Release : 68.el9 2024-02-05T07:02:15.247 INFO:teuthology.orchestra.run.smithi188.stdout:Architecture: x86_64 2024-02-05T07:02:15.247 INFO:teuthology.orchestra.run.smithi188.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-05T07:02:15.248 INFO:teuthology.orchestra.run.smithi188.stdout:Group : Unspecified 2024-02-05T07:02:15.248 INFO:teuthology.orchestra.run.smithi188.stdout:Size : 8264254 2024-02-05T07:02:15.248 INFO:teuthology.orchestra.run.smithi188.stdout:License : GPLv3+ 2024-02-05T07:02:15.248 INFO:teuthology.orchestra.run.smithi188.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-05T07:02:15.248 INFO:teuthology.orchestra.run.smithi188.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-05T07:02:15.248 INFO:teuthology.orchestra.run.smithi188.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-05T07:02:15.248 INFO:teuthology.orchestra.run.smithi188.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-05T07:02:15.248 INFO:teuthology.orchestra.run.smithi188.stdout:Packager : builder@centos.org 2024-02-05T07:02:15.248 INFO:teuthology.orchestra.run.smithi188.stdout:Vendor : CentOS 2024-02-05T07:02:15.248 INFO:teuthology.orchestra.run.smithi188.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-05T07:02:15.248 INFO:teuthology.orchestra.run.smithi188.stdout:Summary : Support tools for GRUB. 2024-02-05T07:02:15.248 INFO:teuthology.orchestra.run.smithi188.stdout:Description : 2024-02-05T07:02:15.248 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:02:15.248 INFO:teuthology.orchestra.run.smithi188.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-05T07:02:15.249 INFO:teuthology.orchestra.run.smithi188.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-05T07:02:15.249 INFO:teuthology.orchestra.run.smithi188.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-05T07:02:15.249 INFO:teuthology.orchestra.run.smithi188.stdout:hardware devices. 2024-02-05T07:02:15.249 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:02:15.249 INFO:teuthology.orchestra.run.smithi188.stdout:This subpackage provides tools for support of all platforms. 2024-02-05T07:02:15.249 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-05T07:02:15.250 INFO:teuthology.task.kernel:Updating grub on smithi188 to boot 5.14.0-416.el9.x86_64 2024-02-05T07:02:15.250 DEBUG:teuthology.orchestra.run.smithi188:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-05T07:02:15.775 INFO:teuthology.orchestra.run.smithi188.stderr:Generating grub configuration file ... 2024-02-05T07:02:17.178 INFO:teuthology.orchestra.run.smithi188.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-05T07:02:17.216 INFO:teuthology.orchestra.run.smithi188.stderr:done 2024-02-05T07:02:17.219 DEBUG:teuthology.orchestra.run.smithi188:> mktemp 2024-02-05T07:02:17.234 INFO:teuthology.orchestra.run.smithi188.stdout:/tmp/tmp.unyt6pgV51 2024-02-05T07:02:17.234 DEBUG:teuthology.orchestra.run.smithi188:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.unyt6pgV51 2024-02-05T07:02:17.302 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0666 /tmp/tmp.unyt6pgV51 2024-02-05T07:02:17.440 DEBUG:teuthology.orchestra.remote:smithi188:/tmp/tmp.unyt6pgV51 is 6KB 2024-02-05T07:02:17.489 DEBUG:teuthology.orchestra.run.smithi188:> rm -fr /tmp/tmp.unyt6pgV51 2024-02-05T07:02:17.503 DEBUG:teuthology.orchestra.run.smithi188:> sudo /bin/ls /boot/loader/entries || true 2024-02-05T07:02:17.599 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-05T07:02:17.600 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-05T07:02:17.600 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-05T07:02:17.600 INFO:teuthology.orchestra.run.smithi188.stdout:15949e3c88704300882482eddfd7baae-5.14.0-416.el9.x86_64.conf 2024-02-05T07:02:17.601 DEBUG:teuthology.orchestra.run.smithi188:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-416.el9.x86_64 2024-02-05T07:02:17.706 DEBUG:teuthology.orchestra.run.smithi188:> sudo shutdown -r now 2024-02-05T07:02:24.897 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-core-5.14.0-416.el9.x86_64 4/4 2024-02-05T07:02:24.897 INFO:teuthology.orchestra.run.smithi184.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-05T07:02:24.897 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:02:24.967 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-modules-5.14.0-416.el9.x86_64 4/4 2024-02-05T07:02:25.429 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: kernel-5.14.0-416.el9.x86_64 4/4 2024-02-05T07:02:25.429 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-5.14.0-416.el9.x86_64 1/4 2024-02-05T07:02:25.429 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-core-5.14.0-416.el9.x86_64 2/4 2024-02-05T07:02:25.429 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-modules-5.14.0-416.el9.x86_64 3/4 2024-02-05T07:02:25.857 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : kernel-modules-core-5.14.0-416.el9.x86_64 4/4 2024-02-05T07:02:25.858 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:02:25.858 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:02:25.858 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-5.14.0-416.el9.x86_64 2024-02-05T07:02:25.858 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-core-5.14.0-416.el9.x86_64 2024-02-05T07:02:25.858 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-5.14.0-416.el9.x86_64 2024-02-05T07:02:25.858 INFO:teuthology.orchestra.run.smithi184.stdout: kernel-modules-core-5.14.0-416.el9.x86_64 2024-02-05T07:02:25.858 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:02:25.858 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:02:26.419 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2024-02-05T07:02:26.549 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-5.14.0-416.el9.x86_64 2024-02-05T07:02:26.549 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-416.el9.x86_64 2024-02-05T07:02:26.550 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-416.el9.x86_64 2024-02-05T07:02:26.550 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-05T07:02:26.550 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-05T07:02:26.550 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-05T07:02:26.550 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=None, version=distro) 2024-02-05T07:02:26.550 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q kernel | sort -rV | head -n 1 2024-02-05T07:02:26.657 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-5.14.0-416.el9.x86_64 2024-02-05T07:02:26.657 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-416.el9.x86_64 2024-02-05T07:02:26.657 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -qi grub2-tools 2024-02-05T07:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout:Name : grub2-tools 2024-02-05T07:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout:Epoch : 1 2024-02-05T07:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout:Version : 2.06 2024-02-05T07:02:26.691 INFO:teuthology.orchestra.run.smithi184.stdout:Release : 68.el9 2024-02-05T07:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: x86_64 2024-02-05T07:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-05T07:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout:Group : Unspecified 2024-02-05T07:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout:Size : 8264254 2024-02-05T07:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout:License : GPLv3+ 2024-02-05T07:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-05T07:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-05T07:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-05T07:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-05T07:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout:Packager : builder@centos.org 2024-02-05T07:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout:Vendor : CentOS 2024-02-05T07:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-05T07:02:26.692 INFO:teuthology.orchestra.run.smithi184.stdout:Summary : Support tools for GRUB. 2024-02-05T07:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout:Description : 2024-02-05T07:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-05T07:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-05T07:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-05T07:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout:hardware devices. 2024-02-05T07:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:02:26.693 INFO:teuthology.orchestra.run.smithi184.stdout:This subpackage provides tools for support of all platforms. 2024-02-05T07:02:26.694 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-05T07:02:26.694 INFO:teuthology.task.kernel:Updating grub on smithi184 to boot 5.14.0-416.el9.x86_64 2024-02-05T07:02:26.694 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-05T07:02:27.313 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2024-02-05T07:02:28.609 INFO:teuthology.orchestra.run.smithi184.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-05T07:02:28.649 INFO:teuthology.orchestra.run.smithi184.stderr:done 2024-02-05T07:02:28.651 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-02-05T07:02:28.675 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.ANuv8AkFzP 2024-02-05T07:02:28.675 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ANuv8AkFzP 2024-02-05T07:02:28.743 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.ANuv8AkFzP 2024-02-05T07:02:28.886 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.ANuv8AkFzP is 6KB 2024-02-05T07:02:28.935 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.ANuv8AkFzP 2024-02-05T07:02:28.949 DEBUG:teuthology.orchestra.run.smithi184:> sudo /bin/ls /boot/loader/entries || true 2024-02-05T07:02:29.024 INFO:teuthology.orchestra.run.smithi184.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-05T07:02:29.024 INFO:teuthology.orchestra.run.smithi184.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-05T07:02:29.024 INFO:teuthology.orchestra.run.smithi184.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-05T07:02:29.024 INFO:teuthology.orchestra.run.smithi184.stdout:15949e3c88704300882482eddfd7baae-5.14.0-416.el9.x86_64.conf 2024-02-05T07:02:29.025 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-416.el9.x86_64 2024-02-05T07:02:29.180 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2024-02-05T07:02:47.725 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-02-05T07:02:47.726 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-02-05T07:02:47.727 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T07:02:59.191 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-05T07:02:59.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-02-05T07:02:59.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T07:03:47.773 DEBUG:teuthology.orchestra.remote:timed out 2024-02-05T07:03:56.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-02-05T07:03:56.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T07:03:59.196 DEBUG:teuthology.orchestra.remote:timed out 2024-02-05T07:04:00.360 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-02-05T07:04:00.851 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-02-05T07:04:00.851 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-416.el9.x86_64"... 2024-02-05T07:04:00.851 DEBUG:teuthology.orchestra.run.smithi188:> uname -r 2024-02-05T07:04:00.865 INFO:teuthology.orchestra.run.smithi188.stdout:5.14.0-416.el9.x86_64 2024-02-05T07:04:00.865 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-416.el9.x86_64 vs 5.14.0-416.el9.x86_64 2024-02-05T07:04:00.865 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-05T07:04:00.866 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-05T07:04:01.866 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-02-05T07:04:01.866 DEBUG:teuthology.orchestra.run.smithi188:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-05T07:04:01.956 INFO:teuthology.orchestra.run.smithi188.stdout:ttyS1 2024-02-05T07:04:02.002 DEBUG:teuthology.parallel:result is None 2024-02-05T07:04:08.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-02-05T07:04:08.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T07:04:08.517 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-02-05T07:04:08.911 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-02-05T07:04:08.911 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-416.el9.x86_64"... 2024-02-05T07:04:08.911 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-02-05T07:04:08.925 INFO:teuthology.orchestra.run.smithi184.stdout:5.14.0-416.el9.x86_64 2024-02-05T07:04:08.925 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-416.el9.x86_64 vs 5.14.0-416.el9.x86_64 2024-02-05T07:04:08.925 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-05T07:04:08.925 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-05T07:04:09.925 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-05T07:04:09.926 DEBUG:teuthology.orchestra.run.smithi184:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-05T07:04:10.028 INFO:teuthology.orchestra.run.smithi184.stdout:ttyS1 2024-02-05T07:04:10.066 DEBUG:teuthology.parallel:result is None 2024-02-05T07:04:10.067 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-05T07:04:10.074 INFO:teuthology.task.internal:Creating test directory... 2024-02-05T07:04:10.075 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-05T07:04:10.076 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-05T07:04:10.096 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-05T07:04:10.102 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-05T07:04:10.109 INFO:teuthology.task.internal:Creating archive directory... 2024-02-05T07:04:10.109 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-05T07:04:10.128 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-05T07:04:10.179 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-05T07:04:10.186 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-05T07:04:10.186 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-05T07:04:10.188 DEBUG:teuthology.orchestra.run.smithi188:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-05T07:04:10.212 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-05T07:04:10.225 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-05T07:04:10.246 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-05T07:04:10.260 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-05T07:04:10.262 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-05T07:04:10.269 INFO:teuthology.task.internal:Configuring sudo... 2024-02-05T07:04:10.269 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-05T07:04:10.271 DEBUG:teuthology.orchestra.run.smithi188:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-05T07:04:10.331 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-05T07:04:10.342 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-05T07:04:10.342 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-05T07:04:10.344 DEBUG:teuthology.orchestra.run.smithi188:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-05T07:04:10.386 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-05T07:04:10.439 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-05T07:04:10.513 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-05T07:04:10.554 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-05T07:04:10.594 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:04:10.594 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-05T07:04:10.660 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-05T07:04:10.704 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-05T07:04:10.762 DEBUG:teuthology.orchestra.run.smithi188:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-05T07:04:10.806 DEBUG:teuthology.orchestra.run.smithi188:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-05T07:04:10.848 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-05T07:04:10.848 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-05T07:04:10.916 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2024-02-05T07:04:10.918 DEBUG:teuthology.orchestra.run.smithi188:> sudo service rsyslog restart 2024-02-05T07:04:10.994 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-05T07:04:11.014 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-05T07:04:11.460 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-05T07:04:11.469 INFO:teuthology.task.internal:Starting timer... 2024-02-05T07:04:11.469 INFO:teuthology.run_tasks:Running task pcp... 2024-02-05T07:04:11.500 INFO:teuthology.run_tasks:Running task selinux... 2024-02-05T07:04:11.509 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-05T07:04:11.509 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2024-02-05T07:04:11.587 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2024-02-05T07:04:11.592 DEBUG:teuthology.orchestra.run.smithi188:> sudo service auditd rotate 2024-02-05T07:04:11.672 INFO:teuthology.orchestra.run.smithi188.stdout:Rotating logs: 2024-02-05T07:04:11.674 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-05T07:04:11.675 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2024-02-05T07:04:11.707 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2024-02-05T07:04:11.708 DEBUG:teuthology.orchestra.run.smithi188:> /usr/sbin/getenforce 2024-02-05T07:04:11.736 INFO:teuthology.orchestra.run.smithi188.stdout:Permissive 2024-02-05T07:04:11.736 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi184.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi188.front.sepia.ceph.com': 'permissive'} 2024-02-05T07:04:11.737 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-05T07:04:11.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-05T07:04:11.798 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-05T07:04:11.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-05T07:04:11.826 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-05T07:04:11.826 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2024-02-05T07:04:11.877 DEBUG:teuthology.orchestra.run.smithi188:> sudo /usr/sbin/setenforce permissive 2024-02-05T07:04:11.921 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-05T07:04:11.932 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-02-05T07:04:11.938 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-02-05T07:04:12.060 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-05T07:04:12.075 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-05T07:04:12.077 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi184.front.sepia.ceph.com,smithi188.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-05T07:08:17.392 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi184.front.sepia.ceph.com'), Remote(name='ubuntu@smithi188.front.sepia.ceph.com')] 2024-02-05T07:08:17.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-02-05T07:08:17.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T07:08:17.485 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-02-05T07:08:17.563 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-02-05T07:08:17.563 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-02-05T07:08:17.564 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi188.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-05T07:08:17.650 DEBUG:teuthology.orchestra.run.smithi188:> true 2024-02-05T07:08:17.715 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi188.front.sepia.ceph.com' 2024-02-05T07:08:17.715 INFO:teuthology.run_tasks:Running task clock... 2024-02-05T07:08:17.727 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-05T07:08:17.727 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-05T07:08:17.728 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-05T07:08:17.730 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-05T07:08:17.730 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-05T07:08:17.758 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-05T07:08:17.775 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-05T07:08:17.787 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-05T07:08:17.804 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-05T07:08:17.804 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2024-02-05T07:08:17.818 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2024-02-05T07:08:17.834 INFO:teuthology.orchestra.run.smithi188.stderr:sudo: ntpd: command not found 2024-02-05T07:08:17.835 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-05T07:08:17.849 INFO:teuthology.orchestra.run.smithi188.stdout:506 Cannot talk to daemon 2024-02-05T07:08:17.850 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-05T07:08:17.867 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-05T07:08:17.885 INFO:teuthology.orchestra.run.smithi188.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-05T07:08:17.905 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-02-05T07:08:17.909 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-05T07:08:17.909 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-02-05T07:08:17.909 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-05T07:08:17.909 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-05T07:08:17.909 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-05T07:08:17.909 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-05T07:08:17.937 INFO:teuthology.orchestra.run.smithi188.stderr:bash: line 1: ntpq: command not found 2024-02-05T07:08:17.940 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-05T07:08:17.940 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2024-02-05T07:08:17.940 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-05T07:08:17.940 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-05T07:08:17.941 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-05T07:08:17.941 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-05T07:08:17.942 INFO:teuthology.run_tasks:Running task pexec... 2024-02-05T07:08:17.954 INFO:teuthology.task.pexec:Executing custom commands... 2024-02-05T07:08:17.954 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi184.front.sepia.ceph.com 2024-02-05T07:08:17.955 DEBUG:teuthology.orchestra.run.smithi184:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-05T07:08:17.955 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi188.front.sepia.ceph.com 2024-02-05T07:08:17.955 DEBUG:teuthology.orchestra.run.smithi188:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-05T07:08:18.539 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:48 ago on Mon 05 Feb 2024 07:07:30 AM UTC. 2024-02-05T07:08:18.583 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:47 ago on Mon 05 Feb 2024 07:07:31 AM UTC. 2024-02-05T07:08:18.691 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:08:18.692 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:08:18.692 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-02-05T07:08:18.692 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:08:18.692 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:08:18.693 INFO:teuthology.orchestra.run.smithi184.stdout: runc x86_64 4:1.1.12-1.el9 CentOS-AppStream 3.1 M 2024-02-05T07:08:18.693 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:08:18.693 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:08:18.693 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:08:18.693 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-02-05T07:08:18.693 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:08:18.694 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 3.1 M 2024-02-05T07:08:18.694 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 9.8 M 2024-02-05T07:08:18.694 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:08:18.733 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:08:18.735 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:08:18.735 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-02-05T07:08:18.736 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:08:18.736 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:08:18.736 INFO:teuthology.orchestra.run.smithi188.stdout: runc x86_64 4:1.1.12-1.el9 CentOS-AppStream 3.1 M 2024-02-05T07:08:18.736 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:08:18.736 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:08:18.736 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:08:18.736 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-02-05T07:08:18.736 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:08:18.736 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 3.1 M 2024-02-05T07:08:18.736 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 9.8 M 2024-02-05T07:08:18.736 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:08:18.947 INFO:teuthology.orchestra.run.smithi184.stdout:runc-1.1.12-1.el9.x86_64.rpm 12 MB/s | 3.1 MB 00:00 2024-02-05T07:08:18.948 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:08:18.948 INFO:teuthology.orchestra.run.smithi184.stdout:Total 12 MB/s | 3.1 MB 00:00 2024-02-05T07:08:18.948 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:08:18.954 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:08:18.954 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:08:18.974 INFO:teuthology.orchestra.run.smithi188.stdout:runc-1.1.12-1.el9.x86_64.rpm 13 MB/s | 3.1 MB 00:00 2024-02-05T07:08:18.975 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:08:18.975 INFO:teuthology.orchestra.run.smithi188.stdout:Total 13 MB/s | 3.1 MB 00:00 2024-02-05T07:08:18.975 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:08:18.980 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:08:18.980 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:08:19.025 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:08:19.025 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:08:19.051 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:08:19.051 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:08:19.221 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:08:19.255 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:08:19.342 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : runc-4:1.1.12-1.el9.x86_64 1/1 2024-02-05T07:08:19.360 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : runc-4:1.1.12-1.el9.x86_64 1/1 2024-02-05T07:08:19.900 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: runc-4:1.1.12-1.el9.x86_64 1/1 2024-02-05T07:08:19.931 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: runc-4:1.1.12-1.el9.x86_64 1/1 2024-02-05T07:08:20.218 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : runc-4:1.1.12-1.el9.x86_64 1/1 2024-02-05T07:08:20.218 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:08:20.218 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:08:20.218 INFO:teuthology.orchestra.run.smithi184.stdout: runc-4:1.1.12-1.el9.x86_64 2024-02-05T07:08:20.218 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:08:20.218 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:08:20.232 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : runc-4:1.1.12-1.el9.x86_64 1/1 2024-02-05T07:08:20.233 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:08:20.233 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:08:20.233 INFO:teuthology.orchestra.run.smithi188.stdout: runc-4:1.1.12-1.el9.x86_64 2024-02-05T07:08:20.233 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:08:20.233 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:08:20.479 DEBUG:teuthology.parallel:result is None 2024-02-05T07:08:20.497 DEBUG:teuthology.parallel:result is None 2024-02-05T07:08:20.497 INFO:teuthology.run_tasks:Running task install... 2024-02-05T07:08:20.506 DEBUG:teuthology.task.install:project ceph 2024-02-05T07:08:20.506 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '164d3be4a527be775f4d3c343ea591122f1b8921'}, 'extra_packages': ['cephadm']} 2024-02-05T07:08:20.506 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '164d3be4a527be775f4d3c343ea591122f1b8921'} 2024-02-05T07:08:20.506 INFO:teuthology.task.install:Using flavor: default 2024-02-05T07:08:20.512 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-05T07:08:20.512 INFO:teuthology.task.install:extra packages: [] 2024-02-05T07:08:20.513 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '164d3be4a527be775f4d3c343ea591122f1b8921', 'tag': None, 'wait_for_package': False} 2024-02-05T07:08:20.513 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=164d3be4a527be775f4d3c343ea591122f1b8921 2024-02-05T07:08:20.515 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '164d3be4a527be775f4d3c343ea591122f1b8921', 'tag': None, 'wait_for_package': False} 2024-02-05T07:08:20.515 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=164d3be4a527be775f4d3c343ea591122f1b8921 2024-02-05T07:08:20.667 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-guits-testing-3-2024-02-04-2254/164d3be4a527be775f4d3c343ea591122f1b8921/centos/9/flavors/default/ 2024-02-05T07:08:20.667 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1241.g164d3be4 2024-02-05T07:08:20.742 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-guits-testing-3-2024-02-04-2254/164d3be4a527be775f4d3c343ea591122f1b8921/centos/9/flavors/default/ 2024-02-05T07:08:20.742 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1241.g164d3be4 2024-02-05T07:08:20.841 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-guits-testing-3-2024-02-04-2254/164d3be4a527be775f4d3c343ea591122f1b8921/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-guits-testing-3-2024-02-04-2254/164d3be4a527be775f4d3c343ea591122f1b8921/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-guits-testing-3-2024-02-04-2254/164d3be4a527be775f4d3c343ea591122f1b8921/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-05T07:08:20.841 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:08:20.841 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-05T07:08:20.850 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-guits-testing-3-2024-02-04-2254/164d3be4a527be775f4d3c343ea591122f1b8921/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-guits-testing-3-2024-02-04-2254/164d3be4a527be775f4d3c343ea591122f1b8921/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-guits-testing-3-2024-02-04-2254/164d3be4a527be775f4d3c343ea591122f1b8921/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-05T07:08:20.850 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-05T07:08:20.850 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-05T07:08:20.869 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-05T07:08:20.869 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/164d3be4a527be775f4d3c343ea591122f1b8921/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-05T07:08:20.880 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-05T07:08:20.880 DEBUG:teuthology.orchestra.run.smithi188:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/164d3be4a527be775f4d3c343ea591122f1b8921/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-05T07:08:20.936 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-05T07:08:20.950 DEBUG:teuthology.orchestra.run.smithi188:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-05T07:08:21.017 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-05T07:08:21.031 DEBUG:teuthology.orchestra.run.smithi188:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-05T07:08:21.084 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2024-02-05T07:08:21.085 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2024-02-05T07:08:21.100 INFO:teuthology.orchestra.run.smithi188.stdout:check_obsoletes = 1 2024-02-05T07:08:21.101 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum clean all 2024-02-05T07:08:21.323 INFO:teuthology.orchestra.run.smithi184.stdout:74 files removed 2024-02-05T07:08:21.341 INFO:teuthology.orchestra.run.smithi188.stdout:74 files removed 2024-02-05T07:08:21.350 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw 2024-02-05T07:08:21.371 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-radosgw 2024-02-05T07:08:21.986 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 252 kB/s | 80 kB 00:00 2024-02-05T07:08:22.158 INFO:teuthology.orchestra.run.smithi188.stdout:ceph packages for x86_64 170 kB/s | 80 kB 00:00 2024-02-05T07:08:22.429 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 26 kB/s | 10 kB 00:00 2024-02-05T07:08:22.558 INFO:teuthology.orchestra.run.smithi188.stdout:ceph noarch packages 29 kB/s | 10 kB 00:00 2024-02-05T07:08:22.780 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 6.1 kB/s | 1.9 kB 00:00 2024-02-05T07:08:22.975 INFO:teuthology.orchestra.run.smithi188.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-02-05T07:08:23.307 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-9 - AppStream 13 MB/s | 6.6 MB 00:00 2024-02-05T07:08:23.661 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - AppStream 10 MB/s | 6.6 MB 00:00 2024-02-05T07:08:24.774 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-9 - BaseOS 5.4 MB/s | 2.0 MB 00:00 2024-02-05T07:08:25.078 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS-9 - BaseOS 6.4 MB/s | 2.0 MB 00:00 2024-02-05T07:08:25.814 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-02-05T07:08:27.012 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.0 MB 00:01 2024-02-05T07:08:31.082 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 19 MB 00:04 2024-02-05T07:08:35.924 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 5.9 MB 00:01 2024-02-05T07:08:37.717 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 15 kB 00:00 2024-02-05T07:08:38.629 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 26 MB/s | 20 MB 00:00 2024-02-05T07:08:43.485 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-02-05T07:08:43.533 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:15 2024-02-05T07:08:46.109 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:08:46.111 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:08:46.111 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-05T07:08:46.111 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:08:46.111 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:08:46.111 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 9.7 M 2024-02-05T07:08:46.112 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2024-02-05T07:08:46.112 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 3.4 M 2024-02-05T07:08:46.112 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 3.1 M 2024-02-05T07:08:46.112 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-05T07:08:46.112 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options 2024-02-05T07:08:46.112 INFO:teuthology.orchestra.run.smithi184.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-05T07:08:46.112 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 5.1 M 2024-02-05T07:08:46.112 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 20 M 2024-02-05T07:08:46.112 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 25 k 2024-02-05T07:08:46.113 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-05T07:08:46.113 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-05T07:08:46.113 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-05T07:08:46.113 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 743 k 2024-02-05T07:08:46.113 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-05T07:08:46.113 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-05T07:08:46.113 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-05T07:08:46.113 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 498 k 2024-02-05T07:08:46.113 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-05T07:08:46.114 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 5.1 M 2024-02-05T07:08:46.114 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-05T07:08:46.114 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-05T07:08:46.114 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-05T07:08:46.114 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse 2024-02-05T07:08:46.114 INFO:teuthology.orchestra.run.smithi184.stdout: x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 45 k 2024-02-05T07:08:46.114 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 131 k 2024-02-05T07:08:46.114 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 162 k 2024-02-05T07:08:46.114 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-05T07:08:46.114 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 320 k 2024-02-05T07:08:46.114 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 298 k 2024-02-05T07:08:46.114 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 99 k 2024-02-05T07:08:46.115 INFO:teuthology.orchestra.run.smithi184.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-05T07:08:46.115 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-05T07:08:46.115 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:08:46.115 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:08:46.115 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:08:46.115 INFO:teuthology.orchestra.run.smithi184.stdout:Install 27 Packages 2024-02-05T07:08:46.115 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 2 Packages 2024-02-05T07:08:46.115 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:08:46.116 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 57 M 2024-02-05T07:08:46.116 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:08:47.120 INFO:teuthology.orchestra.run.smithi184.stdout:(1/29): ceph-base-19.0.0-1241.g164d3be4.el9.x86 5.3 MB/s | 5.1 MB 00:00 2024-02-05T07:08:47.178 INFO:teuthology.orchestra.run.smithi184.stdout:(2/29): ceph-selinux-19.0.0-1241.g164d3be4.el9. 432 kB/s | 25 kB 00:00 2024-02-05T07:08:47.286 INFO:teuthology.orchestra.run.smithi184.stdout:(3/29): libcephfs2-19.0.0-1241.g164d3be4.el9.x8 6.7 MB/s | 743 kB 00:00 2024-02-05T07:08:47.404 INFO:teuthology.orchestra.run.smithi184.stdout:(4/29): libradosstriper1-19.0.0-1241.g164d3be4. 4.2 MB/s | 498 kB 00:00 2024-02-05T07:08:47.450 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - CRB 13 MB/s | 5.9 MB 00:00 2024-02-05T07:08:48.120 INFO:teuthology.orchestra.run.smithi184.stdout:(5/29): ceph-radosgw-19.0.0-1241.g164d3be4.el9. 5.0 MB/s | 9.7 MB 00:01 2024-02-05T07:08:48.195 INFO:teuthology.orchestra.run.smithi184.stdout:(6/29): librgw2-19.0.0-1241.g164d3be4.el9.x86_6 6.4 MB/s | 5.1 MB 00:00 2024-02-05T07:08:48.221 INFO:teuthology.orchestra.run.smithi184.stdout:(7/29): python3-ceph-argparse-19.0.0-1241.g164d 450 kB/s | 45 kB 00:00 2024-02-05T07:08:48.279 INFO:teuthology.orchestra.run.smithi184.stdout:(8/29): python3-ceph-common-19.0.0-1241.g164d3b 1.5 MB/s | 131 kB 00:00 2024-02-05T07:08:48.313 INFO:teuthology.orchestra.run.smithi184.stdout:(9/29): python3-cephfs-19.0.0-1241.g164d3be4.el 1.7 MB/s | 162 kB 00:00 2024-02-05T07:08:48.371 INFO:teuthology.orchestra.run.smithi184.stdout:(10/29): python3-rados-19.0.0-1241.g164d3be4.el 3.4 MB/s | 320 kB 00:00 2024-02-05T07:08:48.430 INFO:teuthology.orchestra.run.smithi184.stdout:(11/29): python3-rbd-19.0.0-1241.g164d3be4.el9. 2.5 MB/s | 298 kB 00:00 2024-02-05T07:08:48.472 INFO:teuthology.orchestra.run.smithi184.stdout:(12/29): python3-rgw-19.0.0-1241.g164d3be4.el9. 990 kB/s | 99 kB 00:00 2024-02-05T07:08:48.614 INFO:teuthology.orchestra.run.smithi184.stdout:(13/29): boost-program-options-1.75.0-8.el9.x86 576 kB/s | 106 kB 00:00 2024-02-05T07:08:48.639 INFO:teuthology.orchestra.run.smithi184.stdout:(14/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 159 kB 00:00 2024-02-05T07:08:48.673 INFO:teuthology.orchestra.run.smithi184.stdout:(15/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 753 kB/s | 44 kB 00:00 2024-02-05T07:08:48.748 INFO:teuthology.orchestra.run.smithi184.stdout:(16/29): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 661 kB 00:00 2024-02-05T07:08:48.774 INFO:teuthology.orchestra.run.smithi184.stdout:(17/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 282 kB 00:00 2024-02-05T07:08:48.791 INFO:teuthology.orchestra.run.smithi184.stdout:(18/29): python3-prettytable-0.7.2-27.el9.noarc 991 kB/s | 41 kB 00:00 2024-02-05T07:08:48.952 INFO:teuthology.orchestra.run.smithi188.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 15 kB 00:00 2024-02-05T07:08:48.983 INFO:teuthology.orchestra.run.smithi184.stdout:(19/29): ceph-common-19.0.0-1241.g164d3be4.el9. 7.0 MB/s | 20 MB 00:02 2024-02-05T07:08:49.133 INFO:teuthology.orchestra.run.smithi184.stdout:(20/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 861 kB/s | 309 kB 00:00 2024-02-05T07:08:49.150 INFO:teuthology.orchestra.run.smithi184.stdout:(21/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 221 kB/s | 26 kB 00:00 2024-02-05T07:08:49.284 INFO:teuthology.orchestra.run.smithi184.stdout:(22/29): liboath-2.6.7-2.el9.x86_64.rpm 323 kB/s | 49 kB 00:00 2024-02-05T07:08:49.311 INFO:teuthology.orchestra.run.smithi184.stdout:(23/29): libunwind-1.6.2-1.el9.x86_64.rpm 424 kB/s | 67 kB 00:00 2024-02-05T07:08:49.343 INFO:teuthology.orchestra.run.smithi184.stdout:(24/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 14 MB/s | 838 kB 00:00 2024-02-05T07:08:49.368 INFO:teuthology.orchestra.run.smithi184.stdout:(25/29): re2-20211101-3.el9.x86_64.rpm 3.3 MB/s | 192 kB 00:00 2024-02-05T07:08:49.426 INFO:teuthology.orchestra.run.smithi184.stdout:(26/29): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-02-05T07:08:49.485 INFO:teuthology.orchestra.run.smithi184.stdout:(27/29): libarrow-9.0.0-10.el9.x86_64.rpm 6.4 MB/s | 4.4 MB 00:00 2024-02-05T07:08:49.760 INFO:teuthology.orchestra.run.smithi184.stdout:(28/29): librbd1-19.0.0-1241.g164d3be4.el9.x86_ 9.4 MB/s | 3.1 MB 00:00 2024-02-05T07:08:49.835 INFO:teuthology.orchestra.run.smithi184.stdout:(29/29): librados2-19.0.0-1241.g164d3be4.el9.x8 7.3 MB/s | 3.4 MB 00:00 2024-02-05T07:08:49.842 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:08:49.842 INFO:teuthology.orchestra.run.smithi184.stdout:Total 15 MB/s | 57 MB 00:03 2024-02-05T07:08:49.842 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:08:49.872 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:08:49.873 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:08:50.351 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:08:50.351 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:08:50.536 INFO:teuthology.orchestra.run.smithi188.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2024-02-05T07:08:51.727 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:08:51.814 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2024-02-05T07:08:51.848 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/31 2024-02-05T07:08:51.898 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/31 2024-02-05T07:08:52.284 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/31 2024-02-05T07:08:52.315 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:19.0.0-1241.g164d3be4.el9.x86_64 5/31 2024-02-05T07:08:52.405 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:19.0.0-1241.g164d3be4.el9.x86_64 5/31 2024-02-05T07:08:52.493 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:19.0.0-1241.g164d3be4.el9.x86_64 6/31 2024-02-05T07:08:52.525 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:19.0.0-1241.g164d3be4.el9.x86_64 7/31 2024-02-05T07:08:52.586 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:19.0.0-1241.g164d3be4.el9.x86_64 7/31 2024-02-05T07:08:52.616 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/31 2024-02-05T07:08:52.663 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:19.0.0-1241.g164d3be4.el9. 9/31 2024-02-05T07:08:52.736 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:19.0.0-1241.g164d3be4.el9.x86_64 10/31 2024-02-05T07:08:52.760 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:19.0.0-1241.g164d3be4.el9.x86_6 11/31 2024-02-05T07:08:52.826 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1241.g164d3be4.el9.x86_6 11/31 2024-02-05T07:08:52.931 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2024-02-05T07:08:52.960 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2024-02-05T07:08:53.000 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2024-02-05T07:08:53.032 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2024-02-05T07:08:53.061 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2024-02-05T07:08:53.094 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2024-02-05T07:08:53.419 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2024-02-05T07:08:53.449 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:19.0.0-1241.g164d3be4.el9.x86_64 19/31 2024-02-05T07:08:53.539 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:19.0.0-1241.g164d3be4.el9.x86_64 19/31 2024-02-05T07:08:53.571 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:19.0.0-1241.g164d3be4.el9.x86_64 20/31 2024-02-05T07:08:53.616 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2024-02-05T07:08:54.071 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2024-02-05T07:08:54.102 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:19.0.0-1241.g164d3be4.el9.x86_64 23/31 2024-02-05T07:08:54.173 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:19.0.0-1241.g164d3be4.el9.x86_64 23/31 2024-02-05T07:08:54.242 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:19.0.0-1241.g164d3be4.el9.x86_64 24/31 2024-02-05T07:08:54.271 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:19.0.0-1241.g164d3be4.el9.x8 25/31 2024-02-05T07:08:55.427 INFO:teuthology.orchestra.run.smithi188.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-02-05T07:08:56.469 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.0.0-1241.g164d3be4.el9.x86_64 26/31 2024-02-05T07:08:56.509 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:19.0.0-1241.g164d3be4.el9.x86_64 26/31 2024-02-05T07:08:57.050 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:19.0.0-1241.g164d3be4.el9.x86_64 26/31 2024-02-05T07:08:57.096 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:19.0.0-1241.g164d3be4.el9.x86_64 27/31 2024-02-05T07:08:57.177 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:19.0.0-1241.g164d3be4.el9.x86_64 27/31 2024-02-05T07:08:57.177 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-05T07:08:57.177 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-05T07:08:57.177 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:08:57.222 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:19.0.0-1241.g164d3be4.el9.x86_64 28/31 2024-02-05T07:08:58.035 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:08:58.037 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:08:58.037 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-02-05T07:08:58.037 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:08:58.037 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:08:58.037 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 9.7 M 2024-02-05T07:08:58.037 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrading: 2024-02-05T07:08:58.037 INFO:teuthology.orchestra.run.smithi188.stdout: librados2 x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 3.4 M 2024-02-05T07:08:58.037 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1 x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 3.1 M 2024-02-05T07:08:58.037 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-02-05T07:08:58.038 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options 2024-02-05T07:08:58.038 INFO:teuthology.orchestra.run.smithi188.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-02-05T07:08:58.038 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 5.1 M 2024-02-05T07:08:58.038 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 20 M 2024-02-05T07:08:58.038 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 25 k 2024-02-05T07:08:58.038 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-05T07:08:58.038 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-05T07:08:58.038 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-05T07:08:58.038 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2 x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 743 k 2024-02-05T07:08:58.038 INFO:teuthology.orchestra.run.smithi188.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-05T07:08:58.038 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-02-05T07:08:58.038 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-02-05T07:08:58.038 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1 x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 498 k 2024-02-05T07:08:58.038 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-02-05T07:08:58.039 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2 x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 5.1 M 2024-02-05T07:08:58.039 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-05T07:08:58.039 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-02-05T07:08:58.039 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-05T07:08:58.039 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse 2024-02-05T07:08:58.039 INFO:teuthology.orchestra.run.smithi188.stdout: x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 45 k 2024-02-05T07:08:58.039 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 131 k 2024-02-05T07:08:58.039 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 162 k 2024-02-05T07:08:58.039 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-02-05T07:08:58.039 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 320 k 2024-02-05T07:08:58.039 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 298 k 2024-02-05T07:08:58.039 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 99 k 2024-02-05T07:08:58.039 INFO:teuthology.orchestra.run.smithi188.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-05T07:08:58.039 INFO:teuthology.orchestra.run.smithi188.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-05T07:08:58.040 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:08:58.040 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:08:58.040 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:08:58.040 INFO:teuthology.orchestra.run.smithi188.stdout:Install 27 Packages 2024-02-05T07:08:58.040 INFO:teuthology.orchestra.run.smithi188.stdout:Upgrade 2 Packages 2024-02-05T07:08:58.040 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:08:58.040 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 57 M 2024-02-05T07:08:58.041 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:08:59.019 INFO:teuthology.orchestra.run.smithi188.stdout:(1/29): ceph-base-19.0.0-1241.g164d3be4.el9.x86 6.9 MB/s | 5.1 MB 00:00 2024-02-05T07:08:59.077 INFO:teuthology.orchestra.run.smithi188.stdout:(2/29): ceph-selinux-19.0.0-1241.g164d3be4.el9. 433 kB/s | 25 kB 00:00 2024-02-05T07:08:59.203 INFO:teuthology.orchestra.run.smithi188.stdout:(3/29): libcephfs2-19.0.0-1241.g164d3be4.el9.x8 5.8 MB/s | 743 kB 00:00 2024-02-05T07:08:59.287 INFO:teuthology.orchestra.run.smithi188.stdout:(4/29): libradosstriper1-19.0.0-1241.g164d3be4. 5.8 MB/s | 498 kB 00:00 2024-02-05T07:08:59.945 INFO:teuthology.orchestra.run.smithi188.stdout:(5/29): librgw2-19.0.0-1241.g164d3be4.el9.x86_6 7.7 MB/s | 5.1 MB 00:00 2024-02-05T07:09:00.145 INFO:teuthology.orchestra.run.smithi188.stdout:(6/29): ceph-common-19.0.0-1241.g164d3be4.el9.x 11 MB/s | 20 MB 00:01 2024-02-05T07:09:00.170 INFO:teuthology.orchestra.run.smithi188.stdout:(7/29): python3-ceph-argparse-19.0.0-1241.g164d 200 kB/s | 45 kB 00:00 2024-02-05T07:09:00.212 INFO:teuthology.orchestra.run.smithi188.stdout:(8/29): python3-ceph-common-19.0.0-1241.g164d3b 1.9 MB/s | 131 kB 00:00 2024-02-05T07:09:00.237 INFO:teuthology.orchestra.run.smithi188.stdout:(9/29): python3-cephfs-19.0.0-1241.g164d3be4.el 2.4 MB/s | 162 kB 00:00 2024-02-05T07:09:00.271 INFO:teuthology.orchestra.run.smithi188.stdout:(10/29): python3-rados-19.0.0-1241.g164d3be4.el 5.3 MB/s | 320 kB 00:00 2024-02-05T07:09:00.297 INFO:teuthology.orchestra.run.smithi188.stdout:(11/29): python3-rbd-19.0.0-1241.g164d3be4.el9. 4.9 MB/s | 298 kB 00:00 2024-02-05T07:09:00.322 INFO:teuthology.orchestra.run.smithi188.stdout:(12/29): python3-rgw-19.0.0-1241.g164d3be4.el9. 1.9 MB/s | 99 kB 00:00 2024-02-05T07:09:00.456 INFO:teuthology.orchestra.run.smithi188.stdout:(13/29): ceph-radosgw-19.0.0-1241.g164d3be4.el9 4.5 MB/s | 9.7 MB 00:02 2024-02-05T07:09:00.539 INFO:teuthology.orchestra.run.smithi188.stdout:(14/29): boost-program-options-1.75.0-8.el9.x86 437 kB/s | 106 kB 00:00 2024-02-05T07:09:00.556 INFO:teuthology.orchestra.run.smithi188.stdout:(15/29): librabbitmq-0.11.0-7.el9.x86_64.rpm 594 kB/s | 44 kB 00:00 2024-02-05T07:09:00.589 INFO:teuthology.orchestra.run.smithi188.stdout:(16/29): libpmemobj-1.12.1-1.el9.x86_64.rpm 654 kB/s | 159 kB 00:00 2024-02-05T07:09:00.632 INFO:teuthology.orchestra.run.smithi188.stdout:(17/29): librdkafka-1.6.1-102.el9.x86_64.rpm 7.0 MB/s | 661 kB 00:00 2024-02-05T07:09:00.657 INFO:teuthology.orchestra.run.smithi188.stdout:(18/29): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.7 MB/s | 282 kB 00:00 2024-02-05T07:09:00.674 INFO:teuthology.orchestra.run.smithi188.stdout:(19/29): python3-prettytable-0.7.2-27.el9.noarc 493 kB/s | 41 kB 00:00 2024-02-05T07:09:00.749 INFO:teuthology.orchestra.run.smithi188.stdout:(20/29): libarrow-doc-9.0.0-10.el9.noarch.rpm 348 kB/s | 26 kB 00:00 2024-02-05T07:09:00.816 INFO:teuthology.orchestra.run.smithi188.stdout:(21/29): liboath-2.6.7-2.el9.x86_64.rpm 727 kB/s | 49 kB 00:00 2024-02-05T07:09:00.858 INFO:teuthology.orchestra.run.smithi188.stdout:(22/29): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.3 MB/s | 309 kB 00:00 2024-02-05T07:09:00.883 INFO:teuthology.orchestra.run.smithi188.stdout:(23/29): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-02-05T07:09:00.942 INFO:teuthology.orchestra.run.smithi188.stdout:(24/29): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-02-05T07:09:01.009 INFO:teuthology.orchestra.run.smithi188.stdout:(25/29): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.4 MB/s | 838 kB 00:00 2024-02-05T07:09:01.101 INFO:teuthology.orchestra.run.smithi188.stdout:(26/29): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-02-05T07:09:01.314 INFO:teuthology.orchestra.run.smithi188.stdout:(27/29): librados2-19.0.0-1241.g164d3be4.el9.x8 11 MB/s | 3.4 MB 00:00 2024-02-05T07:09:01.476 INFO:teuthology.orchestra.run.smithi188.stdout:(28/29): libarrow-9.0.0-10.el9.x86_64.rpm 5.5 MB/s | 4.4 MB 00:00 2024-02-05T07:09:01.534 INFO:teuthology.orchestra.run.smithi188.stdout:(29/29): librbd1-19.0.0-1241.g164d3be4.el9.x86_ 7.2 MB/s | 3.1 MB 00:00 2024-02-05T07:09:01.539 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:09:01.539 INFO:teuthology.orchestra.run.smithi188.stdout:Total 16 MB/s | 57 MB 00:03 2024-02-05T07:09:01.539 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:09:01.576 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:09:01.576 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:09:02.055 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:09:02.055 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:09:03.390 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:09:03.491 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/31 2024-02-05T07:09:03.531 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/31 2024-02-05T07:09:03.580 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/31 2024-02-05T07:09:03.966 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/31 2024-02-05T07:09:03.996 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librados2-2:19.0.0-1241.g164d3be4.el9.x86_64 5/31 2024-02-05T07:09:04.079 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:19.0.0-1241.g164d3be4.el9.x86_64 5/31 2024-02-05T07:09:04.167 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rados-2:19.0.0-1241.g164d3be4.el9.x86_64 6/31 2024-02-05T07:09:04.198 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs2-2:19.0.0-1241.g164d3be4.el9.x86_64 7/31 2024-02-05T07:09:04.252 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs2-2:19.0.0-1241.g164d3be4.el9.x86_64 7/31 2024-02-05T07:09:04.281 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/31 2024-02-05T07:09:04.324 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-argparse-2:19.0.0-1241.g164d3be4.el9. 9/31 2024-02-05T07:09:04.401 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cephfs-2:19.0.0-1241.g164d3be4.el9.x86_64 10/31 2024-02-05T07:09:04.425 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libradosstriper1-2:19.0.0-1241.g164d3be4.el9.x86_6 11/31 2024-02-05T07:09:04.490 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1241.g164d3be4.el9.x86_6 11/31 2024-02-05T07:09:04.597 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/31 2024-02-05T07:09:04.633 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/31 2024-02-05T07:09:04.672 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/31 2024-02-05T07:09:04.713 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/31 2024-02-05T07:09:04.742 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/31 2024-02-05T07:09:04.775 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 17/31 2024-02-05T07:09:05.085 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 18/31 2024-02-05T07:09:05.113 INFO:teuthology.orchestra.run.smithi188.stdout: Upgrading : librbd1-2:19.0.0-1241.g164d3be4.el9.x86_64 19/31 2024-02-05T07:09:05.203 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:19.0.0-1241.g164d3be4.el9.x86_64 19/31 2024-02-05T07:09:05.235 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rbd-2:19.0.0-1241.g164d3be4.el9.x86_64 20/31 2024-02-05T07:09:05.278 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 21/31 2024-02-05T07:09:05.727 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 22/31 2024-02-05T07:09:05.757 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librgw2-2:19.0.0-1241.g164d3be4.el9.x86_64 23/31 2024-02-05T07:09:05.828 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librgw2-2:19.0.0-1241.g164d3be4.el9.x86_64 23/31 2024-02-05T07:09:05.896 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rgw-2:19.0.0-1241.g164d3be4.el9.x86_64 24/31 2024-02-05T07:09:05.926 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ceph-common-2:19.0.0-1241.g164d3be4.el9.x8 25/31 2024-02-05T07:09:07.082 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1241.g164d3be4.el9.x86_64 28/31 2024-02-05T07:09:07.082 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2024-02-05T07:09:07.082 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2024-02-05T07:09:07.082 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2024-02-05T07:09:07.082 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2024-02-05T07:09:07.082 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2024-02-05T07:09:07.082 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /root 2024-02-05T07:09:07.083 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2024-02-05T07:09:07.083 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:08.022 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:19.0.0-1241.g164d3be4.el9.x86_64 29/31 2024-02-05T07:09:08.048 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1241.g164d3be4.el9.x86_64 29/31 2024-02-05T07:09:08.048 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:09:08.048 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-05T07:09:08.048 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-05T07:09:08.048 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-05T07:09:08.048 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:08.049 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-02-05T07:09:08.117 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-02-05T07:09:08.117 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2024-02-05T07:09:08.118 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:19.0.0-1241.g164d3be4.el9.x86_64 26/31 2024-02-05T07:09:08.164 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-common-2:19.0.0-1241.g164d3be4.el9.x86_64 26/31 2024-02-05T07:09:08.691 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-common-2:19.0.0-1241.g164d3be4.el9.x86_64 26/31 2024-02-05T07:09:08.725 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-base-2:19.0.0-1241.g164d3be4.el9.x86_64 27/31 2024-02-05T07:09:08.818 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-base-2:19.0.0-1241.g164d3be4.el9.x86_64 27/31 2024-02-05T07:09:08.818 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-05T07:09:08.818 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-05T07:09:08.818 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:08.860 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-selinux-2:19.0.0-1241.g164d3be4.el9.x86_64 28/31 2024-02-05T07:09:09.360 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2024-02-05T07:09:09.360 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:19.0.0-1241.g164d3be4.el9.x86_64 1/31 2024-02-05T07:09:09.360 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:19.0.0-1241.g164d3be4.el9.x86_64 2/31 2024-02-05T07:09:09.360 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:19.0.0-1241.g164d3be4.el9.x86_64 3/31 2024-02-05T07:09:09.360 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:19.0.0-1241.g164d3be4.el9.x86_64 4/31 2024-02-05T07:09:09.360 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:19.0.0-1241.g164d3be4.el9.x86_64 5/31 2024-02-05T07:09:09.360 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:19.0.0-1241.g164d3be4.el9.x86_6 6/31 2024-02-05T07:09:09.360 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:19.0.0-1241.g164d3be4.el9.x86_64 7/31 2024-02-05T07:09:09.360 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1241.g164d3be4.el9. 8/31 2024-02-05T07:09:09.360 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:19.0.0-1241.g164d3be4.el9.x8 9/31 2024-02-05T07:09:09.360 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:19.0.0-1241.g164d3be4.el9.x86_64 10/31 2024-02-05T07:09:09.361 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:19.0.0-1241.g164d3be4.el9.x86_64 11/31 2024-02-05T07:09:09.361 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:19.0.0-1241.g164d3be4.el9.x86_64 12/31 2024-02-05T07:09:09.361 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:19.0.0-1241.g164d3be4.el9.x86_64 13/31 2024-02-05T07:09:09.361 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2024-02-05T07:09:09.361 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2024-02-05T07:09:09.361 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2024-02-05T07:09:09.361 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2024-02-05T07:09:09.361 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2024-02-05T07:09:09.361 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2024-02-05T07:09:09.361 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2024-02-05T07:09:09.361 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2024-02-05T07:09:09.361 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2024-02-05T07:09:09.361 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2024-02-05T07:09:09.361 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2024-02-05T07:09:09.362 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2024-02-05T07:09:09.362 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2024-02-05T07:09:09.362 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2024-02-05T07:09:09.365 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:19.0.0-1241.g164d3be4.el9.x86_64 28/31 2024-02-05T07:09:09.365 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2024-02-05T07:09:09.365 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:19.0.0-1241.g164d3be4.el9.x86_64 30/31 2024-02-05T07:09:10.409 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2024-02-05T07:09:10.410 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:10.410 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2024-02-05T07:09:10.410 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:10.410 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:10.410 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:09:10.410 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-05T07:09:10.410 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:10.410 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:10.410 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:10.410 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:10.410 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-05T07:09:10.410 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-05T07:09:10.410 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-05T07:09:10.411 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:10.411 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-05T07:09:10.411 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-05T07:09:10.411 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-05T07:09:10.411 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:10.411 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-05T07:09:10.411 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:10.411 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-05T07:09:10.411 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-05T07:09:10.411 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-05T07:09:10.411 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:10.411 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:10.411 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:10.411 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-05T07:09:10.412 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:10.412 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:10.412 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:10.412 INFO:teuthology.orchestra.run.smithi184.stdout: re2-1:20211101-3.el9.x86_64 2024-02-05T07:09:10.412 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-05T07:09:10.412 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:10.412 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:09:10.640 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-test 2024-02-05T07:09:11.210 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:28 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:09:11.366 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:09:11.367 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:09:11.367 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-05T07:09:11.367 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:09:11.367 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:09:11.368 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 47 M 2024-02-05T07:09:11.368 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-05T07:09:11.368 INFO:teuthology.orchestra.run.smithi184.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-05T07:09:11.368 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 163 k 2024-02-05T07:09:11.368 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-05T07:09:11.368 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-05T07:09:11.368 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-05T07:09:11.368 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:11.368 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:09:11.368 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:09:11.368 INFO:teuthology.orchestra.run.smithi184.stdout:Install 6 Packages 2024-02-05T07:09:11.368 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:11.369 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 48 M 2024-02-05T07:09:11.369 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 204 M 2024-02-05T07:09:11.369 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:09:11.605 INFO:teuthology.orchestra.run.smithi184.stdout:(1/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 300 kB 00:00 2024-02-05T07:09:11.647 INFO:teuthology.orchestra.run.smithi184.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-02-05T07:09:11.706 INFO:teuthology.orchestra.run.smithi184.stdout:(3/6): jq-1.6-16.el9.x86_64.rpm 3.1 MB/s | 186 kB 00:00 2024-02-05T07:09:11.781 INFO:teuthology.orchestra.run.smithi184.stdout:(4/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2024-02-05T07:09:11.956 INFO:teuthology.orchestra.run.smithi184.stdout:(5/6): libcephsqlite-19.0.0-1241.g164d3be4.el9. 279 kB/s | 163 kB 00:00 2024-02-05T07:09:15.339 INFO:teuthology.orchestra.run.smithi184.stdout:(6/6): ceph-test-19.0.0-1241.g164d3be4.el9.x86_ 12 MB/s | 47 MB 00:03 2024-02-05T07:09:15.342 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:09:15.343 INFO:teuthology.orchestra.run.smithi184.stdout:Total 12 MB/s | 48 MB 00:03 2024-02-05T07:09:15.343 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:09:15.362 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:09:15.362 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:09:15.748 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:09:15.749 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:09:16.322 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:09:16.402 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-05T07:09:16.438 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-05T07:09:16.482 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-05T07:09:16.529 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-05T07:09:16.551 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:19.0.0-1241.g164d3be4.el9.x86_64 5/6 2024-02-05T07:09:18.488 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1241.g164d3be4.el9.x86_64 28/31 2024-02-05T07:09:18.489 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /sys 2024-02-05T07:09:18.489 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /proc 2024-02-05T07:09:18.489 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /mnt 2024-02-05T07:09:18.489 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /var/tmp 2024-02-05T07:09:18.489 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /home 2024-02-05T07:09:18.490 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /root 2024-02-05T07:09:18.492 INFO:teuthology.orchestra.run.smithi188.stdout:skipping the directory /tmp 2024-02-05T07:09:18.492 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:19.373 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-radosgw-2:19.0.0-1241.g164d3be4.el9.x86_64 29/31 2024-02-05T07:09:19.398 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1241.g164d3be4.el9.x86_64 29/31 2024-02-05T07:09:19.398 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:09:19.398 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-05T07:09:19.398 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-05T07:09:19.398 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-05T07:09:19.399 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:19.400 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-02-05T07:09:19.500 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 30/31 2024-02-05T07:09:19.500 INFO:teuthology.orchestra.run.smithi188.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 31/31 2024-02-05T07:09:20.680 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 31/31 2024-02-05T07:09:20.680 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-base-2:19.0.0-1241.g164d3be4.el9.x86_64 1/31 2024-02-05T07:09:20.680 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-common-2:19.0.0-1241.g164d3be4.el9.x86_64 2/31 2024-02-05T07:09:20.680 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-radosgw-2:19.0.0-1241.g164d3be4.el9.x86_64 3/31 2024-02-05T07:09:20.680 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-selinux-2:19.0.0-1241.g164d3be4.el9.x86_64 4/31 2024-02-05T07:09:20.680 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs2-2:19.0.0-1241.g164d3be4.el9.x86_64 5/31 2024-02-05T07:09:20.680 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libradosstriper1-2:19.0.0-1241.g164d3be4.el9.x86_6 6/31 2024-02-05T07:09:20.680 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librgw2-2:19.0.0-1241.g164d3be4.el9.x86_64 7/31 2024-02-05T07:09:20.681 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1241.g164d3be4.el9. 8/31 2024-02-05T07:09:20.681 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ceph-common-2:19.0.0-1241.g164d3be4.el9.x8 9/31 2024-02-05T07:09:20.681 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cephfs-2:19.0.0-1241.g164d3be4.el9.x86_64 10/31 2024-02-05T07:09:20.681 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rados-2:19.0.0-1241.g164d3be4.el9.x86_64 11/31 2024-02-05T07:09:20.681 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rbd-2:19.0.0-1241.g164d3be4.el9.x86_64 12/31 2024-02-05T07:09:20.681 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rgw-2:19.0.0-1241.g164d3be4.el9.x86_64 13/31 2024-02-05T07:09:20.681 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/31 2024-02-05T07:09:20.681 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/31 2024-02-05T07:09:20.681 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/31 2024-02-05T07:09:20.681 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/31 2024-02-05T07:09:20.681 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/31 2024-02-05T07:09:20.681 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/31 2024-02-05T07:09:20.681 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 20/31 2024-02-05T07:09:20.681 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 21/31 2024-02-05T07:09:20.682 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 22/31 2024-02-05T07:09:20.682 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 23/31 2024-02-05T07:09:20.682 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 24/31 2024-02-05T07:09:20.682 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 25/31 2024-02-05T07:09:20.682 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : re2-1:20211101-3.el9.x86_64 26/31 2024-02-05T07:09:20.682 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 27/31 2024-02-05T07:09:20.682 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:19.0.0-1241.g164d3be4.el9.x86_64 28/31 2024-02-05T07:09:20.682 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 29/31 2024-02-05T07:09:20.682 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:19.0.0-1241.g164d3be4.el9.x86_64 30/31 2024-02-05T07:09:21.029 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1241.g164d3be4.el9.x86_64 5/6 2024-02-05T07:09:21.099 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:19.0.0-1241.g164d3be4.el9.x86_64 6/6 2024-02-05T07:09:21.780 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 31/31 2024-02-05T07:09:21.780 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:21.780 INFO:teuthology.orchestra.run.smithi188.stdout:Upgraded: 2024-02-05T07:09:21.780 INFO:teuthology.orchestra.run.smithi188.stdout: librados2-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:21.781 INFO:teuthology.orchestra.run.smithi188.stdout: librbd1-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:21.781 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:09:21.781 INFO:teuthology.orchestra.run.smithi188.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-05T07:09:21.781 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-base-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:21.781 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-common-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:21.781 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-radosgw-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:21.781 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-selinux-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:21.781 INFO:teuthology.orchestra.run.smithi188.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-05T07:09:21.781 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-05T07:09:21.781 INFO:teuthology.orchestra.run.smithi188.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-05T07:09:21.781 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs2-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:21.781 INFO:teuthology.orchestra.run.smithi188.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-05T07:09:21.781 INFO:teuthology.orchestra.run.smithi188.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-05T07:09:21.782 INFO:teuthology.orchestra.run.smithi188.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-05T07:09:21.782 INFO:teuthology.orchestra.run.smithi188.stdout: libradosstriper1-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:21.782 INFO:teuthology.orchestra.run.smithi188.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-05T07:09:21.782 INFO:teuthology.orchestra.run.smithi188.stdout: librgw2-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:21.782 INFO:teuthology.orchestra.run.smithi188.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-05T07:09:21.782 INFO:teuthology.orchestra.run.smithi188.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-05T07:09:21.782 INFO:teuthology.orchestra.run.smithi188.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-05T07:09:21.782 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-argparse-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:21.782 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ceph-common-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:21.782 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cephfs-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:21.782 INFO:teuthology.orchestra.run.smithi188.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-05T07:09:21.782 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rados-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:21.782 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rbd-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:21.783 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rgw-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:21.783 INFO:teuthology.orchestra.run.smithi188.stdout: re2-1:20211101-3.el9.x86_64 2024-02-05T07:09:21.783 INFO:teuthology.orchestra.run.smithi188.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-05T07:09:21.783 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:21.783 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:09:22.114 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-test 2024-02-05T07:09:22.710 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:27 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:09:22.867 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:09:22.868 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:09:22.868 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-02-05T07:09:22.868 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:09:22.868 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:09:22.868 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 47 M 2024-02-05T07:09:22.868 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-02-05T07:09:22.868 INFO:teuthology.orchestra.run.smithi188.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-02-05T07:09:22.869 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 163 k 2024-02-05T07:09:22.869 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-02-05T07:09:22.869 INFO:teuthology.orchestra.run.smithi188.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-02-05T07:09:22.869 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-02-05T07:09:22.869 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:22.869 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:09:22.869 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:09:22.869 INFO:teuthology.orchestra.run.smithi188.stdout:Install 6 Packages 2024-02-05T07:09:22.869 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:22.870 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 48 M 2024-02-05T07:09:22.870 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 204 M 2024-02-05T07:09:22.870 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:09:23.066 INFO:teuthology.orchestra.run.smithi188.stdout:(1/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 300 kB 00:00 2024-02-05T07:09:23.108 INFO:teuthology.orchestra.run.smithi188.stdout:(2/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-02-05T07:09:23.158 INFO:teuthology.orchestra.run.smithi188.stdout:(3/6): jq-1.6-16.el9.x86_64.rpm 3.6 MB/s | 186 kB 00:00 2024-02-05T07:09:23.184 INFO:teuthology.orchestra.run.smithi188.stdout:(4/6): libcephsqlite-19.0.0-1241.g164d3be4.el9. 521 kB/s | 163 kB 00:00 2024-02-05T07:09:23.209 INFO:teuthology.orchestra.run.smithi188.stdout:(5/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-02-05T07:09:23.411 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-test-2:19.0.0-1241.g164d3be4.el9.x86_64 6/6 2024-02-05T07:09:23.411 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:19.0.0-1241.g164d3be4.el9.x86_64 1/6 2024-02-05T07:09:23.411 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:19.0.0-1241.g164d3be4.el9.x86_64 2/6 2024-02-05T07:09:23.411 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-05T07:09:23.411 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-05T07:09:23.411 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-05T07:09:23.802 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-05T07:09:23.802 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:23.803 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:09:23.803 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:23.803 INFO:teuthology.orchestra.run.smithi184.stdout: jq-1.6-16.el9.x86_64 2024-02-05T07:09:23.803 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:23.803 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-05T07:09:23.803 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-05T07:09:23.803 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-05T07:09:23.803 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:23.803 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:09:24.107 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph 2024-02-05T07:09:24.707 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:41 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:09:24.876 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:09:24.878 INFO:teuthology.orchestra.run.smithi184.stdout:========================================================================================= 2024-02-05T07:09:24.879 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-05T07:09:24.879 INFO:teuthology.orchestra.run.smithi184.stdout:========================================================================================= 2024-02-05T07:09:24.879 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:09:24.879 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 6.6 k 2024-02-05T07:09:24.879 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-05T07:09:24.879 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 2.1 M 2024-02-05T07:09:24.879 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 1.5 M 2024-02-05T07:09:24.879 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 247 k 2024-02-05T07:09:24.879 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 4.7 M 2024-02-05T07:09:24.879 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 17 M 2024-02-05T07:09:24.880 INFO:teuthology.orchestra.run.smithi184.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-05T07:09:24.880 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-05T07:09:24.880 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-05T07:09:24.880 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-05T07:09:24.880 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-05T07:09:24.880 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-05T07:09:24.880 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-05T07:09:24.880 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-05T07:09:24.880 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-05T07:09:24.880 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-05T07:09:24.880 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-05T07:09:24.881 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-05T07:09:24.881 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-05T07:09:24.881 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-05T07:09:24.881 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-05T07:09:24.881 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-05T07:09:24.881 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-05T07:09:24.881 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-05T07:09:24.881 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-05T07:09:24.881 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-05T07:09:24.881 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-05T07:09:24.881 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-05T07:09:24.881 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-05T07:09:24.881 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-05T07:09:24.882 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-05T07:09:24.882 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-05T07:09:24.882 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-05T07:09:24.882 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-05T07:09:24.882 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-05T07:09:24.882 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-05T07:09:24.882 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:24.882 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:09:24.882 INFO:teuthology.orchestra.run.smithi184.stdout:========================================================================================= 2024-02-05T07:09:24.882 INFO:teuthology.orchestra.run.smithi184.stdout:Install 36 Packages 2024-02-05T07:09:24.882 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:24.883 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 30 M 2024-02-05T07:09:24.883 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 107 M 2024-02-05T07:09:24.883 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:09:25.184 INFO:teuthology.orchestra.run.smithi188.stdout:(6/6): ceph-test-19.0.0-1241.g164d3be4.el9.x86_ 20 MB/s | 47 MB 00:02 2024-02-05T07:09:25.187 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:09:25.187 INFO:teuthology.orchestra.run.smithi188.stdout:Total 21 MB/s | 48 MB 00:02 2024-02-05T07:09:25.188 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:09:25.208 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:09:25.209 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:09:25.447 INFO:teuthology.orchestra.run.smithi184.stdout:(1/36): ceph-19.0.0-1241.g164d3be4.el9.x86_64.r 29 kB/s | 6.6 kB 00:00 2024-02-05T07:09:25.588 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:09:25.588 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:09:25.755 INFO:teuthology.orchestra.run.smithi184.stdout:(2/36): ceph-mgr-19.0.0-1241.g164d3be4.el9.x86_ 2.8 MB/s | 1.5 MB 00:00 2024-02-05T07:09:25.789 INFO:teuthology.orchestra.run.smithi184.stdout:(3/36): ceph-mds-19.0.0-1241.g164d3be4.el9.x86_ 3.8 MB/s | 2.1 MB 00:00 2024-02-05T07:09:25.872 INFO:teuthology.orchestra.run.smithi184.stdout:(4/36): ceph-mgr-modules-core-19.0.0-1241.g164d 2.9 MB/s | 247 kB 00:00 2024-02-05T07:09:26.023 INFO:teuthology.orchestra.run.smithi184.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2024-02-05T07:09:26.073 INFO:teuthology.orchestra.run.smithi184.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-02-05T07:09:26.115 INFO:teuthology.orchestra.run.smithi184.stdout:(7/36): python3-markupsafe-1.1.1-12.el9.x86_64. 761 kB/s | 32 kB 00:00 2024-02-05T07:09:26.159 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:09:26.160 INFO:teuthology.orchestra.run.smithi184.stdout:(8/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-02-05T07:09:26.199 INFO:teuthology.orchestra.run.smithi184.stdout:(9/36): python3-toml-0.10.2-6.el9.noarch.rpm 928 kB/s | 39 kB 00:00 2024-02-05T07:09:26.235 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 1/6 2024-02-05T07:09:26.249 INFO:teuthology.orchestra.run.smithi184.stdout:(10/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-02-05T07:09:26.275 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : jq-1.6-16.el9.x86_64 2/6 2024-02-05T07:09:26.318 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/6 2024-02-05T07:09:26.333 INFO:teuthology.orchestra.run.smithi184.stdout:(11/36): ceph-mon-19.0.0-1241.g164d3be4.el9.x86 5.3 MB/s | 4.7 MB 00:00 2024-02-05T07:09:26.365 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 4/6 2024-02-05T07:09:26.391 INFO:teuthology.orchestra.run.smithi184.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 8.1 MB/s | 1.1 MB 00:00 2024-02-05T07:09:26.395 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephsqlite-2:19.0.0-1241.g164d3be4.el9.x86_64 5/6 2024-02-05T07:09:26.417 INFO:teuthology.orchestra.run.smithi184.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-02-05T07:09:26.442 INFO:teuthology.orchestra.run.smithi184.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-02-05T07:09:26.467 INFO:teuthology.orchestra.run.smithi184.stdout:(15/36): python3-requests-2.25.1-8.el9.noarch.r 2.2 MB/s | 113 kB 00:00 2024-02-05T07:09:26.484 INFO:teuthology.orchestra.run.smithi184.stdout:(16/36): python3-urllib3-1.26.5-5.el9.noarch.rp 4.4 MB/s | 187 kB 00:00 2024-02-05T07:09:26.685 INFO:teuthology.orchestra.run.smithi184.stdout:(17/36): ceph-osd-19.0.0-1241.g164d3be4.el9.x86 18 MB/s | 17 MB 00:00 2024-02-05T07:09:26.702 INFO:teuthology.orchestra.run.smithi184.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 95 kB/s | 22 kB 00:00 2024-02-05T07:09:26.994 INFO:teuthology.orchestra.run.smithi184.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 141 kB/s | 43 kB 00:00 2024-02-05T07:09:27.019 INFO:teuthology.orchestra.run.smithi184.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 283 kB/s | 151 kB 00:00 2024-02-05T07:09:27.086 INFO:teuthology.orchestra.run.smithi184.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 447 kB/s | 172 kB 00:00 2024-02-05T07:09:27.111 INFO:teuthology.orchestra.run.smithi184.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 116 kB/s | 11 kB 00:00 2024-02-05T07:09:27.180 INFO:teuthology.orchestra.run.smithi184.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 192 kB/s | 18 kB 00:00 2024-02-05T07:09:27.195 INFO:teuthology.orchestra.run.smithi184.stdout:(24/36): python3-jaraco-collections-3.0.0-8.el9 277 kB/s | 23 kB 00:00 2024-02-05T07:09:27.237 INFO:teuthology.orchestra.run.smithi184.stdout:(25/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.4 MB/s | 358 kB 00:00 2024-02-05T07:09:27.262 INFO:teuthology.orchestra.run.smithi184.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 231 kB/s | 19 kB 00:00 2024-02-05T07:09:27.279 INFO:teuthology.orchestra.run.smithi184.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 235 kB/s | 20 kB 00:00 2024-02-05T07:09:27.321 INFO:teuthology.orchestra.run.smithi184.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 552 kB/s | 46 kB 00:00 2024-02-05T07:09:27.354 INFO:teuthology.orchestra.run.smithi184.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 857 kB/s | 79 kB 00:00 2024-02-05T07:09:27.413 INFO:teuthology.orchestra.run.smithi184.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 179 kB/s | 16 kB 00:00 2024-02-05T07:09:27.447 INFO:teuthology.orchestra.run.smithi184.stdout:(31/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 978 kB/s | 90 kB 00:00 2024-02-05T07:09:27.472 INFO:teuthology.orchestra.run.smithi184.stdout:(32/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-02-05T07:09:27.497 INFO:teuthology.orchestra.run.smithi184.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 426 kB/s | 36 kB 00:00 2024-02-05T07:09:27.614 INFO:teuthology.orchestra.run.smithi184.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-02-05T07:09:27.631 INFO:teuthology.orchestra.run.smithi184.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 150 kB/s | 20 kB 00:00 2024-02-05T07:09:27.656 INFO:teuthology.orchestra.run.smithi184.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.3 MB/s | 427 kB 00:00 2024-02-05T07:09:27.660 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:09:27.660 INFO:teuthology.orchestra.run.smithi184.stdout:Total 11 MB/s | 30 MB 00:02 2024-02-05T07:09:27.676 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:09:27.722 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:09:27.723 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:09:28.142 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:09:28.142 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:09:29.497 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:09:29.568 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-02-05T07:09:29.600 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-02-05T07:09:29.628 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-02-05T07:09:29.697 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-02-05T07:09:29.735 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-02-05T07:09:29.768 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-02-05T07:09:29.860 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-02-05T07:09:29.929 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-02-05T07:09:29.971 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-02-05T07:09:30.033 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-02-05T07:09:30.087 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-02-05T07:09:30.126 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-02-05T07:09:30.174 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-02-05T07:09:30.235 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-02-05T07:09:30.414 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-02-05T07:09:30.464 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-02-05T07:09:30.509 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-02-05T07:09:30.545 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-02-05T07:09:30.575 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-02-05T07:09:30.659 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-02-05T07:09:30.694 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-02-05T07:09:30.727 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-02-05T07:09:30.759 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-02-05T07:09:30.794 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-02-05T07:09:30.837 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-02-05T07:09:30.874 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1241.g164d3be4.el9.x86_64 5/6 2024-02-05T07:09:30.925 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-02-05T07:09:30.953 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-test-2:19.0.0-1241.g164d3be4.el9.x86_64 6/6 2024-02-05T07:09:30.968 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-02-05T07:09:31.039 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-02-05T07:09:31.177 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-02-05T07:09:31.294 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-02-05T07:09:31.460 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1241.g164d3be4.el9. 31/36 2024-02-05T07:09:31.489 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:19.0.0-1241.g164d3be4.el9.x86_64 32/36 2024-02-05T07:09:31.515 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1241.g164d3be4.el9.x86_64 32/36 2024-02-05T07:09:31.515 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:09:31.515 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-05T07:09:31.515 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-05T07:09:31.515 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-05T07:09:31.516 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:32.957 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:19.0.0-1241.g164d3be4.el9.x86_64 33/36 2024-02-05T07:09:32.983 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:19.0.0-1241.g164d3be4.el9.x86_64 33/36 2024-02-05T07:09:32.984 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:09:32.984 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-05T07:09:32.984 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-05T07:09:32.984 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-05T07:09:32.984 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:33.424 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:19.0.0-1241.g164d3be4.el9.x86_64 34/36 2024-02-05T07:09:33.447 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:19.0.0-1241.g164d3be4.el9.x86_64 34/36 2024-02-05T07:09:33.447 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:09:33.447 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-05T07:09:33.447 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-05T07:09:33.447 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-05T07:09:33.447 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:33.579 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-test-2:19.0.0-1241.g164d3be4.el9.x86_64 6/6 2024-02-05T07:09:33.579 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-test-2:19.0.0-1241.g164d3be4.el9.x86_64 1/6 2024-02-05T07:09:33.579 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephsqlite-2:19.0.0-1241.g164d3be4.el9.x86_64 2/6 2024-02-05T07:09:33.580 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 3/6 2024-02-05T07:09:33.580 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/6 2024-02-05T07:09:33.580 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : jq-1.6-16.el9.x86_64 5/6 2024-02-05T07:09:33.658 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:19.0.0-1241.g164d3be4.el9.x86_64 35/36 2024-02-05T07:09:33.681 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:19.0.0-1241.g164d3be4.el9.x86_64 35/36 2024-02-05T07:09:33.681 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:09:33.682 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-05T07:09:33.682 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-05T07:09:33.682 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-05T07:09:33.682 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:33.748 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:19.0.0-1241.g164d3be4.el9.x86_64 36/36 2024-02-05T07:09:34.008 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 6/6 2024-02-05T07:09:34.009 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:34.009 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:09:34.009 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-test-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:34.009 INFO:teuthology.orchestra.run.smithi188.stdout: jq-1.6-16.el9.x86_64 2024-02-05T07:09:34.009 INFO:teuthology.orchestra.run.smithi188.stdout: libcephsqlite-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:34.010 INFO:teuthology.orchestra.run.smithi188.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-02-05T07:09:34.010 INFO:teuthology.orchestra.run.smithi188.stdout: socat-1.7.4.1-5.el9.x86_64 2024-02-05T07:09:34.010 INFO:teuthology.orchestra.run.smithi188.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-02-05T07:09:34.010 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:34.010 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:09:34.275 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph 2024-02-05T07:09:34.847 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:39 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:09:35.018 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:09:35.021 INFO:teuthology.orchestra.run.smithi188.stdout:========================================================================================= 2024-02-05T07:09:35.021 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-02-05T07:09:35.021 INFO:teuthology.orchestra.run.smithi188.stdout:========================================================================================= 2024-02-05T07:09:35.021 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:09:35.021 INFO:teuthology.orchestra.run.smithi188.stdout: ceph x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 6.6 k 2024-02-05T07:09:35.021 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-02-05T07:09:35.021 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 2.1 M 2024-02-05T07:09:35.021 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 1.5 M 2024-02-05T07:09:35.021 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 247 k 2024-02-05T07:09:35.021 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 4.7 M 2024-02-05T07:09:35.021 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 17 M 2024-02-05T07:09:35.021 INFO:teuthology.orchestra.run.smithi188.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-02-05T07:09:35.021 INFO:teuthology.orchestra.run.smithi188.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-02-05T07:09:35.022 INFO:teuthology.orchestra.run.smithi188.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-02-05T07:09:35.022 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-05T07:09:35.022 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-02-05T07:09:35.022 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-05T07:09:35.022 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-05T07:09:35.022 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-02-05T07:09:35.022 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-05T07:09:35.022 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-05T07:09:35.022 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-05T07:09:35.022 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-05T07:09:35.022 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-05T07:09:35.022 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-05T07:09:35.022 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-02-05T07:09:35.022 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-02-05T07:09:35.023 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-05T07:09:35.023 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-05T07:09:35.023 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-02-05T07:09:35.023 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-05T07:09:35.023 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-05T07:09:35.023 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-02-05T07:09:35.023 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-02-05T07:09:35.023 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests noarch 2.25.1-8.el9 CentOS-BaseOS 113 k 2024-02-05T07:09:35.023 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-05T07:09:35.023 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-02-05T07:09:35.023 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-02-05T07:09:35.023 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-05T07:09:35.023 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-05T07:09:35.023 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-05T07:09:35.024 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:35.024 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:09:35.024 INFO:teuthology.orchestra.run.smithi188.stdout:========================================================================================= 2024-02-05T07:09:35.024 INFO:teuthology.orchestra.run.smithi188.stdout:Install 36 Packages 2024-02-05T07:09:35.024 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:35.024 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 30 M 2024-02-05T07:09:35.024 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 107 M 2024-02-05T07:09:35.025 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:09:35.397 INFO:teuthology.orchestra.run.smithi188.stdout:(1/36): ceph-19.0.0-1241.g164d3be4.el9.x86_64.r 41 kB/s | 6.6 kB 00:00 2024-02-05T07:09:35.658 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-2:19.0.0-1241.g164d3be4.el9.x86_64 36/36 2024-02-05T07:09:35.659 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:19.0.0-1241.g164d3be4.el9.x86_64 1/36 2024-02-05T07:09:35.659 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:19.0.0-1241.g164d3be4.el9.x86_64 2/36 2024-02-05T07:09:35.659 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:19.0.0-1241.g164d3be4.el9.x86_64 3/36 2024-02-05T07:09:35.659 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:19.0.0-1241.g164d3be4.el9.x86_64 4/36 2024-02-05T07:09:35.659 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:19.0.0-1241.g164d3be4.el9.x86_64 5/36 2024-02-05T07:09:35.659 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1241.g164d3be4.el9. 6/36 2024-02-05T07:09:35.659 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-02-05T07:09:35.659 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-02-05T07:09:35.659 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-02-05T07:09:35.659 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-02-05T07:09:35.660 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-02-05T07:09:35.660 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-02-05T07:09:35.660 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-02-05T07:09:35.660 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-02-05T07:09:35.660 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-02-05T07:09:35.660 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/36 2024-02-05T07:09:35.660 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 17/36 2024-02-05T07:09:35.660 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-02-05T07:09:35.660 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-02-05T07:09:35.660 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-02-05T07:09:35.660 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-02-05T07:09:35.660 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-02-05T07:09:35.660 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-02-05T07:09:35.661 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-02-05T07:09:35.661 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-02-05T07:09:35.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-02-05T07:09:35.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-02-05T07:09:35.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-02-05T07:09:35.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-02-05T07:09:35.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-02-05T07:09:35.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-02-05T07:09:35.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-02-05T07:09:35.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-02-05T07:09:35.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-02-05T07:09:35.662 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-02-05T07:09:35.822 INFO:teuthology.orchestra.run.smithi188.stdout:(2/36): ceph-mon-19.0.0-1241.g164d3be4.el9.x86_ 11 MB/s | 4.7 MB 00:00 2024-02-05T07:09:35.889 INFO:teuthology.orchestra.run.smithi188.stdout:(3/36): ceph-mds-19.0.0-1241.g164d3be4.el9.x86_ 3.3 MB/s | 2.1 MB 00:00 2024-02-05T07:09:36.006 INFO:teuthology.orchestra.run.smithi188.stdout:(4/36): ceph-mgr-19.0.0-1241.g164d3be4.el9.x86_ 1.9 MB/s | 1.5 MB 00:00 2024-02-05T07:09:36.031 INFO:teuthology.orchestra.run.smithi188.stdout:(5/36): ceph-mgr-modules-core-19.0.0-1241.g164d 1.7 MB/s | 247 kB 00:00 2024-02-05T07:09:36.173 INFO:teuthology.orchestra.run.smithi188.stdout:(6/36): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2024-02-05T07:09:36.199 INFO:teuthology.orchestra.run.smithi188.stdout:(7/36): python3-mako-1.1.4-6.el9.noarch.rpm 1.0 MB/s | 144 kB 00:00 2024-02-05T07:09:36.224 INFO:teuthology.orchestra.run.smithi188.stdout:(8/36): python3-markupsafe-1.1.1-12.el9.x86_64. 628 kB/s | 32 kB 00:00 2024-02-05T07:09:36.249 INFO:teuthology.orchestra.run.smithi188.stdout:(9/36): python3-pytz-2021.1-5.el9.noarch.rpm 941 kB/s | 47 kB 00:00 2024-02-05T07:09:36.274 INFO:teuthology.orchestra.run.smithi188.stdout:(10/36): python3-toml-0.10.2-6.el9.noarch.rpm 773 kB/s | 39 kB 00:00 2024-02-05T07:09:36.308 INFO:teuthology.orchestra.run.smithi188.stdout:(11/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-02-05T07:09:36.367 INFO:teuthology.orchestra.run.smithi188.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 12 MB/s | 1.1 MB 00:00 2024-02-05T07:09:36.392 INFO:teuthology.orchestra.run.smithi188.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-02-05T07:09:36.417 INFO:teuthology.orchestra.run.smithi188.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 2.4 MB/s | 124 kB 00:00 2024-02-05T07:09:36.442 INFO:teuthology.orchestra.run.smithi188.stdout:(15/36): python3-requests-2.25.1-8.el9.noarch.r 2.2 MB/s | 113 kB 00:00 2024-02-05T07:09:36.468 INFO:teuthology.orchestra.run.smithi188.stdout:(16/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 187 kB 00:00 2024-02-05T07:09:36.643 INFO:teuthology.orchestra.run.smithi188.stdout:(17/36): ceph-osd-19.0.0-1241.g164d3be4.el9.x86 20 MB/s | 17 MB 00:00 2024-02-05T07:09:36.743 INFO:teuthology.orchestra.run.smithi188.stdout:(18/36): lua-devel-5.4.4-4.el9.x86_64.rpm 74 kB/s | 22 kB 00:00 2024-02-05T07:09:36.801 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-02-05T07:09:36.802 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:36.802 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:09:36.802 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:36.802 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:36.802 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:36.802 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:09:36.802 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:36.802 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:36.802 INFO:teuthology.orchestra.run.smithi184.stdout: lua-5.4.4-4.el9.x86_64 2024-02-05T07:09:36.802 INFO:teuthology.orchestra.run.smithi184.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-05T07:09:36.802 INFO:teuthology.orchestra.run.smithi184.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-05T07:09:36.802 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-05T07:09:36.803 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-05T07:09:36.803 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-05T07:09:36.803 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-05T07:09:36.803 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-05T07:09:36.803 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-05T07:09:36.803 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-05T07:09:36.803 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-05T07:09:36.803 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-05T07:09:36.803 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-05T07:09:36.803 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-05T07:09:36.803 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-05T07:09:36.803 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-05T07:09:36.804 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-05T07:09:36.804 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-05T07:09:36.804 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply-3.11-14.el9.noarch 2024-02-05T07:09:36.804 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-05T07:09:36.804 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-05T07:09:36.804 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-05T07:09:36.804 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-05T07:09:36.804 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-05T07:09:36.804 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-05T07:09:36.804 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-05T07:09:36.804 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-05T07:09:36.804 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-05T07:09:36.805 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-05T07:09:36.805 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-05T07:09:36.805 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:36.805 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:09:36.944 INFO:teuthology.orchestra.run.smithi188.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 318 kB/s | 151 kB 00:00 2024-02-05T07:09:36.977 INFO:teuthology.orchestra.run.smithi188.stdout:(20/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 130 kB/s | 43 kB 00:00 2024-02-05T07:09:37.120 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-base 2024-02-05T07:09:37.161 INFO:teuthology.orchestra.run.smithi188.stdout:(21/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.6 MB/s | 358 kB 00:00 2024-02-05T07:09:37.186 INFO:teuthology.orchestra.run.smithi188.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 51 kB/s | 11 kB 00:00 2024-02-05T07:09:37.211 INFO:teuthology.orchestra.run.smithi188.stdout:(23/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 367 kB/s | 172 kB 00:00 2024-02-05T07:09:37.320 INFO:teuthology.orchestra.run.smithi188.stdout:(24/36): python3-jaraco-classes-3.2.1-5.el9.noa 111 kB/s | 18 kB 00:00 2024-02-05T07:09:37.345 INFO:teuthology.orchestra.run.smithi188.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 146 kB/s | 23 kB 00:00 2024-02-05T07:09:37.370 INFO:teuthology.orchestra.run.smithi188.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 122 kB/s | 19 kB 00:00 2024-02-05T07:09:37.496 INFO:teuthology.orchestra.run.smithi188.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 112 kB/s | 20 kB 00:00 2024-02-05T07:09:37.521 INFO:teuthology.orchestra.run.smithi188.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 308 kB/s | 46 kB 00:00 2024-02-05T07:09:37.546 INFO:teuthology.orchestra.run.smithi188.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 449 kB/s | 79 kB 00:00 2024-02-05T07:09:37.613 INFO:teuthology.orchestra.run.smithi188.stdout:(30/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-02-05T07:09:37.630 INFO:teuthology.orchestra.run.smithi188.stdout:(31/36): python3-portend-3.1.0-2.el9.noarch.rpm 151 kB/s | 16 kB 00:00 2024-02-05T07:09:37.655 INFO:teuthology.orchestra.run.smithi188.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 827 kB/s | 90 kB 00:00 2024-02-05T07:09:37.685 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:54 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:09:37.706 INFO:teuthology.orchestra.run.smithi188.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 386 kB/s | 36 kB 00:00 2024-02-05T07:09:37.789 INFO:teuthology.orchestra.run.smithi184.stdout:Package ceph-base-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:09:37.806 INFO:teuthology.orchestra.run.smithi188.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-02-05T07:09:37.831 INFO:teuthology.orchestra.run.smithi188.stdout:(35/36): python3-zc-lockfile-2.0-10.el9.noarch. 160 kB/s | 20 kB 00:00 2024-02-05T07:09:37.841 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:09:37.842 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-05T07:09:37.842 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:09:37.857 INFO:teuthology.orchestra.run.smithi188.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.1 MB/s | 427 kB 00:00 2024-02-05T07:09:37.860 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:09:37.860 INFO:teuthology.orchestra.run.smithi188.stdout:Total 10 MB/s | 30 MB 00:02 2024-02-05T07:09:37.877 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:09:37.909 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install cephadm 2024-02-05T07:09:37.921 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:09:37.921 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:09:38.312 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:09:38.313 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:09:38.466 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:55 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:09:38.623 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:09:38.624 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:09:38.624 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-05T07:09:38.624 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:09:38.624 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:09:38.625 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 748 k 2024-02-05T07:09:38.625 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:38.625 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:09:38.625 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:09:38.625 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-02-05T07:09:38.625 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:38.625 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 748 k 2024-02-05T07:09:38.625 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 754 k 2024-02-05T07:09:38.625 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:09:38.907 INFO:teuthology.orchestra.run.smithi184.stdout:cephadm-19.0.0-1241.g164d3be4.el9.noarch.rpm 2.6 MB/s | 748 kB 00:00 2024-02-05T07:09:38.907 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:09:38.908 INFO:teuthology.orchestra.run.smithi184.stdout:Total 2.6 MB/s | 748 kB 00:00 2024-02-05T07:09:38.908 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:09:38.913 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:09:38.913 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:09:38.919 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:09:38.919 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:09:38.990 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:09:39.355 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 1/1 2024-02-05T07:09:39.437 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 1/1 2024-02-05T07:09:39.659 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:09:39.726 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-02-05T07:09:39.758 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-02-05T07:09:39.787 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-02-05T07:09:39.839 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 1/1 2024-02-05T07:09:39.856 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-02-05T07:09:39.902 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-02-05T07:09:39.960 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-02-05T07:09:40.051 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-02-05T07:09:40.138 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-02-05T07:09:40.156 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 1/1 2024-02-05T07:09:40.156 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:40.156 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:09:40.156 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:09:40.156 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:40.156 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:09:40.183 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-02-05T07:09:40.259 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-02-05T07:09:40.313 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-02-05T07:09:40.328 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-immutable-object-cache 2024-02-05T07:09:40.352 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-02-05T07:09:40.409 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-02-05T07:09:40.468 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-02-05T07:09:40.657 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-02-05T07:09:40.697 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-02-05T07:09:40.733 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-02-05T07:09:40.772 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-02-05T07:09:40.801 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-02-05T07:09:40.878 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-02-05T07:09:40.899 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:57 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:09:40.920 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-02-05T07:09:40.953 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-02-05T07:09:40.994 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-02-05T07:09:41.029 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-02-05T07:09:41.057 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:09:41.057 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:09:41.057 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repo Size 2024-02-05T07:09:41.057 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:09:41.057 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:09:41.057 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 145 k 2024-02-05T07:09:41.057 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:41.057 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:09:41.058 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:09:41.058 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-02-05T07:09:41.058 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:41.058 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 145 k 2024-02-05T07:09:41.058 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 436 k 2024-02-05T07:09:41.058 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:09:41.064 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-02-05T07:09:41.152 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-02-05T07:09:41.195 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-02-05T07:09:41.267 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-02-05T07:09:41.404 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-02-05T07:09:41.404 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-immutable-object-cache-19.0.0-1241.g164d3b 420 kB/s | 145 kB 00:00 2024-02-05T07:09:41.405 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:09:41.405 INFO:teuthology.orchestra.run.smithi184.stdout:Total 419 kB/s | 145 kB 00:00 2024-02-05T07:09:41.405 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:09:41.412 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:09:41.412 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:09:41.465 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:09:41.465 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:09:41.538 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-02-05T07:09:41.627 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:09:41.688 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1241.g164d3be4. 1/1 2024-02-05T07:09:41.696 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1241.g164d3be4.el9. 31/36 2024-02-05T07:09:41.713 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1241.g164d3be4. 1/1 2024-02-05T07:09:41.713 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:09:41.713 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-05T07:09:41.714 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:41.735 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-2:19.0.0-1241.g164d3be4.el9.x86_64 32/36 2024-02-05T07:09:41.757 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1241.g164d3be4.el9.x86_64 32/36 2024-02-05T07:09:41.757 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:09:41.757 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-05T07:09:41.757 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-05T07:09:41.757 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-05T07:09:41.757 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:42.739 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1241.g164d3be4. 1/1 2024-02-05T07:09:42.739 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:42.739 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:09:42.739 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:42.740 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:42.740 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:09:42.970 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr 2024-02-05T07:09:43.209 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-osd-2:19.0.0-1241.g164d3be4.el9.x86_64 33/36 2024-02-05T07:09:43.235 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-osd-2:19.0.0-1241.g164d3be4.el9.x86_64 33/36 2024-02-05T07:09:43.235 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:09:43.235 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-05T07:09:43.236 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-05T07:09:43.236 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-05T07:09:43.236 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:43.553 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:00 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:09:43.658 INFO:teuthology.orchestra.run.smithi184.stdout:Package ceph-mgr-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:09:43.693 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mon-2:19.0.0-1241.g164d3be4.el9.x86_64 34/36 2024-02-05T07:09:43.709 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:09:43.710 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-05T07:09:43.710 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:09:43.716 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mon-2:19.0.0-1241.g164d3be4.el9.x86_64 34/36 2024-02-05T07:09:43.716 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:09:43.716 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-05T07:09:43.716 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-05T07:09:43.716 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-05T07:09:43.716 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:43.775 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-dashboard 2024-02-05T07:09:43.935 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mds-2:19.0.0-1241.g164d3be4.el9.x86_64 35/36 2024-02-05T07:09:43.958 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mds-2:19.0.0-1241.g164d3be4.el9.x86_64 35/36 2024-02-05T07:09:43.958 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:09:43.958 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-05T07:09:43.958 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-05T07:09:43.958 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-05T07:09:43.958 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:44.024 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-2:19.0.0-1241.g164d3be4.el9.x86_64 36/36 2024-02-05T07:09:44.333 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:01 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:09:44.491 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:09:44.492 INFO:teuthology.orchestra.run.smithi184.stdout:====================================================================================== 2024-02-05T07:09:44.492 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-05T07:09:44.492 INFO:teuthology.orchestra.run.smithi184.stdout:====================================================================================== 2024-02-05T07:09:44.492 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:09:44.492 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 1.8 M 2024-02-05T07:09:44.492 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-05T07:09:44.493 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-05T07:09:44.493 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 28 k 2024-02-05T07:09:44.493 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 15 k 2024-02-05T07:09:44.493 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-05T07:09:44.493 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-05T07:09:44.493 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-05T07:09:44.493 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-05T07:09:44.493 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-05T07:09:44.493 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-05T07:09:44.493 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-05T07:09:44.493 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-05T07:09:44.493 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:44.494 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:09:44.494 INFO:teuthology.orchestra.run.smithi184.stdout:====================================================================================== 2024-02-05T07:09:44.494 INFO:teuthology.orchestra.run.smithi184.stdout:Install 12 Packages 2024-02-05T07:09:44.494 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:44.494 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 6.8 M 2024-02-05T07:09:44.494 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 26 M 2024-02-05T07:09:44.495 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:09:44.816 INFO:teuthology.orchestra.run.smithi184.stdout:(1/12): ceph-grafana-dashboards-19.0.0-1241.g16 152 kB/s | 28 kB 00:00 2024-02-05T07:09:44.916 INFO:teuthology.orchestra.run.smithi184.stdout:(2/12): ceph-prometheus-alerts-19.0.0-1241.g164 53 kB/s | 15 kB 00:00 2024-02-05T07:09:45.042 INFO:teuthology.orchestra.run.smithi184.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.5 MB/s | 1.0 MB 00:00 2024-02-05T07:09:45.066 INFO:teuthology.orchestra.run.smithi184.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.5 MB/s | 238 kB 00:00 2024-02-05T07:09:45.283 INFO:teuthology.orchestra.run.smithi184.stdout:(5/12): ceph-mgr-dashboard-19.0.0-1241.g164d3be 2.7 MB/s | 1.8 MB 00:00 2024-02-05T07:09:45.392 INFO:teuthology.orchestra.run.smithi184.stdout:(6/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.4 MB/s | 863 kB 00:00 2024-02-05T07:09:45.701 INFO:teuthology.orchestra.run.smithi184.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 47 kB/s | 19 kB 00:00 2024-02-05T07:09:45.776 INFO:teuthology.orchestra.run.smithi184.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 773 kB/s | 548 kB 00:00 2024-02-05T07:09:45.854 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-2:19.0.0-1241.g164d3be4.el9.x86_64 36/36 2024-02-05T07:09:45.854 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-2:19.0.0-1241.g164d3be4.el9.x86_64 1/36 2024-02-05T07:09:45.854 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mds-2:19.0.0-1241.g164d3be4.el9.x86_64 2/36 2024-02-05T07:09:45.854 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-2:19.0.0-1241.g164d3be4.el9.x86_64 3/36 2024-02-05T07:09:45.854 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mon-2:19.0.0-1241.g164d3be4.el9.x86_64 4/36 2024-02-05T07:09:45.855 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-osd-2:19.0.0-1241.g164d3be4.el9.x86_64 5/36 2024-02-05T07:09:45.855 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1241.g164d3be4.el9. 6/36 2024-02-05T07:09:45.855 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-02-05T07:09:45.855 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-02-05T07:09:45.855 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-02-05T07:09:45.855 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-02-05T07:09:45.855 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-02-05T07:09:45.855 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-02-05T07:09:45.855 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-02-05T07:09:45.855 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-02-05T07:09:45.855 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-02-05T07:09:45.855 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 16/36 2024-02-05T07:09:45.855 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 17/36 2024-02-05T07:09:45.855 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-02-05T07:09:45.856 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-02-05T07:09:45.856 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-02-05T07:09:45.856 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-02-05T07:09:45.856 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-02-05T07:09:45.856 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-02-05T07:09:45.856 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-02-05T07:09:45.856 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-02-05T07:09:45.856 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-02-05T07:09:45.856 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-02-05T07:09:45.856 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-02-05T07:09:45.857 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-02-05T07:09:45.857 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-02-05T07:09:45.857 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-02-05T07:09:45.857 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-02-05T07:09:45.857 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-02-05T07:09:45.858 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-02-05T07:09:45.858 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-02-05T07:09:45.884 INFO:teuthology.orchestra.run.smithi184.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 283 kB/s | 31 kB 00:00 2024-02-05T07:09:45.993 INFO:teuthology.orchestra.run.smithi184.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 495 kB/s | 144 kB 00:00 2024-02-05T07:09:46.018 INFO:teuthology.orchestra.run.smithi184.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.4 MB/s | 188 kB 00:00 2024-02-05T07:09:46.260 INFO:teuthology.orchestra.run.smithi184.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.4 MB/s | 2.0 MB 00:00 2024-02-05T07:09:46.266 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:09:46.266 INFO:teuthology.orchestra.run.smithi184.stdout:Total 3.9 MB/s | 6.8 MB 00:01 2024-02-05T07:09:46.286 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:09:46.305 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:09:46.306 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:09:46.494 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:09:46.495 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:09:46.814 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-02-05T07:09:46.814 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:46.815 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:09:46.815 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:46.815 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mds-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:46.815 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:46.815 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-modules-core-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:09:46.815 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mon-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:46.815 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-osd-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:46.815 INFO:teuthology.orchestra.run.smithi188.stdout: lua-5.4.4-4.el9.x86_64 2024-02-05T07:09:46.815 INFO:teuthology.orchestra.run.smithi188.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-02-05T07:09:46.815 INFO:teuthology.orchestra.run.smithi188.stdout: luarocks-3.9.2-1.el9.noarch 2024-02-05T07:09:46.815 INFO:teuthology.orchestra.run.smithi188.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-05T07:09:46.815 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-05T07:09:46.815 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-05T07:09:46.816 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-05T07:09:46.816 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-05T07:09:46.816 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-05T07:09:46.816 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-05T07:09:46.816 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-05T07:09:46.816 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-05T07:09:46.816 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-05T07:09:46.816 INFO:teuthology.orchestra.run.smithi188.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-05T07:09:46.816 INFO:teuthology.orchestra.run.smithi188.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-05T07:09:46.816 INFO:teuthology.orchestra.run.smithi188.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-05T07:09:46.816 INFO:teuthology.orchestra.run.smithi188.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-05T07:09:46.816 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-05T07:09:46.816 INFO:teuthology.orchestra.run.smithi188.stdout: python3-ply-3.11-14.el9.noarch 2024-02-05T07:09:46.816 INFO:teuthology.orchestra.run.smithi188.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-05T07:09:46.817 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-05T07:09:46.817 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-05T07:09:46.817 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-05T07:09:46.817 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-05T07:09:46.817 INFO:teuthology.orchestra.run.smithi188.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-05T07:09:46.817 INFO:teuthology.orchestra.run.smithi188.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-05T07:09:46.817 INFO:teuthology.orchestra.run.smithi188.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-05T07:09:46.817 INFO:teuthology.orchestra.run.smithi188.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-05T07:09:46.817 INFO:teuthology.orchestra.run.smithi188.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-05T07:09:46.817 INFO:teuthology.orchestra.run.smithi188.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-05T07:09:46.817 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:46.817 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:09:47.013 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:09:47.056 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-base 2024-02-05T07:09:47.085 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-02-05T07:09:47.121 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-02-05T07:09:47.159 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-02-05T07:09:47.189 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-02-05T07:09:47.293 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-02-05T07:09:47.456 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-02-05T07:09:47.542 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-02-05T07:09:47.586 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-02-05T07:09:47.614 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-02-05T07:09:47.626 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:52 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:09:47.644 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1241.g164d3be4.el9 10/12 2024-02-05T07:09:47.731 INFO:teuthology.orchestra.run.smithi188.stdout:Package ceph-base-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:09:47.783 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:09:47.784 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-02-05T07:09:47.784 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:09:47.854 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install cephadm 2024-02-05T07:09:47.888 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1241.g164d3be4.el 11/12 2024-02-05T07:09:47.921 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1241.g164d3be4.el9.noa 12/12 2024-02-05T07:09:48.418 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:53 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:09:48.572 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:09:48.573 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:09:48.573 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-02-05T07:09:48.573 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:09:48.573 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:09:48.573 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 748 k 2024-02-05T07:09:48.573 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:48.573 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:09:48.573 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:09:48.573 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-02-05T07:09:48.573 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:48.573 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 748 k 2024-02-05T07:09:48.574 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 754 k 2024-02-05T07:09:48.574 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:09:48.692 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1241.g164d3be4.el9.noa 12/12 2024-02-05T07:09:48.692 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1241.g164d3be4.el 1/12 2024-02-05T07:09:48.692 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1241.g164d3be4.el9.noa 2/12 2024-02-05T07:09:48.692 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1241.g164d3be4.el9 3/12 2024-02-05T07:09:48.692 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-02-05T07:09:48.692 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-02-05T07:09:48.692 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-02-05T07:09:48.692 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-02-05T07:09:48.692 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-02-05T07:09:48.693 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-02-05T07:09:48.693 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-02-05T07:09:48.693 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-02-05T07:09:48.918 INFO:teuthology.orchestra.run.smithi188.stdout:cephadm-19.0.0-1241.g164d3be4.el9.noarch.rpm 2.1 MB/s | 748 kB 00:00 2024-02-05T07:09:48.919 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:09:48.919 INFO:teuthology.orchestra.run.smithi188.stdout:Total 2.1 MB/s | 748 kB 00:00 2024-02-05T07:09:48.919 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:09:48.924 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:09:48.925 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:09:48.930 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:09:48.930 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:09:49.004 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:09:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-02-05T07:09:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:49.072 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:09:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-05T07:09:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:09:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:09:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:09:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-05T07:09:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-05T07:09:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-05T07:09:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-05T07:09:49.072 INFO:teuthology.orchestra.run.smithi184.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-05T07:09:49.073 INFO:teuthology.orchestra.run.smithi184.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-05T07:09:49.073 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-05T07:09:49.073 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-05T07:09:49.073 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:49.073 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:09:49.323 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-05T07:09:49.409 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 1/1 2024-02-05T07:09:49.481 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 1/1 2024-02-05T07:09:49.880 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 1/1 2024-02-05T07:09:49.886 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:06 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:09:50.044 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:09:50.045 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================================ 2024-02-05T07:09:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-05T07:09:50.045 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================================ 2024-02-05T07:09:50.045 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:09:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 7.4 M 2024-02-05T07:09:50.045 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-05T07:09:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-05T07:09:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-05T07:09:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-05T07:09:50.045 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-05T07:09:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-05T07:09:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-05T07:09:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-05T07:09:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-05T07:09:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-05T07:09:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-05T07:09:50.046 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-05T07:09:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:50.047 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:09:50.047 INFO:teuthology.orchestra.run.smithi184.stdout:============================================================================================ 2024-02-05T07:09:50.047 INFO:teuthology.orchestra.run.smithi184.stdout:Install 12 Packages 2024-02-05T07:09:50.047 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:50.047 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 37 M 2024-02-05T07:09:50.047 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 209 M 2024-02-05T07:09:50.048 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:09:50.192 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 1/1 2024-02-05T07:09:50.192 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:50.192 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:09:50.192 INFO:teuthology.orchestra.run.smithi188.stdout: cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:09:50.192 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:50.192 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:09:50.394 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-immutable-object-cache 2024-02-05T07:09:50.491 INFO:teuthology.orchestra.run.smithi184.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 197 kB/s | 32 kB 00:00 2024-02-05T07:09:50.533 INFO:teuthology.orchestra.run.smithi184.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 425 kB/s | 17 kB 00:00 2024-02-05T07:09:50.576 INFO:teuthology.orchestra.run.smithi184.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 834 kB/s | 34 kB 00:00 2024-02-05T07:09:50.626 INFO:teuthology.orchestra.run.smithi184.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 10 MB/s | 3.0 MB 00:00 2024-02-05T07:09:50.818 INFO:teuthology.orchestra.run.smithi184.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2024-02-05T07:09:50.884 INFO:teuthology.orchestra.run.smithi184.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 4.8 MB 00:00 2024-02-05T07:09:50.911 INFO:teuthology.orchestra.run.smithi184.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2024-02-05T07:09:50.975 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:55 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:09:51.060 INFO:teuthology.orchestra.run.smithi184.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 5.3 MB/s | 802 kB 00:00 2024-02-05T07:09:51.130 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:09:51.130 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:09:51.131 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repo Size 2024-02-05T07:09:51.131 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:09:51.131 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:09:51.131 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 145 k 2024-02-05T07:09:51.131 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:51.131 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:09:51.131 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:09:51.131 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-02-05T07:09:51.131 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:51.132 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 145 k 2024-02-05T07:09:51.132 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 436 k 2024-02-05T07:09:51.132 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:09:51.244 INFO:teuthology.orchestra.run.smithi184.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 44 MB/s | 16 MB 00:00 2024-02-05T07:09:51.344 INFO:teuthology.orchestra.run.smithi184.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 691 kB/s | 194 kB 00:00 2024-02-05T07:09:51.358 INFO:teuthology.orchestra.run.smithi188.stdout:ceph-immutable-object-cache-19.0.0-1241.g164d3b 643 kB/s | 145 kB 00:00 2024-02-05T07:09:51.359 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:09:51.359 INFO:teuthology.orchestra.run.smithi188.stdout:Total 638 kB/s | 145 kB 00:00 2024-02-05T07:09:51.359 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:09:51.366 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:09:51.367 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:09:51.418 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:09:51.418 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:09:51.567 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:09:51.634 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1241.g164d3be4. 1/1 2024-02-05T07:09:51.659 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1241.g164d3be4. 1/1 2024-02-05T07:09:51.659 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:09:51.659 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-05T07:09:51.659 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:51.853 INFO:teuthology.orchestra.run.smithi184.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 404 kB/s | 245 kB 00:00 2024-02-05T07:09:52.053 INFO:teuthology.orchestra.run.smithi184.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-1 4.3 MB/s | 7.4 MB 00:01 2024-02-05T07:09:52.056 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:09:52.056 INFO:teuthology.orchestra.run.smithi184.stdout:Total 18 MB/s | 37 MB 00:02 2024-02-05T07:09:52.071 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:09:52.096 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:09:52.097 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:09:52.450 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:09:52.451 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:09:52.605 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1241.g164d3be4. 1/1 2024-02-05T07:09:52.605 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:52.605 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:09:52.605 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-immutable-object-cache-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:09:52.605 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:52.606 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:09:52.850 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr 2024-02-05T07:09:53.157 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:09:53.234 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-05T07:09:53.273 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-05T07:09:53.371 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-05T07:09:53.410 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-05T07:09:53.429 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:58 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:09:53.533 INFO:teuthology.orchestra.run.smithi188.stdout:Package ceph-mgr-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:09:53.584 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:09:53.585 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-02-05T07:09:53.585 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:09:53.588 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-05T07:09:53.626 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-05T07:09:53.652 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr-dashboard 2024-02-05T07:09:53.703 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-05T07:09:54.218 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:00:59 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:09:54.375 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:09:54.376 INFO:teuthology.orchestra.run.smithi188.stdout:====================================================================================== 2024-02-05T07:09:54.376 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-02-05T07:09:54.376 INFO:teuthology.orchestra.run.smithi188.stdout:====================================================================================== 2024-02-05T07:09:54.376 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:09:54.376 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 1.8 M 2024-02-05T07:09:54.376 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-02-05T07:09:54.376 INFO:teuthology.orchestra.run.smithi188.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-02-05T07:09:54.376 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 28 k 2024-02-05T07:09:54.376 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 15 k 2024-02-05T07:09:54.376 INFO:teuthology.orchestra.run.smithi188.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-02-05T07:09:54.376 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-02-05T07:09:54.376 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-02-05T07:09:54.377 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-02-05T07:09:54.377 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-02-05T07:09:54.377 INFO:teuthology.orchestra.run.smithi188.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-02-05T07:09:54.377 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-05T07:09:54.377 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-05T07:09:54.377 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:54.377 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:09:54.377 INFO:teuthology.orchestra.run.smithi188.stdout:====================================================================================== 2024-02-05T07:09:54.377 INFO:teuthology.orchestra.run.smithi188.stdout:Install 12 Packages 2024-02-05T07:09:54.377 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:54.378 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 6.8 M 2024-02-05T07:09:54.378 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 26 M 2024-02-05T07:09:54.378 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:09:54.392 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-05T07:09:54.524 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-05T07:09:54.749 INFO:teuthology.orchestra.run.smithi188.stdout:(1/12): ceph-grafana-dashboards-19.0.0-1241.g16 148 kB/s | 28 kB 00:00 2024-02-05T07:09:54.841 INFO:teuthology.orchestra.run.smithi188.stdout:(2/12): ceph-prometheus-alerts-19.0.0-1241.g164 54 kB/s | 15 kB 00:00 2024-02-05T07:09:54.983 INFO:teuthology.orchestra.run.smithi188.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-02-05T07:09:55.008 INFO:teuthology.orchestra.run.smithi188.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.4 MB/s | 238 kB 00:00 2024-02-05T07:09:55.050 INFO:teuthology.orchestra.run.smithi188.stdout:(5/12): ceph-mgr-dashboard-19.0.0-1241.g164d3be 3.6 MB/s | 1.8 MB 00:00 2024-02-05T07:09:55.317 INFO:teuthology.orchestra.run.smithi188.stdout:(6/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.5 MB/s | 863 kB 00:00 2024-02-05T07:09:55.401 INFO:teuthology.orchestra.run.smithi188.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 55 kB/s | 19 kB 00:00 2024-02-05T07:09:55.693 INFO:teuthology.orchestra.run.smithi188.stdout:(8/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 801 kB/s | 548 kB 00:00 2024-02-05T07:09:55.718 INFO:teuthology.orchestra.run.smithi188.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 492 kB/s | 144 kB 00:00 2024-02-05T07:09:55.795 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-05T07:09:55.815 INFO:teuthology.orchestra.run.smithi188.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 253 kB/s | 31 kB 00:00 2024-02-05T07:09:55.919 INFO:teuthology.orchestra.run.smithi188.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 942 kB/s | 188 kB 00:00 2024-02-05T07:09:56.227 INFO:teuthology.orchestra.run.smithi188.stdout:(12/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.2 MB/s | 2.0 MB 00:00 2024-02-05T07:09:56.232 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:09:56.233 INFO:teuthology.orchestra.run.smithi188.stdout:Total 3.7 MB/s | 6.8 MB 00:01 2024-02-05T07:09:56.251 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:09:56.269 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:09:56.269 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:09:56.447 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:09:56.448 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:09:56.840 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-05T07:09:56.866 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1241.g164d3 12/12 2024-02-05T07:09:56.962 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:09:57.053 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-02-05T07:09:57.087 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-02-05T07:09:57.151 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-02-05T07:09:57.181 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-02-05T07:09:57.286 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-02-05T07:09:57.407 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-02-05T07:09:57.503 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-02-05T07:09:57.544 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-02-05T07:09:57.581 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-02-05T07:09:57.670 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1241.g164d3be4.el9 10/12 2024-02-05T07:09:57.912 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1241.g164d3be4.el 11/12 2024-02-05T07:09:57.947 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1241.g164d3be4.el9.noa 12/12 2024-02-05T07:09:58.802 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1241.g164d3be4.el9.noa 12/12 2024-02-05T07:09:58.802 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1241.g164d3be4.el 1/12 2024-02-05T07:09:58.802 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1241.g164d3be4.el9.noa 2/12 2024-02-05T07:09:58.802 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1241.g164d3be4.el9 3/12 2024-02-05T07:09:58.802 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-02-05T07:09:58.802 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-02-05T07:09:58.802 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-02-05T07:09:58.802 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-02-05T07:09:58.803 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-02-05T07:09:58.803 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-02-05T07:09:58.803 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-02-05T07:09:58.803 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-02-05T07:09:59.182 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-02-05T07:09:59.182 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:59.182 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:09:59.182 INFO:teuthology.orchestra.run.smithi188.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-02-05T07:09:59.182 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-grafana-dashboards-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:09:59.182 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-dashboard-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:09:59.182 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-prometheus-alerts-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:09:59.183 INFO:teuthology.orchestra.run.smithi188.stdout: grpc-data-1.46.7-10.el9.noarch 2024-02-05T07:09:59.183 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-3.14.0-13.el9.x86_64 2024-02-05T07:09:59.183 INFO:teuthology.orchestra.run.smithi188.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-02-05T07:09:59.183 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-02-05T07:09:59.183 INFO:teuthology.orchestra.run.smithi188.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-02-05T07:09:59.183 INFO:teuthology.orchestra.run.smithi188.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-02-05T07:09:59.183 INFO:teuthology.orchestra.run.smithi188.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-05T07:09:59.183 INFO:teuthology.orchestra.run.smithi188.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-05T07:09:59.183 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:09:59.183 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:09:59.441 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-05T07:09:59.457 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1241.g164d3 12/12 2024-02-05T07:09:59.457 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1241.g164d3 1/12 2024-02-05T07:09:59.458 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-05T07:09:59.458 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-05T07:09:59.458 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-05T07:09:59.458 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-05T07:09:59.458 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-05T07:09:59.458 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-05T07:09:59.458 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-05T07:09:59.458 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-05T07:09:59.458 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-05T07:09:59.458 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-05T07:09:59.885 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-05T07:09:59.885 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:59.885 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:09:59.885 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:09:59.885 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-05T07:09:59.885 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-05T07:09:59.885 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-05T07:09:59.886 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-05T07:09:59.886 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-05T07:09:59.886 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-05T07:09:59.886 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-05T07:09:59.886 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-05T07:09:59.886 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-05T07:09:59.886 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-05T07:09:59.886 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-05T07:09:59.886 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:09:59.886 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:00.004 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:05 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:00.159 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:00.160 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================================ 2024-02-05T07:10:00.160 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-02-05T07:10:00.161 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================================ 2024-02-05T07:10:00.161 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:10:00.161 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 7.4 M 2024-02-05T07:10:00.161 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-02-05T07:10:00.161 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-02-05T07:10:00.161 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-02-05T07:10:00.161 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-02-05T07:10:00.161 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-02-05T07:10:00.161 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-02-05T07:10:00.161 INFO:teuthology.orchestra.run.smithi188.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-02-05T07:10:00.161 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-02-05T07:10:00.161 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-05T07:10:00.161 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-02-05T07:10:00.162 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-02-05T07:10:00.162 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-02-05T07:10:00.162 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:00.162 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:10:00.162 INFO:teuthology.orchestra.run.smithi188.stdout:============================================================================================ 2024-02-05T07:10:00.162 INFO:teuthology.orchestra.run.smithi188.stdout:Install 12 Packages 2024-02-05T07:10:00.162 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:00.163 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 37 M 2024-02-05T07:10:00.163 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 209 M 2024-02-05T07:10:00.163 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:10:00.291 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-rook 2024-02-05T07:10:00.576 INFO:teuthology.orchestra.run.smithi188.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 221 kB/s | 32 kB 00:00 2024-02-05T07:10:00.626 INFO:teuthology.orchestra.run.smithi188.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 349 kB/s | 17 kB 00:00 2024-02-05T07:10:00.668 INFO:teuthology.orchestra.run.smithi188.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 827 kB/s | 34 kB 00:00 2024-02-05T07:10:00.743 INFO:teuthology.orchestra.run.smithi188.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 9.6 MB/s | 3.0 MB 00:00 2024-02-05T07:10:00.874 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:17 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:00.952 INFO:teuthology.orchestra.run.smithi188.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2024-02-05T07:10:01.019 INFO:teuthology.orchestra.run.smithi188.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 17 MB/s | 4.8 MB 00:00 2024-02-05T07:10:01.031 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:01.032 INFO:teuthology.orchestra.run.smithi184.stdout:======================================================================================== 2024-02-05T07:10:01.032 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-05T07:10:01.033 INFO:teuthology.orchestra.run.smithi184.stdout:======================================================================================== 2024-02-05T07:10:01.033 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:10:01.033 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 52 k 2024-02-05T07:10:01.033 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-05T07:10:01.033 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-05T07:10:01.033 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-05T07:10:01.033 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-05T07:10:01.033 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-05T07:10:01.033 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-05T07:10:01.033 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-05T07:10:01.034 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-05T07:10:01.034 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-05T07:10:01.034 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-05T07:10:01.034 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-05T07:10:01.034 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-05T07:10:01.034 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-05T07:10:01.034 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:01.034 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:10:01.034 INFO:teuthology.orchestra.run.smithi184.stdout:======================================================================================== 2024-02-05T07:10:01.035 INFO:teuthology.orchestra.run.smithi184.stdout:Install 13 Packages 2024-02-05T07:10:01.035 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:01.035 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 2.0 M 2024-02-05T07:10:01.036 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 26 M 2024-02-05T07:10:01.036 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:10:01.044 INFO:teuthology.orchestra.run.smithi188.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2024-02-05T07:10:01.203 INFO:teuthology.orchestra.run.smithi188.stdout:(8/12): libgfortran-11.4.1-3.el9.x86_64.rpm 5.0 MB/s | 802 kB 00:00 2024-02-05T07:10:01.361 INFO:teuthology.orchestra.run.smithi188.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2024-02-05T07:10:01.386 INFO:teuthology.orchestra.run.smithi188.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 194 kB 00:00 2024-02-05T07:10:01.550 INFO:teuthology.orchestra.run.smithi184.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 138 kB/s | 18 kB 00:00 2024-02-05T07:10:01.567 INFO:teuthology.orchestra.run.smithi184.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 164 kB/s | 24 kB 00:00 2024-02-05T07:10:01.634 INFO:teuthology.orchestra.run.smithi184.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 174 kB 00:00 2024-02-05T07:10:01.668 INFO:teuthology.orchestra.run.smithi184.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 132 kB 00:00 2024-02-05T07:10:01.693 INFO:teuthology.orchestra.run.smithi184.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.5 MB/s | 211 kB 00:00 2024-02-05T07:10:01.719 INFO:teuthology.orchestra.run.smithi184.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 856 kB/s | 43 kB 00:00 2024-02-05T07:10:01.819 INFO:teuthology.orchestra.run.smithi184.stdout:(7/13): ceph-mgr-rook-19.0.0-1241.g164d3be4.el9 131 kB/s | 52 kB 00:00 2024-02-05T07:10:02.012 INFO:teuthology.orchestra.run.smithi188.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 378 kB/s | 245 kB 00:00 2024-02-05T07:10:02.028 INFO:teuthology.orchestra.run.smithi184.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 96 kB/s | 32 kB 00:00 2024-02-05T07:10:02.053 INFO:teuthology.orchestra.run.smithi184.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 45 kB/s | 15 kB 00:00 2024-02-05T07:10:02.328 INFO:teuthology.orchestra.run.smithi184.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 215 kB/s | 59 kB 00:00 2024-02-05T07:10:02.337 INFO:teuthology.orchestra.run.smithi188.stdout:(12/12): ceph-mgr-diskprediction-local-19.0.0-1 3.9 MB/s | 7.4 MB 00:01 2024-02-05T07:10:02.340 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:02.340 INFO:teuthology.orchestra.run.smithi188.stdout:Total 17 MB/s | 37 MB 00:02 2024-02-05T07:10:02.353 INFO:teuthology.orchestra.run.smithi184.stdout:(11/13): python3-google-auth-2.27.0-1.el9.noarc 380 kB/s | 203 kB 00:00 2024-02-05T07:10:02.355 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:10:02.382 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:10:02.382 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:10:02.537 INFO:teuthology.orchestra.run.smithi184.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 430 kB/s | 90 kB 00:00 2024-02-05T07:10:02.571 INFO:teuthology.orchestra.run.smithi184.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 1.9 MB/s | 1.0 MB 00:00 2024-02-05T07:10:02.572 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:02.573 INFO:teuthology.orchestra.run.smithi184.stdout:Total 1.3 MB/s | 2.0 MB 00:01 2024-02-05T07:10:02.573 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:10:02.586 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:10:02.586 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:10:02.689 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:10:02.689 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:10:02.739 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:10:02.739 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:10:03.224 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:10:03.391 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-05T07:10:03.454 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-05T07:10:03.474 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:10:03.509 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-05T07:10:03.547 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-05T07:10:03.552 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-02-05T07:10:03.583 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-05T07:10:03.588 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-05T07:10:03.677 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-02-05T07:10:03.681 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-05T07:10:03.711 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-05T07:10:03.782 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-05T07:10:03.831 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-05T07:10:03.909 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-05T07:10:03.943 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-05T07:10:04.020 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-05T07:10:04.551 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-05T07:10:04.595 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-05T07:10:04.629 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-05T07:10:04.680 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-05T07:10:04.703 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-05T07:10:04.733 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:19.0.0-1241.g164d3be4.el9.noarch 13/13 2024-02-05T07:10:04.797 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-05T07:10:05.527 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1241.g164d3be4.el9.noarch 13/13 2024-02-05T07:10:05.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1241.g164d3be4.el9.noarch 1/13 2024-02-05T07:10:05.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-05T07:10:05.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-05T07:10:05.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-05T07:10:05.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-05T07:10:05.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-05T07:10:05.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-05T07:10:05.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-05T07:10:05.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-05T07:10:05.527 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-05T07:10:05.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-05T07:10:05.528 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-05T07:10:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-05T07:10:05.894 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:05.894 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:10:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:10:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-05T07:10:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-05T07:10:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-05T07:10:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-05T07:10:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-05T07:10:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-05T07:10:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-05T07:10:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-05T07:10:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-05T07:10:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-05T07:10:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-05T07:10:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-05T07:10:05.895 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:05.896 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:06.018 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-05T07:10:06.158 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-cephadm 2024-02-05T07:10:06.726 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:23 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:06.882 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:06.882 INFO:teuthology.orchestra.run.smithi184.stdout:======================================================================================== 2024-02-05T07:10:06.882 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-05T07:10:06.883 INFO:teuthology.orchestra.run.smithi184.stdout:======================================================================================== 2024-02-05T07:10:06.883 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:10:06.883 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 138 k 2024-02-05T07:10:06.883 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-05T07:10:06.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-05T07:10:06.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-05T07:10:06.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-02-05T07:10:06.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-05T07:10:06.883 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-05T07:10:06.883 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:06.883 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:10:06.884 INFO:teuthology.orchestra.run.smithi184.stdout:======================================================================================== 2024-02-05T07:10:06.884 INFO:teuthology.orchestra.run.smithi184.stdout:Install 6 Packages 2024-02-05T07:10:06.884 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:06.884 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 6.8 M 2024-02-05T07:10:06.884 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 33 M 2024-02-05T07:10:06.885 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:10:07.034 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-05T07:10:07.069 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1241.g164d3 12/12 2024-02-05T07:10:07.422 INFO:teuthology.orchestra.run.smithi184.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.2 MB/s | 228 kB 00:00 2024-02-05T07:10:07.547 INFO:teuthology.orchestra.run.smithi184.stdout:(2/6): ceph-mgr-cephadm-19.0.0-1241.g164d3be4.e 438 kB/s | 138 kB 00:00 2024-02-05T07:10:07.622 INFO:teuthology.orchestra.run.smithi184.stdout:(3/6): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 5.8 MB 00:00 2024-02-05T07:10:07.773 INFO:teuthology.orchestra.run.smithi184.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 258 kB/s | 58 kB 00:00 2024-02-05T07:10:07.798 INFO:teuthology.orchestra.run.smithi184.stdout:(5/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 1.4 MB/s | 548 kB 00:00 2024-02-05T07:10:07.823 INFO:teuthology.orchestra.run.smithi184.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 290 kB/s | 51 kB 00:00 2024-02-05T07:10:07.827 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:07.827 INFO:teuthology.orchestra.run.smithi184.stdout:Total 7.2 MB/s | 6.8 MB 00:00 2024-02-05T07:10:07.828 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:10:07.836 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:10:07.836 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:10:07.926 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:10:07.927 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:10:08.236 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:10:08.448 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-05T07:10:08.499 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-05T07:10:09.014 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-05T07:10:09.085 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-05T07:10:09.147 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2024-02-05T07:10:09.170 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 6/6 2024-02-05T07:10:09.634 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1241.g164d3 12/12 2024-02-05T07:10:09.635 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1241.g164d3 1/12 2024-02-05T07:10:09.635 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-02-05T07:10:09.635 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-02-05T07:10:09.635 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-02-05T07:10:09.635 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-05T07:10:09.635 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-05T07:10:09.635 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-02-05T07:10:09.635 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-02-05T07:10:09.635 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-02-05T07:10:09.636 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-02-05T07:10:09.636 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-02-05T07:10:09.972 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 6/6 2024-02-05T07:10:09.973 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 1/6 2024-02-05T07:10:09.973 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-05T07:10:09.973 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2024-02-05T07:10:09.973 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-05T07:10:09.973 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-05T07:10:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-02-05T07:10:10.137 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:10.137 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:10:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:10:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-05T07:10:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-05T07:10:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-05T07:10:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-05T07:10:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-05T07:10:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-05T07:10:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-05T07:10:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-05T07:10:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-05T07:10:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-05T07:10:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-05T07:10:10.138 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:10.138 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:10.279 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-05T07:10:10.279 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:10.279 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:10:10.279 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:10:10.279 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-05T07:10:10.279 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-05T07:10:10.279 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-02-05T07:10:10.279 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-05T07:10:10.279 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-05T07:10:10.279 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:10.279 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:10.487 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr-rook 2024-02-05T07:10:10.538 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-fuse 2024-02-05T07:10:11.070 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:16 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:11.105 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:28 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:11.226 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:11.227 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================== 2024-02-05T07:10:11.227 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-02-05T07:10:11.227 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================== 2024-02-05T07:10:11.227 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:10:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 52 k 2024-02-05T07:10:11.228 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-02-05T07:10:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-05T07:10:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-05T07:10:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth noarch 1:2.27.0-1.el9 epel 203 k 2024-02-05T07:10:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-02-05T07:10:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-02-05T07:10:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-05T07:10:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-02-05T07:10:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-02-05T07:10:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-02-05T07:10:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-02-05T07:10:11.228 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-05T07:10:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-05T07:10:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:11.229 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:10:11.229 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================== 2024-02-05T07:10:11.229 INFO:teuthology.orchestra.run.smithi188.stdout:Install 13 Packages 2024-02-05T07:10:11.229 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:11.229 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 2.0 M 2024-02-05T07:10:11.229 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 26 M 2024-02-05T07:10:11.230 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:10:11.262 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:11.263 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:11.263 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-05T07:10:11.263 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:11.263 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:10:11.263 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 885 k 2024-02-05T07:10:11.263 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-05T07:10:11.263 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-05T07:10:11.263 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:11.264 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:10:11.264 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:11.264 INFO:teuthology.orchestra.run.smithi184.stdout:Install 2 Packages 2024-02-05T07:10:11.264 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:11.264 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 964 k 2024-02-05T07:10:11.264 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 2.8 M 2024-02-05T07:10:11.264 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:10:11.416 INFO:teuthology.orchestra.run.smithi184.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 520 kB/s | 79 kB 00:00 2024-02-05T07:10:11.452 INFO:teuthology.orchestra.run.smithi188.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 182 kB/s | 24 kB 00:00 2024-02-05T07:10:11.477 INFO:teuthology.orchestra.run.smithi188.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 114 kB/s | 18 kB 00:00 2024-02-05T07:10:11.561 INFO:teuthology.orchestra.run.smithi188.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.1 MB/s | 174 kB 00:00 2024-02-05T07:10:11.586 INFO:teuthology.orchestra.run.smithi188.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 132 kB 00:00 2024-02-05T07:10:11.611 INFO:teuthology.orchestra.run.smithi188.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-02-05T07:10:11.637 INFO:teuthology.orchestra.run.smithi188.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 853 kB/s | 43 kB 00:00 2024-02-05T07:10:11.662 INFO:teuthology.orchestra.run.smithi188.stdout:(7/13): ceph-mgr-rook-19.0.0-1241.g164d3be4.el9 152 kB/s | 52 kB 00:00 2024-02-05T07:10:11.904 INFO:teuthology.orchestra.run.smithi188.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 110 kB/s | 32 kB 00:00 2024-02-05T07:10:11.921 INFO:teuthology.orchestra.run.smithi188.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 53 kB/s | 15 kB 00:00 2024-02-05T07:10:11.974 INFO:teuthology.orchestra.run.smithi184.stdout:(2/2): ceph-fuse-19.0.0-1241.g164d3be4.el9.x86_ 1.2 MB/s | 885 kB 00:00 2024-02-05T07:10:11.976 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:11.976 INFO:teuthology.orchestra.run.smithi184.stdout:Total 1.3 MB/s | 964 kB 00:00 2024-02-05T07:10:11.976 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:10:11.997 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:10:11.997 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:10:12.073 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:10:12.074 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:10:12.163 INFO:teuthology.orchestra.run.smithi188.stdout:(10/13): python3-google-auth-2.27.0-1.el9.noarc 405 kB/s | 203 kB 00:00 2024-02-05T07:10:12.180 INFO:teuthology.orchestra.run.smithi188.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 229 kB/s | 59 kB 00:00 2024-02-05T07:10:12.259 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:10:12.330 INFO:teuthology.orchestra.run.smithi188.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 2.4 MB/s | 1.0 MB 00:00 2024-02-05T07:10:12.355 INFO:teuthology.orchestra.run.smithi188.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 467 kB/s | 90 kB 00:00 2024-02-05T07:10:12.357 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:12.357 INFO:teuthology.orchestra.run.smithi188.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2024-02-05T07:10:12.357 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:10:12.371 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:10:12.371 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:10:12.384 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-05T07:10:12.449 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 2/2 2024-02-05T07:10:12.472 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:10:12.472 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:10:12.986 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:10:13.142 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-05T07:10:13.181 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 2/2 2024-02-05T07:10:13.181 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 1/2 2024-02-05T07:10:13.197 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-05T07:10:13.253 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-05T07:10:13.292 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-05T07:10:13.332 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-05T07:10:13.425 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-05T07:10:13.501 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-05T07:10:13.501 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:13.501 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:10:13.501 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-05T07:10:13.501 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:13.501 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:13.541 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-google-auth-1:2.27.0-1.el9.noarch 7/13 2024-02-05T07:10:13.600 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-05T07:10:13.783 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-volume 2024-02-05T07:10:14.324 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-05T07:10:14.369 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:31 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:14.372 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-05T07:10:14.406 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-05T07:10:14.454 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-05T07:10:14.476 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-rook-2:19.0.0-1241.g164d3be4.el9.noarch 13/13 2024-02-05T07:10:14.529 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:14.529 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:14.529 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-05T07:10:14.529 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:14.529 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:10:14.530 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 263 k 2024-02-05T07:10:14.530 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-05T07:10:14.530 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-05T07:10:14.530 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:14.530 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:10:14.530 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:14.530 INFO:teuthology.orchestra.run.smithi184.stdout:Install 2 Packages 2024-02-05T07:10:14.530 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:14.531 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 332 k 2024-02-05T07:10:14.531 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 1.5 M 2024-02-05T07:10:14.531 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:10:14.671 INFO:teuthology.orchestra.run.smithi184.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 492 kB/s | 69 kB 00:00 2024-02-05T07:10:14.913 INFO:teuthology.orchestra.run.smithi184.stdout:(2/2): ceph-volume-19.0.0-1241.g164d3be4.el9.no 690 kB/s | 263 kB 00:00 2024-02-05T07:10:14.914 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:14.914 INFO:teuthology.orchestra.run.smithi184.stdout:Total 865 kB/s | 332 kB 00:00 2024-02-05T07:10:14.914 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:10:14.923 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:10:14.923 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:10:14.963 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:10:14.963 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:10:15.114 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:10:15.303 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-02-05T07:10:15.342 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1241.g164d3be4.el9.noarch 13/13 2024-02-05T07:10:15.342 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1241.g164d3be4.el9.noarch 1/13 2024-02-05T07:10:15.342 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-05T07:10:15.342 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-05T07:10:15.342 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-05T07:10:15.342 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-05T07:10:15.342 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-05T07:10:15.342 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-05T07:10:15.342 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-05T07:10:15.342 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-05T07:10:15.342 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-google-auth-1:2.27.0-1.el9.noarch 10/13 2024-02-05T07:10:15.343 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-05T07:10:15.343 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-05T07:10:15.348 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-volume-2:19.0.0-1241.g164d3be4.el9.noarch 2/2 2024-02-05T07:10:15.363 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-volume-2:19.0.0-1241.g164d3be4.el9.noarch 2/2 2024-02-05T07:10:15.363 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:10:15.363 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-05T07:10:15.364 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:15.728 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-05T07:10:15.728 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:15.728 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:10:15.728 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-rook-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:10:15.728 INFO:teuthology.orchestra.run.smithi188.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-05T07:10:15.728 INFO:teuthology.orchestra.run.smithi188.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-05T07:10:15.728 INFO:teuthology.orchestra.run.smithi188.stdout: python3-google-auth-1:2.27.0-1.el9.noarch 2024-02-05T07:10:15.728 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-05T07:10:15.728 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-05T07:10:15.728 INFO:teuthology.orchestra.run.smithi188.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-05T07:10:15.728 INFO:teuthology.orchestra.run.smithi188.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-05T07:10:15.728 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-05T07:10:15.729 INFO:teuthology.orchestra.run.smithi188.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-05T07:10:15.729 INFO:teuthology.orchestra.run.smithi188.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-05T07:10:15.729 INFO:teuthology.orchestra.run.smithi188.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-05T07:10:15.729 INFO:teuthology.orchestra.run.smithi188.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-05T07:10:15.729 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:15.729 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:15.998 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-mgr-cephadm 2024-02-05T07:10:16.145 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-volume-2:19.0.0-1241.g164d3be4.el9.noarch 1/2 2024-02-05T07:10:16.508 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-02-05T07:10:16.508 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:16.508 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:10:16.508 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-volume-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:10:16.508 INFO:teuthology.orchestra.run.smithi184.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-05T07:10:16.508 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:16.508 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:16.564 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:21 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:16.719 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:16.720 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================== 2024-02-05T07:10:16.720 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-02-05T07:10:16.720 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================== 2024-02-05T07:10:16.720 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:10:16.720 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 138 k 2024-02-05T07:10:16.720 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-02-05T07:10:16.720 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-02-05T07:10:16.720 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-02-05T07:10:16.721 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-02-05T07:10:16.721 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-05T07:10:16.721 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-05T07:10:16.721 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:16.721 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:10:16.721 INFO:teuthology.orchestra.run.smithi188.stdout:======================================================================================== 2024-02-05T07:10:16.721 INFO:teuthology.orchestra.run.smithi188.stdout:Install 6 Packages 2024-02-05T07:10:16.721 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:16.722 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 6.8 M 2024-02-05T07:10:16.722 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 33 M 2024-02-05T07:10:16.722 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:10:16.847 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librados-devel 2024-02-05T07:10:16.967 INFO:teuthology.orchestra.run.smithi188.stdout:(1/6): python3-jinja2-2.11.3-4.el9.noarch.rpm 1.1 MB/s | 228 kB 00:00 2024-02-05T07:10:17.151 INFO:teuthology.orchestra.run.smithi188.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 5.8 MB 00:00 2024-02-05T07:10:17.201 INFO:teuthology.orchestra.run.smithi188.stdout:(3/6): python3-asyncssh-2.13.2-3.el9.noarch.rpm 2.3 MB/s | 548 kB 00:00 2024-02-05T07:10:17.226 INFO:teuthology.orchestra.run.smithi188.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 771 kB/s | 58 kB 00:00 2024-02-05T07:10:17.252 INFO:teuthology.orchestra.run.smithi188.stdout:(5/6): ceph-mgr-cephadm-19.0.0-1241.g164d3be4.e 282 kB/s | 138 kB 00:00 2024-02-05T07:10:17.277 INFO:teuthology.orchestra.run.smithi188.stdout:(6/6): python3-typing-extensions-4.4.0-2.el9.no 677 kB/s | 51 kB 00:00 2024-02-05T07:10:17.280 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:17.280 INFO:teuthology.orchestra.run.smithi188.stdout:Total 12 MB/s | 6.8 MB 00:00 2024-02-05T07:10:17.281 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:10:17.289 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:10:17.289 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:10:17.379 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:10:17.381 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:10:17.425 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:34 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:17.582 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:17.583 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:17.583 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repo Size 2024-02-05T07:10:17.583 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:17.584 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:10:17.584 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 127 k 2024-02-05T07:10:17.584 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:17.584 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:10:17.584 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:17.584 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-02-05T07:10:17.584 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:17.584 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 127 k 2024-02-05T07:10:17.584 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 456 k 2024-02-05T07:10:17.584 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:10:17.680 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:10:17.812 INFO:teuthology.orchestra.run.smithi184.stdout:librados-devel-19.0.0-1241.g164d3be4.el9.x86_64 556 kB/s | 127 kB 00:00 2024-02-05T07:10:17.813 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:17.813 INFO:teuthology.orchestra.run.smithi184.stdout:Total 553 kB/s | 127 kB 00:00 2024-02-05T07:10:17.813 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:10:17.818 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:10:17.818 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:10:17.858 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-05T07:10:17.874 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:10:17.874 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:10:17.912 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 2/6 2024-02-05T07:10:18.016 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:10:18.127 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:18.424 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-05T07:10:18.506 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-05T07:10:18.567 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 5/6 2024-02-05T07:10:18.591 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 6/6 2024-02-05T07:10:18.616 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:18.891 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:18.891 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:18.892 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:10:18.892 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:10:18.892 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:18.892 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:19.134 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install libcephfs2 2024-02-05T07:10:19.376 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 6/6 2024-02-05T07:10:19.377 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 1/6 2024-02-05T07:10:19.377 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-05T07:10:19.377 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 3/6 2024-02-05T07:10:19.377 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 4/6 2024-02-05T07:10:19.377 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-05T07:10:19.708 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-05T07:10:19.708 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:19.708 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:10:19.708 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-mgr-cephadm-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:10:19.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-02-05T07:10:19.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-05T07:10:19.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-02-05T07:10:19.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-05T07:10:19.708 INFO:teuthology.orchestra.run.smithi188.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-05T07:10:19.708 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:19.709 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:19.718 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:36 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:19.826 INFO:teuthology.orchestra.run.smithi184.stdout:Package libcephfs2-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:10:19.880 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:19.881 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-05T07:10:19.881 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:19.958 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install libcephfs-devel 2024-02-05T07:10:20.008 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-fuse 2024-02-05T07:10:20.523 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:37 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:20.572 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:25 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:20.679 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:20.680 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:20.680 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repo Size 2024-02-05T07:10:20.680 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:20.680 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:10:20.681 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 31 k 2024-02-05T07:10:20.681 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:20.681 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:10:20.681 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:20.681 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-02-05T07:10:20.681 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:20.681 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 31 k 2024-02-05T07:10:20.681 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 140 k 2024-02-05T07:10:20.681 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:10:20.730 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:20.730 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:20.730 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-02-05T07:10:20.730 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:20.731 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:10:20.731 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 885 k 2024-02-05T07:10:20.731 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-02-05T07:10:20.731 INFO:teuthology.orchestra.run.smithi188.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-02-05T07:10:20.731 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:20.731 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:10:20.731 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:20.731 INFO:teuthology.orchestra.run.smithi188.stdout:Install 2 Packages 2024-02-05T07:10:20.731 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:20.732 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 964 k 2024-02-05T07:10:20.732 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 2.8 M 2024-02-05T07:10:20.732 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:10:20.848 INFO:teuthology.orchestra.run.smithi184.stdout:libcephfs-devel-19.0.0-1241.g164d3be4.el9.x86_6 187 kB/s | 31 kB 00:00 2024-02-05T07:10:20.849 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:20.849 INFO:teuthology.orchestra.run.smithi184.stdout:Total 185 kB/s | 31 kB 00:00 2024-02-05T07:10:20.849 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:10:20.852 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:10:20.852 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:10:20.879 INFO:teuthology.orchestra.run.smithi188.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 536 kB/s | 79 kB 00:00 2024-02-05T07:10:20.887 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:10:20.887 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:10:20.972 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:10:21.072 INFO:teuthology.orchestra.run.smithi188.stdout:(2/2): ceph-fuse-19.0.0-1241.g164d3be4.el9.x86_ 2.6 MB/s | 885 kB 00:00 2024-02-05T07:10:21.072 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:21.072 INFO:teuthology.orchestra.run.smithi188.stdout:Total 2.8 MB/s | 964 kB 00:00 2024-02-05T07:10:21.073 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:10:21.081 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:21.092 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:10:21.092 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:10:21.169 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:10:21.169 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:10:21.364 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:10:21.497 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:21.504 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-05T07:10:21.579 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 2/2 2024-02-05T07:10:21.758 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:21.758 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:21.758 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:10:21.758 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:10:21.758 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:21.758 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:21.967 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librados2 2024-02-05T07:10:22.280 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 2/2 2024-02-05T07:10:22.280 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 1/2 2024-02-05T07:10:22.538 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:39 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:22.615 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-05T07:10:22.615 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:22.615 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:10:22.615 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-05T07:10:22.615 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:22.615 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:22.641 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:10:22.695 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:22.696 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-05T07:10:22.696 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:22.774 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librbd1 2024-02-05T07:10:22.900 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install ceph-volume 2024-02-05T07:10:23.347 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:40 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:23.452 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:10:23.484 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:28 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:23.505 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:23.506 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-05T07:10:23.506 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:23.581 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-rados 2024-02-05T07:10:23.640 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:23.641 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:23.641 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repository Size 2024-02-05T07:10:23.641 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:23.641 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:10:23.641 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume noarch 2:19.0.0-1241.g164d3be4.el9 ceph-noarch 263 k 2024-02-05T07:10:23.641 INFO:teuthology.orchestra.run.smithi188.stdout:Installing dependencies: 2024-02-05T07:10:23.641 INFO:teuthology.orchestra.run.smithi188.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-02-05T07:10:23.641 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:23.641 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:10:23.642 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:23.642 INFO:teuthology.orchestra.run.smithi188.stdout:Install 2 Packages 2024-02-05T07:10:23.642 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:23.642 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 332 k 2024-02-05T07:10:23.642 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 1.5 M 2024-02-05T07:10:23.642 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:10:23.800 INFO:teuthology.orchestra.run.smithi188.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 435 kB/s | 69 kB 00:00 2024-02-05T07:10:23.901 INFO:teuthology.orchestra.run.smithi188.stdout:(2/2): ceph-volume-19.0.0-1241.g164d3be4.el9.no 1.0 MB/s | 263 kB 00:00 2024-02-05T07:10:23.902 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:23.902 INFO:teuthology.orchestra.run.smithi188.stdout:Total 1.2 MB/s | 332 kB 00:00 2024-02-05T07:10:23.902 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:10:23.911 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:10:23.911 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:10:23.953 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:10:23.954 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:10:24.101 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:10:24.153 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:41 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:24.257 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-rados-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:10:24.291 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-02-05T07:10:24.310 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:24.312 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-05T07:10:24.312 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:24.328 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : ceph-volume-2:19.0.0-1241.g164d3be4.el9.noarch 2/2 2024-02-05T07:10:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: ceph-volume-2:19.0.0-1241.g164d3be4.el9.noarch 2/2 2024-02-05T07:10:24.345 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:10:24.345 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-02-05T07:10:24.345 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:24.390 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-rgw 2024-02-05T07:10:24.962 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:41 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:25.067 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-rgw-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:10:25.115 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : ceph-volume-2:19.0.0-1241.g164d3be4.el9.noarch 1/2 2024-02-05T07:10:25.119 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:25.120 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-05T07:10:25.120 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:25.201 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-cephfs 2024-02-05T07:10:25.485 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-02-05T07:10:25.485 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:25.485 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:10:25.485 INFO:teuthology.orchestra.run.smithi188.stdout: ceph-volume-2:19.0.0-1241.g164d3be4.el9.noarch 2024-02-05T07:10:25.485 INFO:teuthology.orchestra.run.smithi188.stdout: python3-packaging-20.9-5.el9.noarch 2024-02-05T07:10:25.485 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:25.485 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:25.767 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:42 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:25.835 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install librados-devel 2024-02-05T07:10:25.871 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-cephfs-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:10:25.923 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:25.924 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-05T07:10:25.924 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:26.009 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-rbd 2024-02-05T07:10:26.419 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:31 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:26.576 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:26.577 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:26.577 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repo Size 2024-02-05T07:10:26.577 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:26.577 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:10:26.577 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 127 k 2024-02-05T07:10:26.577 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:26.577 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:10:26.577 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:26.577 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-02-05T07:10:26.577 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:26.578 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 127 k 2024-02-05T07:10:26.578 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 456 k 2024-02-05T07:10:26.578 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:10:26.584 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:43 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:26.689 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-rbd-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:10:26.741 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:26.742 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-05T07:10:26.742 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:26.831 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install rbd-fuse 2024-02-05T07:10:27.084 INFO:teuthology.orchestra.run.smithi188.stdout:librados-devel-19.0.0-1241.g164d3be4.el9.x86_64 250 kB/s | 127 kB 00:00 2024-02-05T07:10:27.084 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:27.084 INFO:teuthology.orchestra.run.smithi188.stdout:Total 250 kB/s | 127 kB 00:00 2024-02-05T07:10:27.085 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:10:27.090 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:10:27.090 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:10:27.146 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:10:27.146 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:10:27.294 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:10:27.408 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : librados-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:27.439 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:44 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:27.603 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:27.603 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:27.603 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-02-05T07:10:27.604 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:27.604 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:10:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 85 k 2024-02-05T07:10:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:27.604 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:10:27.604 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:27.604 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-02-05T07:10:27.604 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:27.604 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 85 k 2024-02-05T07:10:27.604 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 231 k 2024-02-05T07:10:27.604 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:10:27.827 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-fuse-19.0.0-1241.g164d3be4.el9.x86_64.rpm 385 kB/s | 85 kB 00:00 2024-02-05T07:10:27.827 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:27.827 INFO:teuthology.orchestra.run.smithi184.stdout:Total 382 kB/s | 85 kB 00:00 2024-02-05T07:10:27.827 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:10:27.834 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:10:27.835 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:10:27.891 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:10:27.892 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:10:27.894 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: librados-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:28.077 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:10:28.184 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:28.220 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : librados-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:28.220 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:28.220 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:10:28.220 INFO:teuthology.orchestra.run.smithi188.stdout: librados-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:10:28.220 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:28.220 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:28.453 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install libcephfs2 2024-02-05T07:10:28.612 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:28.948 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:28.948 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:28.949 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:10:28.949 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:10:28.949 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:28.949 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:29.034 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:34 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:29.142 INFO:teuthology.orchestra.run.smithi188.stdout:Package libcephfs2-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:10:29.181 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install rbd-mirror 2024-02-05T07:10:29.195 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:29.196 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-02-05T07:10:29.197 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:29.272 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install libcephfs-devel 2024-02-05T07:10:29.758 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:46 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:29.833 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:34 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:29.920 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:29.920 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:29.921 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repo Size 2024-02-05T07:10:29.921 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:29.921 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:10:29.921 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 3.1 M 2024-02-05T07:10:29.921 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:29.921 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:10:29.921 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:29.921 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-02-05T07:10:29.921 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:29.921 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 3.1 M 2024-02-05T07:10:29.921 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 13 M 2024-02-05T07:10:29.921 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:10:29.989 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:29.990 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:29.990 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repo Size 2024-02-05T07:10:29.990 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:29.990 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:10:29.990 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 31 k 2024-02-05T07:10:29.990 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:29.990 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:10:29.990 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:29.991 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-02-05T07:10:29.991 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:29.991 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 31 k 2024-02-05T07:10:29.991 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 140 k 2024-02-05T07:10:29.991 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:10:30.153 INFO:teuthology.orchestra.run.smithi188.stdout:libcephfs-devel-19.0.0-1241.g164d3be4.el9.x86_6 192 kB/s | 31 kB 00:00 2024-02-05T07:10:30.154 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:30.154 INFO:teuthology.orchestra.run.smithi188.stdout:Total 190 kB/s | 31 kB 00:00 2024-02-05T07:10:30.154 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:10:30.157 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:10:30.158 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:10:30.189 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:10:30.189 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:10:30.285 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:10:30.393 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : libcephfs-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:30.473 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-mirror-19.0.0-1241.g164d3be4.el9.x86_64.rpm 5.6 MB/s | 3.1 MB 00:00 2024-02-05T07:10:30.473 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:30.473 INFO:teuthology.orchestra.run.smithi184.stdout:Total 5.6 MB/s | 3.1 MB 00:00 2024-02-05T07:10:30.473 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:10:30.481 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:10:30.481 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:10:30.554 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:10:30.554 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:10:30.798 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:30.972 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:10:31.038 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:31.063 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:31.063 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:10:31.063 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-05T07:10:31.063 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-05T07:10:31.064 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-05T07:10:31.064 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:31.091 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : libcephfs-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:31.092 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:31.092 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:10:31.092 INFO:teuthology.orchestra.run.smithi188.stdout: libcephfs-devel-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:10:31.092 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:31.092 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:31.304 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install librados2 2024-02-05T07:10:31.873 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:36 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:31.978 INFO:teuthology.orchestra.run.smithi188.stdout:Package librados2-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:10:32.031 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:32.032 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-02-05T07:10:32.032 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:32.105 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install librbd1 2024-02-05T07:10:32.275 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:32.275 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:32.275 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:10:32.276 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:10:32.276 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:32.276 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:32.511 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install rbd-nbd 2024-02-05T07:10:32.671 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:37 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:32.773 INFO:teuthology.orchestra.run.smithi188.stdout:Package librbd1-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:10:32.826 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:32.828 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-02-05T07:10:32.828 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:32.901 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python3-rados 2024-02-05T07:10:33.090 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:50 ago on Mon 05 Feb 2024 07:08:43 AM UTC. 2024-02-05T07:10:33.246 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-05T07:10:33.246 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:33.247 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-02-05T07:10:33.247 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:33.247 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-05T07:10:33.247 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 171 k 2024-02-05T07:10:33.247 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:33.247 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-05T07:10:33.247 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-05T07:10:33.247 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-02-05T07:10:33.247 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:33.247 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 171 k 2024-02-05T07:10:33.247 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 494 k 2024-02-05T07:10:33.247 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-05T07:10:33.473 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:38 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:33.576 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-rados-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:10:33.590 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-nbd-19.0.0-1241.g164d3be4.el9.x86_64.rpm 498 kB/s | 171 kB 00:00 2024-02-05T07:10:33.591 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:33.591 INFO:teuthology.orchestra.run.smithi184.stdout:Total 496 kB/s | 171 kB 00:00 2024-02-05T07:10:33.591 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-05T07:10:33.599 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-05T07:10:33.599 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-05T07:10:33.629 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:33.630 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-02-05T07:10:33.630 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:33.654 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-05T07:10:33.654 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-05T07:10:33.704 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python3-rgw 2024-02-05T07:10:33.803 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-05T07:10:33.922 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:34.279 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:39 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:34.361 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-nbd-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:34.383 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-rgw-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:10:34.435 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:34.436 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-02-05T07:10:34.436 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:34.509 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python3-cephfs 2024-02-05T07:10:34.681 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:34.681 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:34.681 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-05T07:10:34.681 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:10:34.681 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:10:34.681 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-05T07:10:34.894 DEBUG:teuthology.parallel:result is None 2024-02-05T07:10:35.076 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:40 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:35.180 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-cephfs-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:10:35.232 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:35.233 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-02-05T07:10:35.233 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:35.304 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install python3-rbd 2024-02-05T07:10:35.873 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:40 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:35.977 INFO:teuthology.orchestra.run.smithi188.stdout:Package python3-rbd-2:19.0.0-1241.g164d3be4.el9.x86_64 is already installed. 2024-02-05T07:10:36.029 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:36.030 INFO:teuthology.orchestra.run.smithi188.stdout:Nothing to do. 2024-02-05T07:10:36.030 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:36.101 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install rbd-fuse 2024-02-05T07:10:36.671 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:41 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:36.827 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:36.827 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:36.828 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-02-05T07:10:36.828 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:36.828 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:10:36.828 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 85 k 2024-02-05T07:10:36.828 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:36.828 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:10:36.828 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:36.828 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-02-05T07:10:36.828 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:36.828 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 85 k 2024-02-05T07:10:36.828 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 231 k 2024-02-05T07:10:36.829 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:10:37.173 INFO:teuthology.orchestra.run.smithi188.stdout:rbd-fuse-19.0.0-1241.g164d3be4.el9.x86_64.rpm 248 kB/s | 85 kB 00:00 2024-02-05T07:10:37.174 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:37.174 INFO:teuthology.orchestra.run.smithi188.stdout:Total 247 kB/s | 85 kB 00:00 2024-02-05T07:10:37.174 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:10:37.181 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:10:37.181 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:10:37.236 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:10:37.236 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:10:37.419 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:10:37.521 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:37.903 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:38.231 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:38.231 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:38.231 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:10:38.231 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-fuse-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:10:38.231 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:38.231 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:38.469 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install rbd-mirror 2024-02-05T07:10:39.053 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:44 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:39.213 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:39.213 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:39.214 INFO:teuthology.orchestra.run.smithi188.stdout: Package Arch Version Repo Size 2024-02-05T07:10:39.214 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:39.214 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:10:39.214 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 3.1 M 2024-02-05T07:10:39.214 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:39.214 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:10:39.214 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:39.214 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-02-05T07:10:39.214 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:39.214 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 3.1 M 2024-02-05T07:10:39.214 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 13 M 2024-02-05T07:10:39.214 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:10:39.718 INFO:teuthology.orchestra.run.smithi188.stdout:rbd-mirror-19.0.0-1241.g164d3be4.el9.x86_64.rpm 6.1 MB/s | 3.1 MB 00:00 2024-02-05T07:10:39.718 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:39.719 INFO:teuthology.orchestra.run.smithi188.stdout:Total 6.1 MB/s | 3.1 MB 00:00 2024-02-05T07:10:39.719 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:10:39.728 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:10:39.728 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:10:39.800 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:10:39.801 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:10:40.233 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:10:40.294 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-mirror-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:40.317 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:40.318 INFO:teuthology.orchestra.run.smithi188.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-05T07:10:40.318 INFO:teuthology.orchestra.run.smithi188.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-05T07:10:40.318 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-05T07:10:40.318 INFO:teuthology.orchestra.run.smithi188.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-05T07:10:40.318 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:41.461 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-mirror-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:41.461 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:41.461 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:10:41.461 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-mirror-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:10:41.462 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:41.462 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:41.793 DEBUG:teuthology.orchestra.run.smithi188:> sudo yum -y install rbd-nbd 2024-02-05T07:10:42.373 INFO:teuthology.orchestra.run.smithi188.stdout:Last metadata expiration check: 0:01:47 ago on Mon 05 Feb 2024 07:08:55 AM UTC. 2024-02-05T07:10:42.529 INFO:teuthology.orchestra.run.smithi188.stdout:Dependencies resolved. 2024-02-05T07:10:42.529 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:42.529 INFO:teuthology.orchestra.run.smithi188.stdout: Package Architecture Version Repository Size 2024-02-05T07:10:42.529 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:42.529 INFO:teuthology.orchestra.run.smithi188.stdout:Installing: 2024-02-05T07:10:42.529 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd x86_64 2:19.0.0-1241.g164d3be4.el9 ceph 171 k 2024-02-05T07:10:42.530 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:42.530 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction Summary 2024-02-05T07:10:42.530 INFO:teuthology.orchestra.run.smithi188.stdout:================================================================================ 2024-02-05T07:10:42.530 INFO:teuthology.orchestra.run.smithi188.stdout:Install 1 Package 2024-02-05T07:10:42.530 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:42.530 INFO:teuthology.orchestra.run.smithi188.stdout:Total download size: 171 k 2024-02-05T07:10:42.530 INFO:teuthology.orchestra.run.smithi188.stdout:Installed size: 494 k 2024-02-05T07:10:42.531 INFO:teuthology.orchestra.run.smithi188.stdout:Downloading Packages: 2024-02-05T07:10:42.755 INFO:teuthology.orchestra.run.smithi188.stdout:rbd-nbd-19.0.0-1241.g164d3be4.el9.x86_64.rpm 760 kB/s | 171 kB 00:00 2024-02-05T07:10:42.756 INFO:teuthology.orchestra.run.smithi188.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:10:42.756 INFO:teuthology.orchestra.run.smithi188.stdout:Total 756 kB/s | 171 kB 00:00 2024-02-05T07:10:42.756 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction check 2024-02-05T07:10:42.763 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction check succeeded. 2024-02-05T07:10:42.764 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction test 2024-02-05T07:10:42.819 INFO:teuthology.orchestra.run.smithi188.stdout:Transaction test succeeded. 2024-02-05T07:10:42.819 INFO:teuthology.orchestra.run.smithi188.stdout:Running transaction 2024-02-05T07:10:42.973 INFO:teuthology.orchestra.run.smithi188.stdout: Preparing : 1/1 2024-02-05T07:10:43.078 INFO:teuthology.orchestra.run.smithi188.stdout: Installing : rbd-nbd-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:43.502 INFO:teuthology.orchestra.run.smithi188.stdout: Running scriptlet: rbd-nbd-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: Verifying : rbd-nbd-2:19.0.0-1241.g164d3be4.el9.x86_64 1/1 2024-02-05T07:10:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:43.826 INFO:teuthology.orchestra.run.smithi188.stdout:Installed: 2024-02-05T07:10:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: rbd-nbd-2:19.0.0-1241.g164d3be4.el9.x86_64 2024-02-05T07:10:43.826 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:10:43.826 INFO:teuthology.orchestra.run.smithi188.stdout:Complete! 2024-02-05T07:10:44.086 DEBUG:teuthology.parallel:result is None 2024-02-05T07:10:44.087 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=164d3be4a527be775f4d3c343ea591122f1b8921 2024-02-05T07:10:44.230 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-05T07:10:44.255 INFO:teuthology.orchestra.run.smithi184.stdout:19.0.0-1241.g164d3be4.el9 2024-02-05T07:10:44.255 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1241.g164d3be4.el9 2024-02-05T07:10:44.255 INFO:teuthology.task.install:The correct ceph version 19.0.0-1241.g164d3be4 is installed. 2024-02-05T07:10:44.257 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=164d3be4a527be775f4d3c343ea591122f1b8921 2024-02-05T07:10:44.475 DEBUG:teuthology.orchestra.run.smithi188:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-05T07:10:44.495 INFO:teuthology.orchestra.run.smithi188.stdout:19.0.0-1241.g164d3be4.el9 2024-02-05T07:10:44.495 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1241.g164d3be4.el9 2024-02-05T07:10:44.496 INFO:teuthology.task.install:The correct ceph version 19.0.0-1241.g164d3be4 is installed. 2024-02-05T07:10:44.497 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-05T07:10:44.497 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:10:44.497 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-05T07:10:44.530 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-05T07:10:44.530 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-05T07:10:44.564 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-05T07:10:44.564 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:10:44.564 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2024-02-05T07:10:44.600 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-05T07:10:44.669 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-05T07:10:44.669 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/daemon-helper 2024-02-05T07:10:44.696 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-05T07:10:44.764 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-05T07:10:44.764 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:10:44.764 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-05T07:10:44.793 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-05T07:10:44.861 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-05T07:10:44.861 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-05T07:10:44.890 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-05T07:10:44.957 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-05T07:10:44.957 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:10:44.957 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2024-02-05T07:10:44.985 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-05T07:10:45.053 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-05T07:10:45.053 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/usr/bin/stdin-killer 2024-02-05T07:10:45.081 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-05T07:10:45.148 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-05T07:10:45.241 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 1, 'ms bind msgr2': False, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'mon_bind_msgr2': False, 'sha1': '164d3be4a527be775f4d3c343ea591122f1b8921', 'cephadm_mode': 'cephadm-package'} 2024-02-05T07:10:45.241 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 2024-02-05T07:10:45.242 INFO:tasks.cephadm:Cluster fsid is ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:10:45.242 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-05T07:10:45.242 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '[v1:172.21.15.184:6789]', 'mon.c': '[v1:172.21.15.184:6790]', 'mon.b': '[v1:172.21.15.188:6789]'} 2024-02-05T07:10:45.243 INFO:tasks.cephadm:First mon is mon.a on smithi184 2024-02-05T07:10:45.243 INFO:tasks.cephadm:First mgr is y 2024-02-05T07:10:45.243 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-05T07:10:45.243 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname $(hostname -s) 2024-02-05T07:10:45.271 DEBUG:teuthology.orchestra.run.smithi188:> sudo hostname $(hostname -s) 2024-02-05T07:10:45.309 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 on all hosts... 2024-02-05T07:10:45.309 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 pull 2024-02-05T07:10:45.313 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 pull 2024-02-05T07:10:46.158 INFO:teuthology.orchestra.run.smithi184.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921... 2024-02-05T07:10:46.225 INFO:teuthology.orchestra.run.smithi188.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921... 2024-02-05T07:11:33.921 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-02-05T07:11:33.921 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 19.0.0-1241-g164d3be4 (164d3be4a527be775f4d3c343ea591122f1b8921) squid (dev)", 2024-02-05T07:11:33.921 INFO:teuthology.orchestra.run.smithi184.stdout: "image_id": "8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1", 2024-02-05T07:11:33.921 INFO:teuthology.orchestra.run.smithi184.stdout: "repo_digests": [ 2024-02-05T07:11:33.921 INFO:teuthology.orchestra.run.smithi184.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0" 2024-02-05T07:11:33.921 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-02-05T07:11:33.921 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-02-05T07:11:34.451 INFO:teuthology.orchestra.run.smithi188.stdout:{ 2024-02-05T07:11:34.451 INFO:teuthology.orchestra.run.smithi188.stdout: "ceph_version": "ceph version 19.0.0-1241-g164d3be4 (164d3be4a527be775f4d3c343ea591122f1b8921) squid (dev)", 2024-02-05T07:11:34.451 INFO:teuthology.orchestra.run.smithi188.stdout: "image_id": "8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1", 2024-02-05T07:11:34.451 INFO:teuthology.orchestra.run.smithi188.stdout: "repo_digests": [ 2024-02-05T07:11:34.451 INFO:teuthology.orchestra.run.smithi188.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0" 2024-02-05T07:11:34.451 INFO:teuthology.orchestra.run.smithi188.stdout: ] 2024-02-05T07:11:34.451 INFO:teuthology.orchestra.run.smithi188.stdout:} 2024-02-05T07:11:34.474 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph 2024-02-05T07:11:34.507 DEBUG:teuthology.orchestra.run.smithi188:> sudo mkdir -p /etc/ceph 2024-02-05T07:11:34.535 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /etc/ceph 2024-02-05T07:11:34.575 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 777 /etc/ceph 2024-02-05T07:11:34.602 INFO:tasks.cephadm:Writing seed config... 2024-02-05T07:11:34.603 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-05T07:11:34.603 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-05T07:11:34.603 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-05T07:11:34.603 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-02-05T07:11:34.603 INFO:tasks.cephadm: override: [global] ms bind msgr2 = False 2024-02-05T07:11:34.603 INFO:tasks.cephadm: override: [global] ms type = async 2024-02-05T07:11:34.603 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-05T07:11:34.603 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-05T07:11:34.603 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-05T07:11:34.604 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-02-05T07:11:34.604 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-05T07:11:34.604 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-05T07:11:34.604 INFO:tasks.cephadm: override: [osd] osd class default list = * 2024-02-05T07:11:34.604 INFO:tasks.cephadm: override: [osd] osd class load list = * 2024-02-05T07:11:34.604 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-02-05T07:11:34.604 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:11:34.604 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-05T07:11:34.632 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ae38c7f2-c3f5-11ee-95b6-87774f69a715 mon election default strategy = 1 ms bind msgr2 = False ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2024-02-05T07:11:34.632 DEBUG:teuthology.orchestra.run.smithi184:mon.a> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mon.a.service 2024-02-05T07:11:34.674 DEBUG:teuthology.orchestra.run.smithi184:mgr.y> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mgr.y.service 2024-02-05T07:11:34.717 INFO:tasks.cephadm:Bootstrapping... 2024-02-05T07:11:34.717 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 -v bootstrap --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.184:6789]' --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-05T07:11:34.908 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-05T07:11:34.909 INFO:teuthology.orchestra.run.smithi184.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921', '-v', 'bootstrap', '--fsid', 'ae38c7f2-c3f5-11ee-95b6-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-addrv', '[v1:172.21.15.184:6789]', '--skip-admin-label'] 2024-02-05T07:11:34.932 INFO:teuthology.orchestra.run.smithi184.stdout:/bin/podman: stdout 4.9.0 2024-02-05T07:11:34.933 INFO:teuthology.orchestra.run.smithi184.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-02-05T07:11:34.933 INFO:teuthology.orchestra.run.smithi184.stdout:Verifying podman|docker is present... 2024-02-05T07:11:34.958 INFO:teuthology.orchestra.run.smithi184.stdout:/bin/podman: stdout 4.9.0 2024-02-05T07:11:34.958 INFO:teuthology.orchestra.run.smithi184.stdout:Verifying lvm2 is present... 2024-02-05T07:11:34.958 INFO:teuthology.orchestra.run.smithi184.stdout:Verifying time synchronization is in place... 2024-02-05T07:11:34.965 INFO:teuthology.orchestra.run.smithi184.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-05T07:11:34.965 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-05T07:11:34.971 INFO:teuthology.orchestra.run.smithi184.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-05T07:11:34.971 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stdout inactive 2024-02-05T07:11:34.977 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stdout enabled 2024-02-05T07:11:34.983 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stdout active 2024-02-05T07:11:34.983 INFO:teuthology.orchestra.run.smithi184.stdout:Unit chronyd.service is enabled and running 2024-02-05T07:11:34.983 INFO:teuthology.orchestra.run.smithi184.stdout:Repeating the final host check... 2024-02-05T07:11:35.006 INFO:teuthology.orchestra.run.smithi184.stdout:/bin/podman: stdout 4.9.0 2024-02-05T07:11:35.007 INFO:teuthology.orchestra.run.smithi184.stdout:podman (/bin/podman) version 4.9.0 is present 2024-02-05T07:11:35.007 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl is present 2024-02-05T07:11:35.007 INFO:teuthology.orchestra.run.smithi184.stdout:lvcreate is present 2024-02-05T07:11:35.013 INFO:teuthology.orchestra.run.smithi184.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-05T07:11:35.013 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-05T07:11:35.019 INFO:teuthology.orchestra.run.smithi184.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-05T07:11:35.019 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stdout inactive 2024-02-05T07:11:35.025 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stdout enabled 2024-02-05T07:11:35.031 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stdout active 2024-02-05T07:11:35.031 INFO:teuthology.orchestra.run.smithi184.stdout:Unit chronyd.service is enabled and running 2024-02-05T07:11:35.031 INFO:teuthology.orchestra.run.smithi184.stdout:Host looks OK 2024-02-05T07:11:35.031 INFO:teuthology.orchestra.run.smithi184.stdout:Cluster fsid: ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:11:35.031 INFO:teuthology.orchestra.run.smithi184.stdout:Acquiring lock 140262545048144 on /run/cephadm/ae38c7f2-c3f5-11ee-95b6-87774f69a715.lock 2024-02-05T07:11:35.031 INFO:teuthology.orchestra.run.smithi184.stdout:Lock 140262545048144 acquired on /run/cephadm/ae38c7f2-c3f5-11ee-95b6-87774f69a715.lock 2024-02-05T07:11:35.032 INFO:teuthology.orchestra.run.smithi184.stdout:Verifying IP 172.21.15.184 port 6789 ... 2024-02-05T07:11:35.032 INFO:teuthology.orchestra.run.smithi184.stdout:Base mon IP(s) is [172.21.15.184:6789], mon addrv is [v1:172.21.15.184:6789] 2024-02-05T07:11:35.035 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.184 metric 100 2024-02-05T07:11:35.035 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.184 metric 100 2024-02-05T07:11:35.038 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-02-05T07:11:35.038 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-02-05T07:11:35.038 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1792sec hoplimit 64 pref medium 2024-02-05T07:11:35.040 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-05T07:11:35.040 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-02-05T07:11:35.040 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-05T07:11:35.040 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-02-05T07:11:35.041 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2024-02-05T07:11:35.041 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-05T07:11:35.041 INFO:teuthology.orchestra.run.smithi184.stdout:Mon IP `172.21.15.184` is in CIDR network `172.21.0.0/20` 2024-02-05T07:11:35.041 INFO:teuthology.orchestra.run.smithi184.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20'] 2024-02-05T07:11:35.041 INFO:teuthology.orchestra.run.smithi184.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-05T07:11:35.042 INFO:teuthology.orchestra.run.smithi184.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921... 2024-02-05T07:11:35.572 INFO:teuthology.orchestra.run.smithi184.stdout:/bin/podman: stdout 8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1 2024-02-05T07:11:35.572 INFO:teuthology.orchestra.run.smithi184.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921... 2024-02-05T07:11:35.572 INFO:teuthology.orchestra.run.smithi184.stdout:/bin/podman: stderr Getting image source signatures 2024-02-05T07:11:35.572 INFO:teuthology.orchestra.run.smithi184.stdout:/bin/podman: stderr Copying blob sha256:58df4e03ba066accf3a7e07426bab5f1c867e27a139801c642bdafb42b9a2d9a 2024-02-05T07:11:35.572 INFO:teuthology.orchestra.run.smithi184.stdout:/bin/podman: stderr Copying blob sha256:48ac04de0ee67de328b3ea21477b81735e6e7c0783ebcda067ca4695a8266750 2024-02-05T07:11:35.573 INFO:teuthology.orchestra.run.smithi184.stdout:/bin/podman: stderr Copying config sha256:8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1 2024-02-05T07:11:35.573 INFO:teuthology.orchestra.run.smithi184.stdout:/bin/podman: stderr Writing manifest to image destination 2024-02-05T07:11:36.868 INFO:teuthology.orchestra.run.smithi184.stdout:ceph: stdout ceph version 19.0.0-1241-g164d3be4 (164d3be4a527be775f4d3c343ea591122f1b8921) squid (dev) 2024-02-05T07:11:36.869 INFO:teuthology.orchestra.run.smithi184.stdout:Ceph version: ceph version 19.0.0-1241-g164d3be4 (164d3be4a527be775f4d3c343ea591122f1b8921) squid (dev) 2024-02-05T07:11:36.869 INFO:teuthology.orchestra.run.smithi184.stdout:Extracting ceph user uid/gid from container image... 2024-02-05T07:11:37.765 INFO:teuthology.orchestra.run.smithi184.stdout:stat: stdout 167 167 2024-02-05T07:11:37.765 INFO:teuthology.orchestra.run.smithi184.stdout:Creating initial keys... 2024-02-05T07:11:38.830 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph-authtool: stdout AQAqisBl4u90BxAAgh9fSn8xFpWZFqZ78MQ+IA== 2024-02-05T07:11:39.810 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph-authtool: stdout AQArisBlZJVRCRAAlYQeTckeTHEjXUkvrKV9Pg== 2024-02-05T07:11:40.756 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph-authtool: stdout AQAsisBlSRWSCBAAg5f/5UDZ8kRt7T8sgTOu8w== 2024-02-05T07:11:40.757 INFO:teuthology.orchestra.run.smithi184.stdout:Creating initial monmap... 2024-02-05T07:11:41.699 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-05T07:11:41.699 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-02-05T07:11:41.699 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:11:41.699 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-05T07:11:41.699 INFO:teuthology.orchestra.run.smithi184.stdout:monmaptool for a [v1:172.21.15.184:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-05T07:11:41.699 INFO:teuthology.orchestra.run.smithi184.stdout:setting min_mon_release = quincy 2024-02-05T07:11:41.699 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/monmaptool: set fsid to ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:11:41.700 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-05T07:11:41.700 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:11:41.700 INFO:teuthology.orchestra.run.smithi184.stdout:Creating mon... 2024-02-05T07:11:42.738 INFO:teuthology.orchestra.run.smithi184.stdout:create mon.a on 2024-02-05T07:11:42.935 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-02-05T07:11:43.068 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-05T07:11:43.253 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715.target → /etc/systemd/system/ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715.target. 2024-02-05T07:11:43.253 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715.target → /etc/systemd/system/ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715.target. 2024-02-05T07:11:43.480 INFO:teuthology.orchestra.run.smithi184.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mon.a 2024-02-05T07:11:43.480 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mon.a.service: Unit ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mon.a.service not loaded. 2024-02-05T07:11:43.643 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715.target.wants/ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mon.a.service → /etc/systemd/system/ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@.service. 2024-02-05T07:11:44.213 INFO:teuthology.orchestra.run.smithi184.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-05T07:11:44.213 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stdout disabled 2024-02-05T07:11:44.220 INFO:teuthology.orchestra.run.smithi184.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-05T07:11:44.220 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stdout inactive 2024-02-05T07:11:44.220 INFO:teuthology.orchestra.run.smithi184.stdout:firewalld.service is not enabled 2024-02-05T07:11:44.220 INFO:teuthology.orchestra.run.smithi184.stdout:Not possible to enable service . firewalld.service is not available 2024-02-05T07:11:44.220 INFO:teuthology.orchestra.run.smithi184.stdout:Waiting for mon to start... 2024-02-05T07:11:44.221 INFO:teuthology.orchestra.run.smithi184.stdout:Waiting for mon... 2024-02-05T07:11:45.181 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout cluster: 2024-02-05T07:11:45.181 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout id: ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:11:45.181 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-02-05T07:11:45.181 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 2024-02-05T07:11:45.181 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout services: 2024-02-05T07:11:45.181 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.58577s) 2024-02-05T07:11:45.182 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-02-05T07:11:45.182 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-02-05T07:11:45.182 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 2024-02-05T07:11:45.182 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout data: 2024-02-05T07:11:45.182 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-02-05T07:11:45.182 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-02-05T07:11:45.182 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-02-05T07:11:45.182 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout pgs: 2024-02-05T07:11:45.182 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 2024-02-05T07:11:45.182 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.650+0000 7f718e3bd700 1 Processor -- start 2024-02-05T07:11:45.182 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.650+0000 7f718e3bd700 1 -- start start 2024-02-05T07:11:45.182 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.650+0000 7f718e3bd700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f7188109f30 con 0x7f7188105b00 2024-02-05T07:11:45.182 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.650+0000 7f7187fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f7188105b00 0x7f7188105f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:39100/0 (socket says 172.21.15.184:39100) 2024-02-05T07:11:45.183 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.650+0000 7f7187fff700 1 -- 172.21.15.184:0/3773999315 learned_addr learned my addr 172.21.15.184:0/3773999315 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:11:45.183 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.650+0000 7f7186ffd700 1 -- 172.21.15.184:0/3773999315 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9975376 0 0) 0x7f7188109f30 con 0x7f7188105b00 2024-02-05T07:11:45.183 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.651+0000 7f7186ffd700 1 -- 172.21.15.184:0/3773999315 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71700035b0 con 0x7f7188105b00 2024-02-05T07:11:45.183 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.651+0000 7f7186ffd700 1 -- 172.21.15.184:0/3773999315 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3754858090 0 0) 0x7f71700035b0 con 0x7f7188105b00 2024-02-05T07:11:45.183 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.651+0000 7f7186ffd700 1 -- 172.21.15.184:0/3773999315 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f718810b0d0 con 0x7f7188105b00 2024-02-05T07:11:45.183 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.651+0000 7f7186ffd700 1 -- 172.21.15.184:0/3773999315 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f7178001580 con 0x7f7188105b00 2024-02-05T07:11:45.183 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.651+0000 7f7186ffd700 1 -- 172.21.15.184:0/3773999315 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7178001870 con 0x7f7188105b00 2024-02-05T07:11:45.183 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.651+0000 7f7186ffd700 1 -- 172.21.15.184:0/3773999315 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f7178001bb0 con 0x7f7188105b00 2024-02-05T07:11:45.183 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.651+0000 7f718e3bd700 1 -- 172.21.15.184:0/3773999315 >> v1:172.21.15.184:6789/0 conn(0x7f7188105b00 legacy=0x7f7188105f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:11:45.183 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.651+0000 7f718e3bd700 1 -- 172.21.15.184:0/3773999315 shutdown_connections 2024-02-05T07:11:45.183 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.651+0000 7f718e3bd700 1 -- 172.21.15.184:0/3773999315 >> 172.21.15.184:0/3773999315 conn(0x7f71881010e0 msgr2=0x7f7188103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:11:45.183 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.651+0000 7f718e3bd700 1 -- 172.21.15.184:0/3773999315 shutdown_connections 2024-02-05T07:11:45.183 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.651+0000 7f718e3bd700 1 -- 172.21.15.184:0/3773999315 wait complete. 2024-02-05T07:11:45.183 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.652+0000 7f718e3bd700 1 Processor -- start 2024-02-05T07:11:45.184 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.652+0000 7f718e3bd700 1 -- start start 2024-02-05T07:11:45.184 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.652+0000 7f718e3bd700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f71881993b0 con 0x7f7188105b00 2024-02-05T07:11:45.184 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.652+0000 7f7187fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f7188105b00 0x7f7188198ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:39108/0 (socket says 172.21.15.184:39108) 2024-02-05T07:11:45.184 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.652+0000 7f7187fff700 1 -- 172.21.15.184:0/707740003 learned_addr learned my addr 172.21.15.184:0/707740003 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:11:45.184 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.653+0000 7f71857fa700 1 -- 172.21.15.184:0/707740003 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952393197 0 0) 0x7f71881993b0 con 0x7f7188105b00 2024-02-05T07:11:45.184 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.653+0000 7f71857fa700 1 -- 172.21.15.184:0/707740003 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71700031f0 con 0x7f7188105b00 2024-02-05T07:11:45.184 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.653+0000 7f71857fa700 1 -- 172.21.15.184:0/707740003 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 116823855 0 0) 0x7f71700031f0 con 0x7f7188105b00 2024-02-05T07:11:45.184 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.653+0000 7f71857fa700 1 -- 172.21.15.184:0/707740003 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f71881993b0 con 0x7f7188105b00 2024-02-05T07:11:45.184 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.653+0000 7f71857fa700 1 -- 172.21.15.184:0/707740003 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f7178001540 con 0x7f7188105b00 2024-02-05T07:11:45.184 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.653+0000 7f71857fa700 1 -- 172.21.15.184:0/707740003 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3545634034 0 0) 0x7f71881993b0 con 0x7f7188105b00 2024-02-05T07:11:45.184 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.653+0000 7f71857fa700 1 -- 172.21.15.184:0/707740003 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7188199540 con 0x7f7188105b00 2024-02-05T07:11:45.184 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.653+0000 7f718e3bd700 1 -- 172.21.15.184:0/707740003 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71881997f0 con 0x7f7188105b00 2024-02-05T07:11:45.184 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.653+0000 7f718e3bd700 1 -- 172.21.15.184:0/707740003 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f718819d340 con 0x7f7188105b00 2024-02-05T07:11:45.184 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.653+0000 7f71857fa700 1 -- 172.21.15.184:0/707740003 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f7178004b90 con 0x7f7188105b00 2024-02-05T07:11:45.185 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.653+0000 7f71857fa700 1 -- 172.21.15.184:0/707740003 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f7178004e10 con 0x7f7188105b00 2024-02-05T07:11:45.185 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.653+0000 7f71857fa700 1 -- 172.21.15.184:0/707740003 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f7178005340 con 0x7f7188105b00 2024-02-05T07:11:45.185 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.653+0000 7f71857fa700 1 -- 172.21.15.184:0/707740003 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 389070130 0 0) 0x7f71780069f0 con 0x7f7188105b00 2024-02-05T07:11:45.185 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.654+0000 7f718e3bd700 1 -- 172.21.15.184:0/707740003 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7174005150 con 0x7f7188105b00 2024-02-05T07:11:45.185 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.656+0000 7f71857fa700 1 -- 172.21.15.184:0/707740003 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f7178005880 con 0x7f7188105b00 2024-02-05T07:11:45.185 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.731+0000 7f718e3bd700 1 -- 172.21.15.184:0/707740003 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f7174005c10 con 0x7f7188105b00 2024-02-05T07:11:45.185 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.731+0000 7f71857fa700 1 -- 172.21.15.184:0/707740003 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+316 (unknown 1155462804 0 2786462884) 0x7f7178005aa0 con 0x7f7188105b00 2024-02-05T07:11:45.185 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.732+0000 7f718e3bd700 1 -- 172.21.15.184:0/707740003 >> v1:172.21.15.184:6789/0 conn(0x7f7188105b00 legacy=0x7f7188198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:11:45.185 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.732+0000 7f718e3bd700 1 -- 172.21.15.184:0/707740003 shutdown_connections 2024-02-05T07:11:45.185 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.732+0000 7f718e3bd700 1 -- 172.21.15.184:0/707740003 >> 172.21.15.184:0/707740003 conn(0x7f71881010e0 msgr2=0x7f718818ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:11:45.185 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.732+0000 7f718e3bd700 1 -- 172.21.15.184:0/707740003 shutdown_connections 2024-02-05T07:11:45.185 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:44.732+0000 7f718e3bd700 1 -- 172.21.15.184:0/707740003 wait complete. 2024-02-05T07:11:45.185 INFO:teuthology.orchestra.run.smithi184.stdout:mon is available 2024-02-05T07:11:45.185 INFO:teuthology.orchestra.run.smithi184.stdout:Assimilating anything we can from ceph.conf... 2024-02-05T07:11:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:46 smithi184 ceph-mon[29386]: from='client.? v1:172.21.15.184:0/114674929' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-05T07:11:46.296 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 2024-02-05T07:11:46.296 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout [global] 2024-02-05T07:11:46.296 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout fsid = ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:11:46.296 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout mon_host = [v1:172.21.15.184:6789] 2024-02-05T07:11:46.296 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-05T07:11:46.296 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-05T07:11:46.296 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-05T07:11:46.296 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-05T07:11:46.296 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 2024-02-05T07:11:46.296 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-05T07:11:46.296 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-05T07:11:46.296 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 2024-02-05T07:11:46.297 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout [osd] 2024-02-05T07:11:46.297 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-05T07:11:46.297 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-05T07:11:46.297 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.589+0000 7f58fbcbc700 1 Processor -- start 2024-02-05T07:11:46.297 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.589+0000 7f58fbcbc700 1 -- start start 2024-02-05T07:11:46.297 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.589+0000 7f58fbcbc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f58f4109f30 con 0x7f58f4105b00 2024-02-05T07:11:46.297 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.589+0000 7f58f9a58700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f58f4105b00 0x7f58f4105f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:39112/0 (socket says 172.21.15.184:39112) 2024-02-05T07:11:46.297 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.589+0000 7f58f9a58700 1 -- 172.21.15.184:0/4134512653 learned_addr learned my addr 172.21.15.184:0/4134512653 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:11:46.297 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.589+0000 7f58f8a56700 1 -- 172.21.15.184:0/4134512653 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4182916074 0 0) 0x7f58f4109f30 con 0x7f58f4105b00 2024-02-05T07:11:46.297 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.589+0000 7f58f8a56700 1 -- 172.21.15.184:0/4134512653 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58e00035b0 con 0x7f58f4105b00 2024-02-05T07:11:46.297 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.589+0000 7f58f8a56700 1 -- 172.21.15.184:0/4134512653 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 160440567 0 0) 0x7f58e00035b0 con 0x7f58f4105b00 2024-02-05T07:11:46.297 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.589+0000 7f58f8a56700 1 -- 172.21.15.184:0/4134512653 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f410b0d0 con 0x7f58f4105b00 2024-02-05T07:11:46.297 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.589+0000 7f58f8a56700 1 -- 172.21.15.184:0/4134512653 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f58f0001580 con 0x7f58f4105b00 2024-02-05T07:11:46.297 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.589+0000 7f58f8a56700 1 -- 172.21.15.184:0/4134512653 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f58f0001870 con 0x7f58f4105b00 2024-02-05T07:11:46.297 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.589+0000 7f58f8a56700 1 -- 172.21.15.184:0/4134512653 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f58f0001bb0 con 0x7f58f4105b00 2024-02-05T07:11:46.298 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.590+0000 7f58fbcbc700 1 -- 172.21.15.184:0/4134512653 >> v1:172.21.15.184:6789/0 conn(0x7f58f4105b00 legacy=0x7f58f4105f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:11:46.298 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.590+0000 7f58fbcbc700 1 -- 172.21.15.184:0/4134512653 shutdown_connections 2024-02-05T07:11:46.298 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.590+0000 7f58fbcbc700 1 -- 172.21.15.184:0/4134512653 >> 172.21.15.184:0/4134512653 conn(0x7f58f41010e0 msgr2=0x7f58f4103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:11:46.298 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.590+0000 7f58fbcbc700 1 -- 172.21.15.184:0/4134512653 shutdown_connections 2024-02-05T07:11:46.298 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.590+0000 7f58fbcbc700 1 -- 172.21.15.184:0/4134512653 wait complete. 2024-02-05T07:11:46.298 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.590+0000 7f58fbcbc700 1 Processor -- start 2024-02-05T07:11:46.298 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.591+0000 7f58fbcbc700 1 -- start start 2024-02-05T07:11:46.298 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.591+0000 7f58fbcbc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f58f41993b0 con 0x7f58f4105b00 2024-02-05T07:11:46.298 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.591+0000 7f58f9a58700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f58f4105b00 0x7f58f4198ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:39114/0 (socket says 172.21.15.184:39114) 2024-02-05T07:11:46.298 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.591+0000 7f58f9a58700 1 -- 172.21.15.184:0/114674929 learned_addr learned my addr 172.21.15.184:0/114674929 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:11:46.298 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.591+0000 7f58eaffd700 1 -- 172.21.15.184:0/114674929 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801730991 0 0) 0x7f58f41993b0 con 0x7f58f4105b00 2024-02-05T07:11:46.298 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.591+0000 7f58eaffd700 1 -- 172.21.15.184:0/114674929 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58e00031f0 con 0x7f58f4105b00 2024-02-05T07:11:46.298 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.591+0000 7f58eaffd700 1 -- 172.21.15.184:0/114674929 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3847152282 0 0) 0x7f58e00031f0 con 0x7f58f4105b00 2024-02-05T07:11:46.298 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.591+0000 7f58eaffd700 1 -- 172.21.15.184:0/114674929 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58f41993b0 con 0x7f58f4105b00 2024-02-05T07:11:46.299 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.591+0000 7f58eaffd700 1 -- 172.21.15.184:0/114674929 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f58f0001540 con 0x7f58f4105b00 2024-02-05T07:11:46.299 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.591+0000 7f58eaffd700 1 -- 172.21.15.184:0/114674929 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3714822098 0 0) 0x7f58f41993b0 con 0x7f58f4105b00 2024-02-05T07:11:46.299 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.591+0000 7f58eaffd700 1 -- 172.21.15.184:0/114674929 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f4199540 con 0x7f58f4105b00 2024-02-05T07:11:46.299 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.591+0000 7f58fbcbc700 1 -- 172.21.15.184:0/114674929 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f41997f0 con 0x7f58f4105b00 2024-02-05T07:11:46.299 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.591+0000 7f58fbcbc700 1 -- 172.21.15.184:0/114674929 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f419d340 con 0x7f58f4105b00 2024-02-05T07:11:46.299 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.591+0000 7f58eaffd700 1 -- 172.21.15.184:0/114674929 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f58f0004b90 con 0x7f58f4105b00 2024-02-05T07:11:46.299 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.591+0000 7f58eaffd700 1 -- 172.21.15.184:0/114674929 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f58f0004e90 con 0x7f58f4105b00 2024-02-05T07:11:46.299 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.592+0000 7f58eaffd700 1 -- 172.21.15.184:0/114674929 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f58f00053c0 con 0x7f58f4105b00 2024-02-05T07:11:46.299 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.592+0000 7f58eaffd700 1 -- 172.21.15.184:0/114674929 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 389070130 0 0) 0x7f58f00069f0 con 0x7f58f4105b00 2024-02-05T07:11:46.299 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.592+0000 7f58fbcbc700 1 -- 172.21.15.184:0/114674929 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d8005150 con 0x7f58f4105b00 2024-02-05T07:11:46.299 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.595+0000 7f58eaffd700 1 -- 172.21.15.184:0/114674929 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f58f0006bb0 con 0x7f58f4105b00 2024-02-05T07:11:46.299 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.661+0000 7f58fbcbc700 1 -- 172.21.15.184:0/114674929 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f58d8005980 con 0x7f58f4105b00 2024-02-05T07:11:46.299 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.664+0000 7f58eaffd700 1 -- 172.21.15.184:0/114674929 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+318 (unknown 1213389831 0 4218021091) 0x7f58f00058b0 con 0x7f58f4105b00 2024-02-05T07:11:46.299 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.665+0000 7f58fbcbc700 1 -- 172.21.15.184:0/114674929 >> v1:172.21.15.184:6789/0 conn(0x7f58f4105b00 legacy=0x7f58f4198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:11:46.300 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.665+0000 7f58fbcbc700 1 -- 172.21.15.184:0/114674929 shutdown_connections 2024-02-05T07:11:46.300 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.665+0000 7f58fbcbc700 1 -- 172.21.15.184:0/114674929 >> 172.21.15.184:0/114674929 conn(0x7f58f41010e0 msgr2=0x7f58f418ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:11:46.300 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.665+0000 7f58fbcbc700 1 -- 172.21.15.184:0/114674929 shutdown_connections 2024-02-05T07:11:46.300 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:45.665+0000 7f58fbcbc700 1 -- 172.21.15.184:0/114674929 wait complete. 2024-02-05T07:11:46.300 INFO:teuthology.orchestra.run.smithi184.stdout:Generating new minimal ceph.conf... 2024-02-05T07:11:47.402 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:47 smithi184 ceph-mon[29386]: from='client.? v1:172.21.15.184:0/1854543821' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:11:47.409 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.704+0000 7f6612c7d700 1 Processor -- start 2024-02-05T07:11:47.409 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.704+0000 7f6612c7d700 1 -- start start 2024-02-05T07:11:47.409 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.704+0000 7f6612c7d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f660c07a350 con 0x7f660c07b750 2024-02-05T07:11:47.409 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.704+0000 7f6610a19700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f660c07b750 0x7f660c079bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:39116/0 (socket says 172.21.15.184:39116) 2024-02-05T07:11:47.409 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.704+0000 7f6610a19700 1 -- 172.21.15.184:0/1198350685 learned_addr learned my addr 172.21.15.184:0/1198350685 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:11:47.409 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.704+0000 7f660b7fe700 1 -- 172.21.15.184:0/1198350685 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537506343 0 0) 0x7f660c07a350 con 0x7f660c07b750 2024-02-05T07:11:47.409 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.705+0000 7f660b7fe700 1 -- 172.21.15.184:0/1198350685 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65fc0035b0 con 0x7f660c07b750 2024-02-05T07:11:47.409 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.705+0000 7f660b7fe700 1 -- 172.21.15.184:0/1198350685 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 458093328 0 0) 0x7f65fc0035b0 con 0x7f660c07b750 2024-02-05T07:11:47.409 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.705+0000 7f660b7fe700 1 -- 172.21.15.184:0/1198350685 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c07a4e0 con 0x7f660c07b750 2024-02-05T07:11:47.409 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.705+0000 7f660b7fe700 1 -- 172.21.15.184:0/1198350685 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f6600001580 con 0x7f660c07b750 2024-02-05T07:11:47.409 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.705+0000 7f660b7fe700 1 -- 172.21.15.184:0/1198350685 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f6600001ce0 con 0x7f660c07b750 2024-02-05T07:11:47.410 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.705+0000 7f660b7fe700 1 -- 172.21.15.184:0/1198350685 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f6600005960 con 0x7f660c07b750 2024-02-05T07:11:47.410 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.705+0000 7f6612c7d700 1 -- 172.21.15.184:0/1198350685 >> v1:172.21.15.184:6789/0 conn(0x7f660c07b750 legacy=0x7f660c079bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:11:47.410 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.705+0000 7f6612c7d700 1 -- 172.21.15.184:0/1198350685 shutdown_connections 2024-02-05T07:11:47.410 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.705+0000 7f6612c7d700 1 -- 172.21.15.184:0/1198350685 >> 172.21.15.184:0/1198350685 conn(0x7f660c1010e0 msgr2=0x7f660c103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:11:47.410 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.705+0000 7f6612c7d700 1 -- 172.21.15.184:0/1198350685 shutdown_connections 2024-02-05T07:11:47.410 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.705+0000 7f6612c7d700 1 -- 172.21.15.184:0/1198350685 wait complete. 2024-02-05T07:11:47.410 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.706+0000 7f6612c7d700 1 Processor -- start 2024-02-05T07:11:47.410 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.706+0000 7f6612c7d700 1 -- start start 2024-02-05T07:11:47.410 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.706+0000 7f6612c7d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f660c19be60 con 0x7f660c07b750 2024-02-05T07:11:47.410 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.706+0000 7f6610a19700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f660c07b750 0x7f660c19b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:39122/0 (socket says 172.21.15.184:39122) 2024-02-05T07:11:47.410 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.706+0000 7f6610a19700 1 -- 172.21.15.184:0/1854543821 learned_addr learned my addr 172.21.15.184:0/1854543821 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:11:47.410 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.706+0000 7f6609ffb700 1 -- 172.21.15.184:0/1854543821 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411690169 0 0) 0x7f660c19be60 con 0x7f660c07b750 2024-02-05T07:11:47.410 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.706+0000 7f6609ffb700 1 -- 172.21.15.184:0/1854543821 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65fc0054f0 con 0x7f660c07b750 2024-02-05T07:11:47.411 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.707+0000 7f6609ffb700 1 -- 172.21.15.184:0/1854543821 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 910058150 0 0) 0x7f65fc0054f0 con 0x7f660c07b750 2024-02-05T07:11:47.411 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.707+0000 7f6609ffb700 1 -- 172.21.15.184:0/1854543821 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f660c19be60 con 0x7f660c07b750 2024-02-05T07:11:47.411 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.707+0000 7f6609ffb700 1 -- 172.21.15.184:0/1854543821 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f6600001080 con 0x7f660c07b750 2024-02-05T07:11:47.411 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.707+0000 7f6609ffb700 1 -- 172.21.15.184:0/1854543821 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3415672353 0 0) 0x7f660c19be60 con 0x7f660c07b750 2024-02-05T07:11:47.411 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.707+0000 7f6609ffb700 1 -- 172.21.15.184:0/1854543821 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c19bff0 con 0x7f660c07b750 2024-02-05T07:11:47.411 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.707+0000 7f6612c7d700 1 -- 172.21.15.184:0/1854543821 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f660c19c2a0 con 0x7f660c07b750 2024-02-05T07:11:47.411 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.707+0000 7f6609ffb700 1 -- 172.21.15.184:0/1854543821 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f6600005340 con 0x7f660c07b750 2024-02-05T07:11:47.411 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.707+0000 7f6609ffb700 1 -- 172.21.15.184:0/1854543821 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f6600006190 con 0x7f660c07b750 2024-02-05T07:11:47.411 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.707+0000 7f6609ffb700 1 -- 172.21.15.184:0/1854543821 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f6600006780 con 0x7f660c07b750 2024-02-05T07:11:47.411 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.707+0000 7f6612c7d700 1 -- 172.21.15.184:0/1854543821 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f660c19fdf0 con 0x7f660c07b750 2024-02-05T07:11:47.411 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.707+0000 7f6609ffb700 1 -- 172.21.15.184:0/1854543821 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 389070130 0 0) 0x7f6600006fa0 con 0x7f660c07b750 2024-02-05T07:11:47.411 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.708+0000 7f6612c7d700 1 -- 172.21.15.184:0/1854543821 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f660c10d060 con 0x7f660c07b750 2024-02-05T07:11:47.411 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.710+0000 7f6609ffb700 1 -- 172.21.15.184:0/1854543821 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f6600005c00 con 0x7f660c07b750 2024-02-05T07:11:47.412 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.777+0000 7f6612c7d700 1 -- 172.21.15.184:0/1854543821 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f660c1a0320 con 0x7f660c07b750 2024-02-05T07:11:47.412 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.778+0000 7f6609ffb700 1 -- 172.21.15.184:0/1854543821 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+148 (unknown 1452402520 0 862990025) 0x7f6600005640 con 0x7f660c07b750 2024-02-05T07:11:47.412 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.778+0000 7f6612c7d700 1 -- 172.21.15.184:0/1854543821 >> v1:172.21.15.184:6789/0 conn(0x7f660c07b750 legacy=0x7f660c19b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:11:47.412 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.778+0000 7f6612c7d700 1 -- 172.21.15.184:0/1854543821 shutdown_connections 2024-02-05T07:11:47.412 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.778+0000 7f6612c7d700 1 -- 172.21.15.184:0/1854543821 >> 172.21.15.184:0/1854543821 conn(0x7f660c1010e0 msgr2=0x7f660c109ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:11:47.412 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.778+0000 7f6612c7d700 1 -- 172.21.15.184:0/1854543821 shutdown_connections 2024-02-05T07:11:47.412 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:46.779+0000 7f6612c7d700 1 -- 172.21.15.184:0/1854543821 wait complete. 2024-02-05T07:11:47.412 INFO:teuthology.orchestra.run.smithi184.stdout:Restarting the monitor... 2024-02-05T07:11:47.692 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:47 smithi184 systemd[1]: Stopping Ceph mon.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:11:48.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:47 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-a[29363]: 2024-02-05T07:11:47.689+0000 7f9fa0e49700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-05T07:11:48.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:47 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-a[29363]: 2024-02-05T07:11:47.689+0000 7f9fa0e49700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-02-05T07:11:48.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:47 smithi184 podman[29709]: 2024-02-05 07:11:47.873742859 +0000 UTC m=+0.309159998 container died a7f82f31545da7ac7f271f40139b1ef239cf0aa20d11273db572860a171194fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.2, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-05T07:11:48.388 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:48 smithi184 podman[29709]: 2024-02-05 07:11:48.20319259 +0000 UTC m=+0.638609769 container cleanup a7f82f31545da7ac7f271f40139b1ef239cf0aa20d11273db572860a171194fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-05T07:11:48.389 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:48 smithi184 bash[29709]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-a 2024-02-05T07:11:48.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:48 smithi184 podman[29728]: 2024-02-05 07:11:48.387262292 +0000 UTC m=+0.511437395 container remove a7f82f31545da7ac7f271f40139b1ef239cf0aa20d11273db572860a171194fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-a, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-05T07:11:48.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:48 smithi184 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mon.a.service: Deactivated successfully. 2024-02-05T07:11:48.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:48 smithi184 systemd[1]: Stopped Ceph mon.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:11:48.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:48 smithi184 systemd[1]: Starting Ceph mon.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:11:49.087 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:48 smithi184 podman[29824]: 2024-02-05 07:11:48.729832081 +0000 UTC m=+0.018347088 image pull 8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 2024-02-05T07:11:49.087 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:48 smithi184 podman[29824]: 2024-02-05 07:11:48.830194592 +0000 UTC m=+0.118709591 container create d42de0bd7fb18e329b7b9a32f32f92fe37b2f94b8d9db998232d367524467078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-a, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be) 2024-02-05T07:11:49.087 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 podman[29824]: 2024-02-05 07:11:49.057706054 +0000 UTC m=+0.346221057 container init d42de0bd7fb18e329b7b9a32f32f92fe37b2f94b8d9db998232d367524467078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-a, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, GIT_CLEAN=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be) 2024-02-05T07:11:49.087 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 podman[29824]: 2024-02-05 07:11:49.062944813 +0000 UTC m=+0.351459813 container start d42de0bd7fb18e329b7b9a32f32f92fe37b2f94b8d9db998232d367524467078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-a, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-05T07:11:49.188 INFO:teuthology.orchestra.run.smithi184.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-02-05T07:11:49.395 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: set uid:gid to 167:167 (ceph:ceph) 2024-02-05T07:11:49.395 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: ceph version 19.0.0-1241-g164d3be4 (164d3be4a527be775f4d3c343ea591122f1b8921) squid (dev), process ceph-mon, pid 6 2024-02-05T07:11:49.395 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: pidfile_write: ignore empty --pid-file 2024-02-05T07:11:49.395 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: load: jerasure load: lrc 2024-02-05T07:11:49.395 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: RocksDB version: 7.9.2 2024-02-05T07:11:49.395 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Git sha 0 2024-02-05T07:11:49.395 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Compile date 2024-02-04 23:11:06 2024-02-05T07:11:49.395 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: DB SUMMARY 2024-02-05T07:11:49.396 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: DB Session ID: 7BSY4YFMRBQFCSDDTAGZ 2024-02-05T07:11:49.396 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: CURRENT file: CURRENT 2024-02-05T07:11:49.396 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: IDENTITY file: IDENTITY 2024-02-05T07:11:49.396 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-02-05T07:11:49.396 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-02-05T07:11:49.396 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 85560 ; 2024-02-05T07:11:49.396 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.error_if_exists: 0 2024-02-05T07:11:49.396 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.create_if_missing: 0 2024-02-05T07:11:49.396 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.paranoid_checks: 1 2024-02-05T07:11:49.396 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-05T07:11:49.396 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-05T07:11:49.397 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-05T07:11:49.397 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.env: 0x55d9379bbae0 2024-02-05T07:11:49.397 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.fs: PosixFileSystem 2024-02-05T07:11:49.397 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.info_log: 0x55d93884f900 2024-02-05T07:11:49.397 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_file_opening_threads: 16 2024-02-05T07:11:49.397 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.statistics: (nil) 2024-02-05T07:11:49.397 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.use_fsync: 0 2024-02-05T07:11:49.397 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_log_file_size: 0 2024-02-05T07:11:49.398 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-05T07:11:49.398 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-05T07:11:49.398 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.keep_log_file_num: 1000 2024-02-05T07:11:49.398 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.recycle_log_file_num: 0 2024-02-05T07:11:49.398 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.allow_fallocate: 1 2024-02-05T07:11:49.398 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.allow_mmap_reads: 0 2024-02-05T07:11:49.398 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.allow_mmap_writes: 0 2024-02-05T07:11:49.398 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.use_direct_reads: 0 2024-02-05T07:11:49.398 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-05T07:11:49.398 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.create_missing_column_families: 0 2024-02-05T07:11:49.399 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.db_log_dir: 2024-02-05T07:11:49.399 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.wal_dir: 2024-02-05T07:11:49.399 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-05T07:11:49.401 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-05T07:11:49.402 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-05T07:11:49.402 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-05T07:11:49.402 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-05T07:11:49.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-05T07:11:49.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.advise_random_on_open: 1 2024-02-05T07:11:49.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.db_write_buffer_size: 0 2024-02-05T07:11:49.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.write_buffer_manager: 0x55d938823400 2024-02-05T07:11:49.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-05T07:11:49.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-05T07:11:49.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-05T07:11:49.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.rate_limiter: (nil) 2024-02-05T07:11:49.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-05T07:11:49.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.wal_recovery_mode: 2 2024-02-05T07:11:49.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.enable_thread_tracking: 0 2024-02-05T07:11:49.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.enable_pipelined_write: 0 2024-02-05T07:11:49.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.unordered_write: 0 2024-02-05T07:11:49.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-05T07:11:49.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-05T07:11:49.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-05T07:11:49.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-05T07:11:49.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.row_cache: None 2024-02-05T07:11:49.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.wal_filter: None 2024-02-05T07:11:49.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-05T07:11:49.405 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.allow_ingest_behind: 0 2024-02-05T07:11:49.405 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.two_write_queues: 0 2024-02-05T07:11:49.405 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.manual_wal_flush: 0 2024-02-05T07:11:49.405 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.wal_compression: 0 2024-02-05T07:11:49.405 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.atomic_flush: 0 2024-02-05T07:11:49.405 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-05T07:11:49.405 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-05T07:11:49.405 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-05T07:11:49.405 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.log_readahead_size: 0 2024-02-05T07:11:49.405 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-05T07:11:49.405 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.best_efforts_recovery: 0 2024-02-05T07:11:49.405 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-05T07:11:49.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-05T07:11:49.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.allow_data_in_errors: 0 2024-02-05T07:11:49.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.db_host_id: __hostname__ 2024-02-05T07:11:49.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-05T07:11:49.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_background_jobs: 2 2024-02-05T07:11:49.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_background_compactions: -1 2024-02-05T07:11:49.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_subcompactions: 1 2024-02-05T07:11:49.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-05T07:11:49.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-05T07:11:49.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-05T07:11:49.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_total_wal_size: 0 2024-02-05T07:11:49.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-05T07:11:49.407 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-05T07:11:49.407 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-05T07:11:49.407 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-05T07:11:49.407 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_open_files: -1 2024-02-05T07:11:49.407 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.bytes_per_sync: 0 2024-02-05T07:11:49.407 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-05T07:11:49.407 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-05T07:11:49.407 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compaction_readahead_size: 0 2024-02-05T07:11:49.407 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_background_flushes: -1 2024-02-05T07:11:49.407 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Compression algorithms supported: 2024-02-05T07:11:49.407 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-05T07:11:49.407 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: kZSTD supported: 0 2024-02-05T07:11:49.407 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: kXpressCompression supported: 0 2024-02-05T07:11:49.408 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: kLZ4HCCompression supported: 1 2024-02-05T07:11:49.408 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: kZlibCompression supported: 1 2024-02-05T07:11:49.408 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: kSnappyCompression supported: 1 2024-02-05T07:11:49.408 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: kLZ4Compression supported: 1 2024-02-05T07:11:49.408 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: kBZip2Compression supported: 0 2024-02-05T07:11:49.408 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-05T07:11:49.408 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-05T07:11:49.408 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-02-05T07:11:49.408 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-05T07:11:49.409 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-05T07:11:49.409 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.merge_operator: 2024-02-05T07:11:49.409 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compaction_filter: None 2024-02-05T07:11:49.409 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compaction_filter_factory: None 2024-02-05T07:11:49.409 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.sst_partitioner_factory: None 2024-02-05T07:11:49.409 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-05T07:11:49.409 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-05T07:11:49.409 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55d93884fa00) 2024-02-05T07:11:49.409 INFO:journalctl@ceph.mon.a.smithi184.stdout: cache_index_and_filter_blocks: 1 2024-02-05T07:11:49.410 INFO:journalctl@ceph.mon.a.smithi184.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-05T07:11:49.410 INFO:journalctl@ceph.mon.a.smithi184.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-05T07:11:49.410 INFO:journalctl@ceph.mon.a.smithi184.stdout: pin_top_level_index_and_filter: 1 2024-02-05T07:11:49.410 INFO:journalctl@ceph.mon.a.smithi184.stdout: index_type: 0 2024-02-05T07:11:49.410 INFO:journalctl@ceph.mon.a.smithi184.stdout: data_block_index_type: 0 2024-02-05T07:11:49.410 INFO:journalctl@ceph.mon.a.smithi184.stdout: index_shortening: 1 2024-02-05T07:11:49.410 INFO:journalctl@ceph.mon.a.smithi184.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-05T07:11:49.410 INFO:journalctl@ceph.mon.a.smithi184.stdout: checksum: 4 2024-02-05T07:11:49.410 INFO:journalctl@ceph.mon.a.smithi184.stdout: no_block_cache: 0 2024-02-05T07:11:49.410 INFO:journalctl@ceph.mon.a.smithi184.stdout: block_cache: 0x55d938853090 2024-02-05T07:11:49.410 INFO:journalctl@ceph.mon.a.smithi184.stdout: block_cache_name: BinnedLRUCache 2024-02-05T07:11:49.410 INFO:journalctl@ceph.mon.a.smithi184.stdout: block_cache_options: 2024-02-05T07:11:49.410 INFO:journalctl@ceph.mon.a.smithi184.stdout: capacity : 536870912 2024-02-05T07:11:49.411 INFO:journalctl@ceph.mon.a.smithi184.stdout: num_shard_bits : 4 2024-02-05T07:11:49.411 INFO:journalctl@ceph.mon.a.smithi184.stdout: strict_capacity_limit : 0 2024-02-05T07:11:49.411 INFO:journalctl@ceph.mon.a.smithi184.stdout: high_pri_pool_ratio: 0.000 2024-02-05T07:11:49.411 INFO:journalctl@ceph.mon.a.smithi184.stdout: block_cache_compressed: (nil) 2024-02-05T07:11:49.411 INFO:journalctl@ceph.mon.a.smithi184.stdout: persistent_cache: (nil) 2024-02-05T07:11:49.411 INFO:journalctl@ceph.mon.a.smithi184.stdout: block_size: 4096 2024-02-05T07:11:49.411 INFO:journalctl@ceph.mon.a.smithi184.stdout: block_size_deviation: 10 2024-02-05T07:11:49.411 INFO:journalctl@ceph.mon.a.smithi184.stdout: block_restart_interval: 16 2024-02-05T07:11:49.411 INFO:journalctl@ceph.mon.a.smithi184.stdout: index_block_restart_interval: 1 2024-02-05T07:11:49.411 INFO:journalctl@ceph.mon.a.smithi184.stdout: metadata_block_size: 4096 2024-02-05T07:11:49.411 INFO:journalctl@ceph.mon.a.smithi184.stdout: partition_filters: 0 2024-02-05T07:11:49.411 INFO:journalctl@ceph.mon.a.smithi184.stdout: use_delta_encoding: 1 2024-02-05T07:11:49.411 INFO:journalctl@ceph.mon.a.smithi184.stdout: filter_policy: bloomfilter 2024-02-05T07:11:49.412 INFO:journalctl@ceph.mon.a.smithi184.stdout: whole_key_filtering: 1 2024-02-05T07:11:49.412 INFO:journalctl@ceph.mon.a.smithi184.stdout: verify_compression: 0 2024-02-05T07:11:49.412 INFO:journalctl@ceph.mon.a.smithi184.stdout: read_amp_bytes_per_bit: 0 2024-02-05T07:11:49.412 INFO:journalctl@ceph.mon.a.smithi184.stdout: format_version: 5 2024-02-05T07:11:49.412 INFO:journalctl@ceph.mon.a.smithi184.stdout: enable_index_compression: 1 2024-02-05T07:11:49.412 INFO:journalctl@ceph.mon.a.smithi184.stdout: block_align: 0 2024-02-05T07:11:49.412 INFO:journalctl@ceph.mon.a.smithi184.stdout: max_auto_readahead_size: 262144 2024-02-05T07:11:49.412 INFO:journalctl@ceph.mon.a.smithi184.stdout: prepopulate_block_cache: 0 2024-02-05T07:11:49.412 INFO:journalctl@ceph.mon.a.smithi184.stdout: initial_auto_readahead_size: 8192 2024-02-05T07:11:49.412 INFO:journalctl@ceph.mon.a.smithi184.stdout: num_file_reads_for_auto_readahead: 2 2024-02-05T07:11:49.412 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.write_buffer_size: 33554432 2024-02-05T07:11:49.412 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_write_buffer_number: 2 2024-02-05T07:11:49.412 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compression: NoCompression 2024-02-05T07:11:49.413 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.bottommost_compression: Disabled 2024-02-05T07:11:49.413 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.prefix_extractor: nullptr 2024-02-05T07:11:49.413 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-05T07:11:49.413 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.num_levels: 7 2024-02-05T07:11:49.413 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-05T07:11:49.413 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-05T07:11:49.413 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-05T07:11:49.413 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-05T07:11:49.413 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-05T07:11:49.413 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-05T07:11:49.413 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-05T07:11:49.413 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-05T07:11:49.413 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-05T07:11:49.413 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-05T07:11:49.413 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-05T07:11:49.414 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-05T07:11:49.414 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-05T07:11:49.414 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compression_opts.level: 32767 2024-02-05T07:11:49.414 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compression_opts.strategy: 0 2024-02-05T07:11:49.414 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-05T07:11:49.414 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-05T07:11:49.414 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-05T07:11:49.414 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-05T07:11:49.414 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compression_opts.enabled: false 2024-02-05T07:11:49.414 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-05T07:11:49.414 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-05T07:11:49.414 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-05T07:11:49.414 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-05T07:11:49.415 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.target_file_size_base: 67108864 2024-02-05T07:11:49.415 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-05T07:11:49.415 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-05T07:11:49.415 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-05T07:11:49.415 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-05T07:11:49.415 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-05T07:11:49.415 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-05T07:11:49.415 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-05T07:11:49.415 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-05T07:11:49.415 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-05T07:11:49.415 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-05T07:11:49.415 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-05T07:11:49.415 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-05T07:11:49.416 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-05T07:11:49.416 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-05T07:11:49.416 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.arena_block_size: 1048576 2024-02-05T07:11:49.416 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-05T07:11:49.416 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-05T07:11:49.416 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.disable_auto_compactions: 0 2024-02-05T07:11:49.416 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-05T07:11:49.416 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-05T07:11:49.416 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-05T07:11:49.416 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-05T07:11:49.416 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-05T07:11:49.417 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-05T07:11:49.417 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-05T07:11:49.417 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-05T07:11:49.417 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-05T07:11:49.417 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-05T07:11:49.417 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.table_properties_collectors: 2024-02-05T07:11:49.417 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.inplace_update_support: 0 2024-02-05T07:11:49.417 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-05T07:11:49.417 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-05T07:11:49.417 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-05T07:11:49.417 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-05T07:11:49.417 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.bloom_locality: 0 2024-02-05T07:11:49.417 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.max_successive_merges: 0 2024-02-05T07:11:49.418 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-05T07:11:49.418 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.paranoid_file_checks: 0 2024-02-05T07:11:49.418 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.force_consistency_checks: 1 2024-02-05T07:11:49.418 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.report_bg_io_stats: 0 2024-02-05T07:11:49.418 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.ttl: 2592000 2024-02-05T07:11:49.418 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-05T07:11:49.418 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-05T07:11:49.418 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-05T07:11:49.418 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.enable_blob_files: false 2024-02-05T07:11:49.418 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.min_blob_size: 0 2024-02-05T07:11:49.418 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.blob_file_size: 268435456 2024-02-05T07:11:49.418 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-05T07:11:49.419 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-05T07:11:49.419 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-05T07:11:49.419 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-05T07:11:49.419 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-05T07:11:49.419 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.blob_file_starting_level: 0 2024-02-05T07:11:49.419 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-05T07:11:49.419 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-02-05T07:11:49.419 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-02-05T07:11:49.419 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 37ac6158-d56c-4ec9-ace4-9c686b994060 2024-02-05T07:11:49.419 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707117109091473, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-02-05T07:11:49.419 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-02-05T07:11:49.419 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707117109092271, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 81894, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 264, "table_properties": {"data_size": 80093, "index_size": 211, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10703, "raw_average_key_size": 47, "raw_value_size": 74068, "raw_average_value_size": 332, "num_data_blocks": 10, "num_entries": 223, "num_filter_entries": 223, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1707117109, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "37ac6158-d56c-4ec9-ace4-9c686b994060", "db_session_id": "7BSY4YFMRBQFCSDDTAGZ", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-02-05T07:11:49.419 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707117109092350, "job": 1, "event": "recovery_finished"} 2024-02-05T07:11:49.420 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-02-05T07:11:49.420 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-05T07:11:49.420 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55d938944000 2024-02-05T07:11:49.420 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: DB pointer 0x55d93892e000 2024-02-05T07:11:49.420 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-05T07:11:49.420 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-05T07:11:49.420 INFO:journalctl@ceph.mon.a.smithi184.stdout: ** DB Stats ** 2024-02-05T07:11:49.420 INFO:journalctl@ceph.mon.a.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-05T07:11:49.420 INFO:journalctl@ceph.mon.a.smithi184.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-05T07:11:49.420 INFO:journalctl@ceph.mon.a.smithi184.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-05T07:11:49.420 INFO:journalctl@ceph.mon.a.smithi184.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-05T07:11:49.420 INFO:journalctl@ceph.mon.a.smithi184.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-05T07:11:49.420 INFO:journalctl@ceph.mon.a.smithi184.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-05T07:11:49.421 INFO:journalctl@ceph.mon.a.smithi184.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-05T07:11:49.421 INFO:journalctl@ceph.mon.a.smithi184.stdout: 2024-02-05T07:11:49.421 INFO:journalctl@ceph.mon.a.smithi184.stdout: ** Compaction Stats [default] ** 2024-02-05T07:11:49.421 INFO:journalctl@ceph.mon.a.smithi184.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-05T07:11:49.421 INFO:journalctl@ceph.mon.a.smithi184.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-05T07:11:49.421 INFO:journalctl@ceph.mon.a.smithi184.stdout: L0 2/0 81.78 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 152.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-05T07:11:49.421 INFO:journalctl@ceph.mon.a.smithi184.stdout: Sum 2/0 81.78 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 152.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-05T07:11:49.421 INFO:journalctl@ceph.mon.a.smithi184.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 152.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-05T07:11:49.421 INFO:journalctl@ceph.mon.a.smithi184.stdout: 2024-02-05T07:11:49.421 INFO:journalctl@ceph.mon.a.smithi184.stdout: ** Compaction Stats [default] ** 2024-02-05T07:11:49.421 INFO:journalctl@ceph.mon.a.smithi184.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-05T07:11:49.421 INFO:journalctl@ceph.mon.a.smithi184.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-05T07:11:49.422 INFO:journalctl@ceph.mon.a.smithi184.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 152.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-05T07:11:49.422 INFO:journalctl@ceph.mon.a.smithi184.stdout: 2024-02-05T07:11:49.422 INFO:journalctl@ceph.mon.a.smithi184.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-05T07:11:49.422 INFO:journalctl@ceph.mon.a.smithi184.stdout: 2024-02-05T07:11:49.422 INFO:journalctl@ceph.mon.a.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-05T07:11:49.422 INFO:journalctl@ceph.mon.a.smithi184.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-05T07:11:49.422 INFO:journalctl@ceph.mon.a.smithi184.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-05T07:11:49.422 INFO:journalctl@ceph.mon.a.smithi184.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-05T07:11:49.422 INFO:journalctl@ceph.mon.a.smithi184.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-05T07:11:49.422 INFO:journalctl@ceph.mon.a.smithi184.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-05T07:11:49.422 INFO:journalctl@ceph.mon.a.smithi184.stdout: Cumulative compaction: 0.00 GB write, 26.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-05T07:11:49.422 INFO:journalctl@ceph.mon.a.smithi184.stdout: Interval compaction: 0.00 GB write, 26.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-05T07:11:49.422 INFO:journalctl@ceph.mon.a.smithi184.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-05T07:11:49.423 INFO:journalctl@ceph.mon.a.smithi184.stdout: Block cache BinnedLRUCache@0x55d938853090#6 capacity: 512.00 MB usage: 1.17 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-02-05T07:11:49.423 INFO:journalctl@ceph.mon.a.smithi184.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(1,0.00 KB,0%) 2024-02-05T07:11:49.423 INFO:journalctl@ceph.mon.a.smithi184.stdout: 2024-02-05T07:11:49.423 INFO:journalctl@ceph.mon.a.smithi184.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-05T07:11:49.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: starting mon.a rank 0 at public addrs v1:172.21.15.184:6789/0 at bind addrs v1:172.21.15.184:6789/0 mon_data /var/lib/ceph/mon/ceph-a fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:11:49.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: mon.a@-1(???) e1 preinit fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:11:49.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: mon.a@-1(???).mds e1 new map 2024-02-05T07:11:49.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: mon.a@-1(???).mds e1 print_map 2024-02-05T07:11:49.423 INFO:journalctl@ceph.mon.a.smithi184.stdout: e1 2024-02-05T07:11:49.423 INFO:journalctl@ceph.mon.a.smithi184.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-05T07:11:49.423 INFO:journalctl@ceph.mon.a.smithi184.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-05T07:11:49.423 INFO:journalctl@ceph.mon.a.smithi184.stdout: legacy client fscid: -1 2024-02-05T07:11:49.423 INFO:journalctl@ceph.mon.a.smithi184.stdout: 2024-02-05T07:11:49.424 INFO:journalctl@ceph.mon.a.smithi184.stdout: No filesystems configured 2024-02-05T07:11:49.424 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-05T07:11:49.424 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-05T07:11:49.424 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-05T07:11:49.424 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-05T07:11:49.424 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-05T07:11:49.424 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: mon.a is new leader, mons a in quorum (ranks 0) 2024-02-05T07:11:49.424 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: monmap e1: 1 mons at {a=v1:172.21.15.184:6789/0} removed_ranks: {} disallowed_leaders: {} 2024-02-05T07:11:49.424 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: fsmap 2024-02-05T07:11:49.424 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: osdmap e1: 0 total, 0 up, 0 in 2024-02-05T07:11:49.424 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 ceph-mon[29861]: mgrmap e1: no daemons active 2024-02-05T07:11:49.424 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 bash[29824]: d42de0bd7fb18e329b7b9a32f32f92fe37b2f94b8d9db998232d367524467078 2024-02-05T07:11:49.424 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:49 smithi184 systemd[1]: Started Ceph mon.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:11:50.256 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.623+0000 7f4bb265e700 1 Processor -- start 2024-02-05T07:11:50.256 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.623+0000 7f4bb265e700 1 -- start start 2024-02-05T07:11:50.256 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.623+0000 7f4bb265e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4bac07a330 con 0x7f4bac07b730 2024-02-05T07:11:50.256 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.623+0000 7f4babfff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f4bac07b730 0x7f4bac079b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46372/0 (socket says 172.21.15.184:46372) 2024-02-05T07:11:50.256 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.623+0000 7f4babfff700 1 -- 172.21.15.184:0/283341559 learned_addr learned my addr 172.21.15.184:0/283341559 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:11:50.256 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.624+0000 7f4baaffd700 1 -- 172.21.15.184:0/283341559 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3926933261 0 0) 0x7f4bac07a330 con 0x7f4bac07b730 2024-02-05T07:11:50.256 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.624+0000 7f4baaffd700 1 -- 172.21.15.184:0/283341559 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b940035b0 con 0x7f4bac07b730 2024-02-05T07:11:50.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.624+0000 7f4baaffd700 1 -- 172.21.15.184:0/283341559 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1543690577 0 0) 0x7f4b940035b0 con 0x7f4bac07b730 2024-02-05T07:11:50.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.624+0000 7f4baaffd700 1 -- 172.21.15.184:0/283341559 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac07a4c0 con 0x7f4bac07b730 2024-02-05T07:11:50.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.624+0000 7f4baaffd700 1 -- 172.21.15.184:0/283341559 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f4b9c001580 con 0x7f4bac07b730 2024-02-05T07:11:50.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.624+0000 7f4baaffd700 1 -- 172.21.15.184:0/283341559 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f4b9c001ce0 con 0x7f4bac07b730 2024-02-05T07:11:50.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.624+0000 7f4baaffd700 1 -- 172.21.15.184:0/283341559 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f4b9c005960 con 0x7f4bac07b730 2024-02-05T07:11:50.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.625+0000 7f4bb265e700 1 -- 172.21.15.184:0/283341559 >> v1:172.21.15.184:6789/0 conn(0x7f4bac07b730 legacy=0x7f4bac079b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:11:50.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.625+0000 7f4bb265e700 1 -- 172.21.15.184:0/283341559 shutdown_connections 2024-02-05T07:11:50.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.625+0000 7f4bb265e700 1 -- 172.21.15.184:0/283341559 >> 172.21.15.184:0/283341559 conn(0x7f4bac1010e0 msgr2=0x7f4bac103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:11:50.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.625+0000 7f4bb265e700 1 -- 172.21.15.184:0/283341559 shutdown_connections 2024-02-05T07:11:50.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.625+0000 7f4bb265e700 1 -- 172.21.15.184:0/283341559 wait complete. 2024-02-05T07:11:50.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.625+0000 7f4bb265e700 1 Processor -- start 2024-02-05T07:11:50.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.625+0000 7f4bb265e700 1 -- start start 2024-02-05T07:11:50.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.626+0000 7f4bb265e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4bac19be50 con 0x7f4bac07b730 2024-02-05T07:11:50.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.626+0000 7f4babfff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f4bac07b730 0x7f4bac19b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46378/0 (socket says 172.21.15.184:46378) 2024-02-05T07:11:50.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.626+0000 7f4babfff700 1 -- 172.21.15.184:0/1005510626 learned_addr learned my addr 172.21.15.184:0/1005510626 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:11:50.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.626+0000 7f4ba97fa700 1 -- 172.21.15.184:0/1005510626 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321625854 0 0) 0x7f4bac19be50 con 0x7f4bac07b730 2024-02-05T07:11:50.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.626+0000 7f4ba97fa700 1 -- 172.21.15.184:0/1005510626 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b940054f0 con 0x7f4bac07b730 2024-02-05T07:11:50.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.626+0000 7f4ba97fa700 1 -- 172.21.15.184:0/1005510626 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2204250398 0 0) 0x7f4b940054f0 con 0x7f4bac07b730 2024-02-05T07:11:50.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.626+0000 7f4ba97fa700 1 -- 172.21.15.184:0/1005510626 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4bac19be50 con 0x7f4bac07b730 2024-02-05T07:11:50.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.626+0000 7f4ba97fa700 1 -- 172.21.15.184:0/1005510626 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f4b9c001080 con 0x7f4bac07b730 2024-02-05T07:11:50.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.626+0000 7f4ba97fa700 1 -- 172.21.15.184:0/1005510626 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4179561184 0 0) 0x7f4bac19be50 con 0x7f4bac07b730 2024-02-05T07:11:50.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.626+0000 7f4ba97fa700 1 -- 172.21.15.184:0/1005510626 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac19bfe0 con 0x7f4bac07b730 2024-02-05T07:11:50.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.626+0000 7f4bb265e700 1 -- 172.21.15.184:0/1005510626 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac19c290 con 0x7f4bac07b730 2024-02-05T07:11:50.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.626+0000 7f4bb265e700 1 -- 172.21.15.184:0/1005510626 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac19fde0 con 0x7f4bac07b730 2024-02-05T07:11:50.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.626+0000 7f4ba97fa700 1 -- 172.21.15.184:0/1005510626 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f4b9c004a40 con 0x7f4bac07b730 2024-02-05T07:11:50.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.626+0000 7f4ba97fa700 1 -- 172.21.15.184:0/1005510626 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f4b9c006260 con 0x7f4bac07b730 2024-02-05T07:11:50.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.627+0000 7f4ba97fa700 1 -- 172.21.15.184:0/1005510626 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f4b9c0067a0 con 0x7f4bac07b730 2024-02-05T07:11:50.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.627+0000 7f4ba97fa700 1 -- 172.21.15.184:0/1005510626 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 389070130 0 0) 0x7f4b9c007e00 con 0x7f4bac07b730 2024-02-05T07:11:50.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.627+0000 7f4bb265e700 1 -- 172.21.15.184:0/1005510626 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b98005150 con 0x7f4bac07b730 2024-02-05T07:11:50.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.630+0000 7f4ba97fa700 1 -- 172.21.15.184:0/1005510626 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f4b9c005c00 con 0x7f4bac07b730 2024-02-05T07:11:50.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.696+0000 7f4bb265e700 1 -- 172.21.15.184:0/1005510626 --> v1:172.21.15.184:6789/0 -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f4b98005980 con 0x7f4bac07b730 2024-02-05T07:11:50.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.698+0000 7f4ba97fa700 1 -- 172.21.15.184:0/1005510626 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (unknown 534127980 0 0) 0x7f4b9c0080e0 con 0x7f4bac07b730 2024-02-05T07:11:50.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.698+0000 7f4bb265e700 1 -- 172.21.15.184:0/1005510626 >> v1:172.21.15.184:6789/0 conn(0x7f4bac07b730 legacy=0x7f4bac19b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:11:50.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.699+0000 7f4bb265e700 1 -- 172.21.15.184:0/1005510626 shutdown_connections 2024-02-05T07:11:50.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.699+0000 7f4bb265e700 1 -- 172.21.15.184:0/1005510626 >> 172.21.15.184:0/1005510626 conn(0x7f4bac1010e0 msgr2=0x7f4bac109f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:11:50.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.699+0000 7f4bb265e700 1 -- 172.21.15.184:0/1005510626 shutdown_connections 2024-02-05T07:11:50.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:49.699+0000 7f4bb265e700 1 -- 172.21.15.184:0/1005510626 wait complete. 2024-02-05T07:11:50.260 INFO:teuthology.orchestra.run.smithi184.stdout:Wrote config to /etc/ceph/ceph.conf 2024-02-05T07:11:50.273 INFO:teuthology.orchestra.run.smithi184.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-05T07:11:50.273 INFO:teuthology.orchestra.run.smithi184.stdout:Creating mgr... 2024-02-05T07:11:50.274 INFO:teuthology.orchestra.run.smithi184.stdout:Verifying port 0.0.0.0:9283 ... 2024-02-05T07:11:50.274 INFO:teuthology.orchestra.run.smithi184.stdout:Verifying port 0.0.0.0:8765 ... 2024-02-05T07:11:50.503 INFO:teuthology.orchestra.run.smithi184.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mgr.y 2024-02-05T07:11:50.503 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mgr.y.service: Unit ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mgr.y.service not loaded. 2024-02-05T07:11:50.650 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715.target.wants/ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mgr.y.service → /etc/systemd/system/ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@.service. 2024-02-05T07:11:50.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1005510626' entity='client.admin' 2024-02-05T07:11:51.179 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:51 smithi184 podman[30104]: 2024-02-05 07:11:51.082477127 +0000 UTC m=+0.315794532 container start 344e075574d1e70c2ce973f0fe3902971ece7e55d7e0bd62986dea0d11ae0afb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.build-date=20240131, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, ceph=True) 2024-02-05T07:11:51.179 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:51 smithi184 bash[30104]: 344e075574d1e70c2ce973f0fe3902971ece7e55d7e0bd62986dea0d11ae0afb 2024-02-05T07:11:51.192 INFO:teuthology.orchestra.run.smithi184.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-05T07:11:51.192 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stdout disabled 2024-02-05T07:11:51.199 INFO:teuthology.orchestra.run.smithi184.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-05T07:11:51.199 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stdout inactive 2024-02-05T07:11:51.199 INFO:teuthology.orchestra.run.smithi184.stdout:firewalld.service is not enabled 2024-02-05T07:11:51.199 INFO:teuthology.orchestra.run.smithi184.stdout:Not possible to enable service . firewalld.service is not available 2024-02-05T07:11:51.208 INFO:teuthology.orchestra.run.smithi184.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-05T07:11:51.208 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stdout disabled 2024-02-05T07:11:51.216 INFO:teuthology.orchestra.run.smithi184.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-05T07:11:51.216 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stdout inactive 2024-02-05T07:11:51.216 INFO:teuthology.orchestra.run.smithi184.stdout:firewalld.service is not enabled 2024-02-05T07:11:51.216 INFO:teuthology.orchestra.run.smithi184.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-02-05T07:11:51.216 INFO:teuthology.orchestra.run.smithi184.stdout:Waiting for mgr to start... 2024-02-05T07:11:51.217 INFO:teuthology.orchestra.run.smithi184.stdout:Waiting for mgr... 2024-02-05T07:11:51.443 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:51 smithi184 systemd[1]: Started Ceph mgr.y for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:11:51.698 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:51.647+0000 7fe4826fc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-05T07:11:52.001 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1369430897' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-05T07:11:52.001 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:51.744+0000 7fe4826fc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-05T07:11:52.248 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 2024-02-05T07:11:52.248 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout { 2024-02-05T07:11:52.248 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "fsid": "ae38c7f2-c3f5-11ee-95b6-87774f69a715", 2024-02-05T07:11:52.249 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "health": { 2024-02-05T07:11:52.249 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-05T07:11:52.249 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-05T07:11:52.249 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-05T07:11:52.249 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:11:52.249 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-05T07:11:52.249 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-05T07:11:52.249 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 0 2024-02-05T07:11:52.249 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout ], 2024-02-05T07:11:52.249 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-05T07:11:52.249 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "a" 2024-02-05T07:11:52.249 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout ], 2024-02-05T07:11:52.249 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-02-05T07:11:52.250 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-05T07:11:52.250 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-05T07:11:52.250 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-02-05T07:11:52.250 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-05T07:11:52.250 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:11:52.250 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-05T07:11:52.250 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-05T07:11:52.250 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-05T07:11:52.250 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-05T07:11:52.250 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-05T07:11:52.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-05T07:11:52.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-05T07:11:52.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-05T07:11:52.257 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:11:52.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-05T07:11:52.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-05T07:11:52.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-05T07:11:52.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-05T07:11:52.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-05T07:11:52.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-05T07:11:52.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-05T07:11:52.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-05T07:11:52.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-05T07:11:52.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:11:52.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-05T07:11:52.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-05T07:11:52.258 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-05T07:11:52.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-05T07:11:52.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:11:52.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-05T07:11:52.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-05T07:11:52.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-05T07:11:52.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-05T07:11:52.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-05T07:11:52.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-05T07:11:52.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "restful" 2024-02-05T07:11:52.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout ], 2024-02-05T07:11:52.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-05T07:11:52.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:11:52.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-05T07:11:52.259 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-05T07:11:52.260 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "modified": "2024-02-05T07:11:44.147925+0000", 2024-02-05T07:11:52.260 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-05T07:11:52.260 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:11:52.260 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-05T07:11:52.260 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout } 2024-02-05T07:11:52.260 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.656+0000 7f691bb45700 1 Processor -- start 2024-02-05T07:11:52.260 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.656+0000 7f691bb45700 1 -- start start 2024-02-05T07:11:52.260 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.657+0000 7f691bb45700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6914079760 con 0x7f6914106580 2024-02-05T07:11:52.260 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.657+0000 7f69198e1700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f6914106580 0x7f6914108970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46402/0 (socket says 172.21.15.184:46402) 2024-02-05T07:11:52.260 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.657+0000 7f69198e1700 1 -- 172.21.15.184:0/3336129405 learned_addr learned my addr 172.21.15.184:0/3336129405 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:11:52.260 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.657+0000 7f69188df700 1 -- 172.21.15.184:0/3336129405 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756119978 0 0) 0x7f6914079760 con 0x7f6914106580 2024-02-05T07:11:52.260 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.657+0000 7f69188df700 1 -- 172.21.15.184:0/3336129405 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69000035b0 con 0x7f6914106580 2024-02-05T07:11:52.260 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.657+0000 7f69188df700 1 -- 172.21.15.184:0/3336129405 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3366770012 0 0) 0x7f69000035b0 con 0x7f6914106580 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.657+0000 7f69188df700 1 -- 172.21.15.184:0/3336129405 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691410b0a0 con 0x7f6914106580 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.657+0000 7f69188df700 1 -- 172.21.15.184:0/3336129405 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f6904001580 con 0x7f6914106580 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.657+0000 7f69188df700 1 -- 172.21.15.184:0/3336129405 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f6904001ce0 con 0x7f6914106580 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.657+0000 7f69188df700 1 -- 172.21.15.184:0/3336129405 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f6904005960 con 0x7f6914106580 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.658+0000 7f691bb45700 1 -- 172.21.15.184:0/3336129405 >> v1:172.21.15.184:6789/0 conn(0x7f6914106580 legacy=0x7f6914108970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.658+0000 7f691bb45700 1 -- 172.21.15.184:0/3336129405 shutdown_connections 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.658+0000 7f691bb45700 1 -- 172.21.15.184:0/3336129405 >> 172.21.15.184:0/3336129405 conn(0x7f69140fffd0 msgr2=0x7f69141023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.658+0000 7f691bb45700 1 -- 172.21.15.184:0/3336129405 shutdown_connections 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.658+0000 7f691bb45700 1 -- 172.21.15.184:0/3336129405 wait complete. 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.659+0000 7f691bb45700 1 Processor -- start 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.659+0000 7f691bb45700 1 -- start start 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.659+0000 7f691bb45700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f691419f5e0 con 0x7f6914106580 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.659+0000 7f69198e1700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f6914106580 0x7f6914105e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46414/0 (socket says 172.21.15.184:46414) 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.659+0000 7f69198e1700 1 -- 172.21.15.184:0/1369430897 learned_addr learned my addr 172.21.15.184:0/1369430897 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.659+0000 7f690affd700 1 -- 172.21.15.184:0/1369430897 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758785265 0 0) 0x7f691419f5e0 con 0x7f6914106580 2024-02-05T07:11:52.261 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.659+0000 7f690affd700 1 -- 172.21.15.184:0/1369430897 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69000054f0 con 0x7f6914106580 2024-02-05T07:11:52.262 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.659+0000 7f690affd700 1 -- 172.21.15.184:0/1369430897 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1639830949 0 0) 0x7f69000054f0 con 0x7f6914106580 2024-02-05T07:11:52.262 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.659+0000 7f690affd700 1 -- 172.21.15.184:0/1369430897 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f691419f5e0 con 0x7f6914106580 2024-02-05T07:11:52.262 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.659+0000 7f690affd700 1 -- 172.21.15.184:0/1369430897 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f6904001080 con 0x7f6914106580 2024-02-05T07:11:52.262 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.659+0000 7f690affd700 1 -- 172.21.15.184:0/1369430897 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1415936966 0 0) 0x7f691419f5e0 con 0x7f6914106580 2024-02-05T07:11:52.262 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.659+0000 7f690affd700 1 -- 172.21.15.184:0/1369430897 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69141a0780 con 0x7f6914106580 2024-02-05T07:11:52.262 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.660+0000 7f691bb45700 1 -- 172.21.15.184:0/1369430897 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691419f7d0 con 0x7f6914106580 2024-02-05T07:11:52.262 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.660+0000 7f691bb45700 1 -- 172.21.15.184:0/1369430897 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f691419fcd0 con 0x7f6914106580 2024-02-05T07:11:52.262 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.660+0000 7f690affd700 1 -- 172.21.15.184:0/1369430897 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f6904005340 con 0x7f6914106580 2024-02-05T07:11:52.262 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.660+0000 7f690affd700 1 -- 172.21.15.184:0/1369430897 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f6904006080 con 0x7f6914106580 2024-02-05T07:11:52.262 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.660+0000 7f690affd700 1 -- 172.21.15.184:0/1369430897 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f6904006690 con 0x7f6914106580 2024-02-05T07:11:52.262 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.660+0000 7f690affd700 1 -- 172.21.15.184:0/1369430897 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 389070130 0 0) 0x7f6904007db0 con 0x7f6914106580 2024-02-05T07:11:52.262 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.660+0000 7f691bb45700 1 -- 172.21.15.184:0/1369430897 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68f8005120 con 0x7f6914106580 2024-02-05T07:11:52.262 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.663+0000 7f690affd700 1 -- 172.21.15.184:0/1369430897 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f6904005c00 con 0x7f6914106580 2024-02-05T07:11:52.262 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.737+0000 7f691bb45700 1 -- 172.21.15.184:0/1369430897 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f68f80053d0 con 0x7f6914106580 2024-02-05T07:11:52.262 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.738+0000 7f690affd700 1 -- 172.21.15.184:0/1369430897 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (unknown 4201413639 0 2070533425) 0x7f6904005640 con 0x7f6914106580 2024-02-05T07:11:52.263 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.739+0000 7f691bb45700 1 -- 172.21.15.184:0/1369430897 >> v1:172.21.15.184:6789/0 conn(0x7f6914106580 legacy=0x7f6914105e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:11:52.263 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.739+0000 7f691bb45700 1 -- 172.21.15.184:0/1369430897 shutdown_connections 2024-02-05T07:11:52.263 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.739+0000 7f691bb45700 1 -- 172.21.15.184:0/1369430897 >> 172.21.15.184:0/1369430897 conn(0x7f69140fffd0 msgr2=0x7f69141903c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:11:52.263 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.739+0000 7f691bb45700 1 -- 172.21.15.184:0/1369430897 shutdown_connections 2024-02-05T07:11:52.263 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:51.739+0000 7f691bb45700 1 -- 172.21.15.184:0/1369430897 wait complete. 2024-02-05T07:11:52.263 INFO:teuthology.orchestra.run.smithi184.stdout:mgr not available, waiting (1/15)... 2024-02-05T07:11:52.736 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:52 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:52.397+0000 7fe4826fc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-05T07:11:52.736 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:52 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:52.490+0000 7fe4826fc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-05T07:11:52.736 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:52 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:52.639+0000 7fe4826fc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-05T07:11:53.022 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:52 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:52.734+0000 7fe4826fc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-05T07:11:53.022 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:52 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:52.815+0000 7fe4826fc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-05T07:11:53.367 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:53.081+0000 7fe4826fc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-05T07:11:53.367 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:53.187+0000 7fe4826fc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-05T07:11:53.367 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:53.271+0000 7fe4826fc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-05T07:11:53.367 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:53.364+0000 7fe4826fc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-05T07:11:53.771 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:53.542+0000 7fe4826fc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-05T07:11:54.663 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:54 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:54.527+0000 7fe4826fc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-05T07:11:54.663 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:54 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:54.660+0000 7fe4826fc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-05T07:11:55.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:55 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2389052407' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-05T07:11:55.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:55 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:55.006+0000 7fe4826fc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-05T07:11:55.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:55 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:55.096+0000 7fe4826fc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-05T07:11:55.380 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 2024-02-05T07:11:55.381 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout { 2024-02-05T07:11:55.381 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "fsid": "ae38c7f2-c3f5-11ee-95b6-87774f69a715", 2024-02-05T07:11:55.381 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "health": { 2024-02-05T07:11:55.381 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-05T07:11:55.381 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-05T07:11:55.381 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-05T07:11:55.381 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:11:55.381 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-05T07:11:55.381 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-05T07:11:55.381 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 0 2024-02-05T07:11:55.381 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout ], 2024-02-05T07:11:55.381 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-05T07:11:55.381 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "a" 2024-02-05T07:11:55.382 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout ], 2024-02-05T07:11:55.382 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-02-05T07:11:55.382 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-05T07:11:55.382 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-05T07:11:55.382 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-02-05T07:11:55.382 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-05T07:11:55.382 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:11:55.382 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-05T07:11:55.382 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-05T07:11:55.382 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-05T07:11:55.382 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-05T07:11:55.382 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-05T07:11:55.390 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-05T07:11:55.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-05T07:11:55.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-05T07:11:55.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:11:55.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-05T07:11:55.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-05T07:11:55.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-05T07:11:55.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-05T07:11:55.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-05T07:11:55.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-05T07:11:55.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-05T07:11:55.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-05T07:11:55.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-05T07:11:55.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:11:55.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-05T07:11:55.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-05T07:11:55.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-05T07:11:55.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-05T07:11:55.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:11:55.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-05T07:11:55.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-05T07:11:55.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-05T07:11:55.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-05T07:11:55.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-05T07:11:55.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-05T07:11:55.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "restful" 2024-02-05T07:11:55.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout ], 2024-02-05T07:11:55.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-05T07:11:55.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:11:55.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-05T07:11:55.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-05T07:11:55.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "modified": "2024-02-05T07:11:44.147925+0000", 2024-02-05T07:11:55.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-05T07:11:55.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:11:55.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-05T07:11:55.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout } 2024-02-05T07:11:55.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.703+0000 7f969b2d5700 1 Processor -- start 2024-02-05T07:11:55.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.703+0000 7f969b2d5700 1 -- start start 2024-02-05T07:11:55.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.704+0000 7f969b2d5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f969407a370 con 0x7f969407b770 2024-02-05T07:11:55.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.704+0000 7f9699071700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f969407b770 0x7f9694079bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46416/0 (socket says 172.21.15.184:46416) 2024-02-05T07:11:55.394 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.704+0000 7f9699071700 1 -- 172.21.15.184:0/3895356479 learned_addr learned my addr 172.21.15.184:0/3895356479 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:11:55.394 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.704+0000 7f968bfff700 1 -- 172.21.15.184:0/3895356479 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414823551 0 0) 0x7f969407a370 con 0x7f969407b770 2024-02-05T07:11:55.394 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.704+0000 7f968bfff700 1 -- 172.21.15.184:0/3895356479 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96800035b0 con 0x7f969407b770 2024-02-05T07:11:55.394 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.704+0000 7f968bfff700 1 -- 172.21.15.184:0/3895356479 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1100527108 0 0) 0x7f96800035b0 con 0x7f969407b770 2024-02-05T07:11:55.394 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.704+0000 7f968bfff700 1 -- 172.21.15.184:0/3895356479 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969407a500 con 0x7f969407b770 2024-02-05T07:11:55.394 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.704+0000 7f968bfff700 1 -- 172.21.15.184:0/3895356479 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9690001580 con 0x7f969407b770 2024-02-05T07:11:55.394 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.705+0000 7f968bfff700 1 -- 172.21.15.184:0/3895356479 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f9690001ce0 con 0x7f969407b770 2024-02-05T07:11:55.395 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.705+0000 7f968bfff700 1 -- 172.21.15.184:0/3895356479 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9690005960 con 0x7f969407b770 2024-02-05T07:11:55.395 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.705+0000 7f969b2d5700 1 -- 172.21.15.184:0/3895356479 >> v1:172.21.15.184:6789/0 conn(0x7f969407b770 legacy=0x7f9694079bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:11:55.395 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.705+0000 7f969b2d5700 1 -- 172.21.15.184:0/3895356479 shutdown_connections 2024-02-05T07:11:55.395 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.705+0000 7f969b2d5700 1 -- 172.21.15.184:0/3895356479 >> 172.21.15.184:0/3895356479 conn(0x7f9694101070 msgr2=0x7f96941034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:11:55.395 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.705+0000 7f969b2d5700 1 -- 172.21.15.184:0/3895356479 shutdown_connections 2024-02-05T07:11:55.395 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.705+0000 7f969b2d5700 1 -- 172.21.15.184:0/3895356479 wait complete. 2024-02-05T07:11:55.395 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.706+0000 7f969b2d5700 1 Processor -- start 2024-02-05T07:11:55.395 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.706+0000 7f969b2d5700 1 -- start start 2024-02-05T07:11:55.395 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.706+0000 7f969b2d5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f969419bed0 con 0x7f969407b770 2024-02-05T07:11:55.395 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.706+0000 7f9699071700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f969407b770 0x7f969419b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46430/0 (socket says 172.21.15.184:46430) 2024-02-05T07:11:55.395 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.706+0000 7f9699071700 1 -- 172.21.15.184:0/2389052407 learned_addr learned my addr 172.21.15.184:0/2389052407 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:11:55.395 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.706+0000 7f968a7fc700 1 -- 172.21.15.184:0/2389052407 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953025022 0 0) 0x7f969419bed0 con 0x7f969407b770 2024-02-05T07:11:55.395 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.706+0000 7f968a7fc700 1 -- 172.21.15.184:0/2389052407 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96800054f0 con 0x7f969407b770 2024-02-05T07:11:55.395 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.707+0000 7f968a7fc700 1 -- 172.21.15.184:0/2389052407 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2994551305 0 0) 0x7f96800054f0 con 0x7f969407b770 2024-02-05T07:11:55.396 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.707+0000 7f968a7fc700 1 -- 172.21.15.184:0/2389052407 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f969419bed0 con 0x7f969407b770 2024-02-05T07:11:55.396 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.707+0000 7f968a7fc700 1 -- 172.21.15.184:0/2389052407 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9690001080 con 0x7f969407b770 2024-02-05T07:11:55.396 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.707+0000 7f968a7fc700 1 -- 172.21.15.184:0/2389052407 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1906601917 0 0) 0x7f969419bed0 con 0x7f969407b770 2024-02-05T07:11:55.396 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.707+0000 7f968a7fc700 1 -- 172.21.15.184:0/2389052407 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969419c060 con 0x7f969407b770 2024-02-05T07:11:55.396 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.707+0000 7f969b2d5700 1 -- 172.21.15.184:0/2389052407 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969419c310 con 0x7f969407b770 2024-02-05T07:11:55.396 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.707+0000 7f969b2d5700 1 -- 172.21.15.184:0/2389052407 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f969419fe60 con 0x7f969407b770 2024-02-05T07:11:55.396 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.707+0000 7f968a7fc700 1 -- 172.21.15.184:0/2389052407 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f9690005340 con 0x7f969407b770 2024-02-05T07:11:55.396 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.707+0000 7f968a7fc700 1 -- 172.21.15.184:0/2389052407 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f96900060a0 con 0x7f969407b770 2024-02-05T07:11:55.396 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.707+0000 7f968a7fc700 1 -- 172.21.15.184:0/2389052407 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f9690006690 con 0x7f969407b770 2024-02-05T07:11:55.396 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.707+0000 7f968a7fc700 1 -- 172.21.15.184:0/2389052407 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 389070130 0 0) 0x7f9690007d30 con 0x7f969407b770 2024-02-05T07:11:55.397 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.708+0000 7f969b2d5700 1 -- 172.21.15.184:0/2389052407 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9678005150 con 0x7f969407b770 2024-02-05T07:11:55.397 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.710+0000 7f968a7fc700 1 -- 172.21.15.184:0/2389052407 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f9690005640 con 0x7f969407b770 2024-02-05T07:11:55.397 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.782+0000 7f969b2d5700 1 -- 172.21.15.184:0/2389052407 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9678005400 con 0x7f969407b770 2024-02-05T07:11:55.397 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.783+0000 7f968a7fc700 1 -- 172.21.15.184:0/2389052407 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (unknown 4201413639 0 350822287) 0x7f9690005880 con 0x7f969407b770 2024-02-05T07:11:55.397 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.784+0000 7f969b2d5700 1 -- 172.21.15.184:0/2389052407 >> v1:172.21.15.184:6789/0 conn(0x7f969407b770 legacy=0x7f969419b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:11:55.397 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.784+0000 7f969b2d5700 1 -- 172.21.15.184:0/2389052407 shutdown_connections 2024-02-05T07:11:55.398 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.784+0000 7f969b2d5700 1 -- 172.21.15.184:0/2389052407 >> 172.21.15.184:0/2389052407 conn(0x7f9694101070 msgr2=0x7f969410a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:11:55.398 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.784+0000 7f969b2d5700 1 -- 172.21.15.184:0/2389052407 shutdown_connections 2024-02-05T07:11:55.398 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:11:54.784+0000 7f969b2d5700 1 -- 172.21.15.184:0/2389052407 wait complete. 2024-02-05T07:11:55.398 INFO:teuthology.orchestra.run.smithi184.stdout:mgr not available, waiting (2/15)... 2024-02-05T07:11:55.771 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:55 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:55.290+0000 7fe4826fc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-05T07:11:55.772 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:55 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:55.496+0000 7fe4826fc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-05T07:11:56.039 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:55 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:55.775+0000 7fe4826fc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-05T07:11:56.039 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:56 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:56.036+0000 7fe4826fc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-05T07:11:56.522 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:56 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:56.269+0000 7fe4826fc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-05T07:11:57.506 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:57 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:57.069+0000 7fe4826fc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-05T07:11:57.771 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:57 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:57.647+0000 7fe4826fc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-05T07:11:57.772 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:57 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:57.742+0000 7fe4826fc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-05T07:11:58.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:11:57 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:11:57.954+0000 7fe4826fc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-05T07:11:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: Activating manager daemon y 2024-02-05T07:11:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: mgrmap e2: y(active, starting, since 0.00319499s) 2024-02-05T07:11:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: from='mgr.14100 v1:172.21.15.184:0/1992467656' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-05T07:11:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: from='mgr.14100 v1:172.21.15.184:0/1992467656' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-05T07:11:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: from='mgr.14100 v1:172.21.15.184:0/1992467656' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-05T07:11:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: from='mgr.14100 v1:172.21.15.184:0/1992467656' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-05T07:11:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: from='mgr.14100 v1:172.21.15.184:0/1992467656' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-05T07:11:58.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: from='mgr.14100 v1:172.21.15.184:0/1992467656' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-05T07:11:58.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: from='mgr.14100 v1:172.21.15.184:0/1992467656' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:11:58.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: from='mgr.14100 v1:172.21.15.184:0/1992467656' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-05T07:11:58.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: Manager daemon y is now available 2024-02-05T07:11:58.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: from='mgr.14100 v1:172.21.15.184:0/1992467656' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-05T07:11:58.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: from='mgr.14100 v1:172.21.15.184:0/1992467656' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-05T07:11:58.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: from='mgr.14100 v1:172.21.15.184:0/1992467656' entity='mgr.y' 2024-02-05T07:11:58.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: from='mgr.14100 v1:172.21.15.184:0/1992467656' entity='mgr.y' 2024-02-05T07:11:58.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:58 smithi184 ceph-mon[29861]: from='mgr.14100 v1:172.21.15.184:0/1992467656' entity='mgr.y' 2024-02-05T07:12:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:11:59 smithi184 ceph-mon[29861]: mgrmap e3: y(active, since 1.00765s) 2024-02-05T07:12:01.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/304039682' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-05T07:12:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:01 smithi184 ceph-mon[29861]: mgrmap e4: y(active, since 3s) 2024-02-05T07:12:06.997 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 2024-02-05T07:12:06.997 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout { 2024-02-05T07:12:06.997 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "fsid": "ae38c7f2-c3f5-11ee-95b6-87774f69a715", 2024-02-05T07:12:06.998 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "health": { 2024-02-05T07:12:06.998 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-05T07:12:06.998 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-05T07:12:06.998 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-05T07:12:06.998 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:12:06.998 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-05T07:12:06.998 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-05T07:12:06.998 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 0 2024-02-05T07:12:06.998 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout ], 2024-02-05T07:12:06.998 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-05T07:12:06.999 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "a" 2024-02-05T07:12:06.999 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout ], 2024-02-05T07:12:06.999 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-02-05T07:12:06.999 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-05T07:12:06.999 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-05T07:12:06.999 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-02-05T07:12:06.999 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-05T07:12:06.999 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:12:06.999 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-05T07:12:07.000 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-05T07:12:07.000 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-05T07:12:07.000 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-05T07:12:07.000 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-05T07:12:07.000 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-05T07:12:07.000 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-05T07:12:07.000 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-05T07:12:07.000 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:12:07.000 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-05T07:12:07.001 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-05T07:12:07.001 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-05T07:12:07.001 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-05T07:12:07.001 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-05T07:12:07.001 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-05T07:12:07.001 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-05T07:12:07.001 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-05T07:12:07.001 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-05T07:12:07.001 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:12:07.002 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-05T07:12:07.002 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-05T07:12:07.002 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-05T07:12:07.002 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-05T07:12:07.002 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:12:07.002 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-05T07:12:07.002 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-05T07:12:07.003 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-05T07:12:07.003 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-05T07:12:07.003 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-05T07:12:07.003 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-05T07:12:07.003 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "restful" 2024-02-05T07:12:07.003 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout ], 2024-02-05T07:12:07.003 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-05T07:12:07.003 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:12:07.003 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-05T07:12:07.003 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-05T07:12:07.003 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "modified": "2024-02-05T07:11:44.147925+0000", 2024-02-05T07:12:07.004 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-05T07:12:07.004 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout }, 2024-02-05T07:12:07.004 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-05T07:12:07.004 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout } 2024-02-05T07:12:07.004 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.473+0000 7fc19e24a700 1 Processor -- start 2024-02-05T07:12:07.004 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.473+0000 7fc19e24a700 1 -- start start 2024-02-05T07:12:07.004 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.473+0000 7fc19e24a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc198108e80 con 0x7fc198105f90 2024-02-05T07:12:07.004 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.474+0000 7fc1977fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc198105f90 0x7fc1981063b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:50782/0 (socket says 172.21.15.184:50782) 2024-02-05T07:12:07.004 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.474+0000 7fc1977fe700 1 -- 172.21.15.184:0/2780495560 learned_addr learned my addr 172.21.15.184:0/2780495560 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:07.004 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.474+0000 7fc196ffd700 1 -- 172.21.15.184:0/2780495560 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4189438299 0 0) 0x7fc198108e80 con 0x7fc198105f90 2024-02-05T07:12:07.004 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.474+0000 7fc196ffd700 1 -- 172.21.15.184:0/2780495560 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1840035b0 con 0x7fc198105f90 2024-02-05T07:12:07.004 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.474+0000 7fc196ffd700 1 -- 172.21.15.184:0/2780495560 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1361115932 0 0) 0x7fc1840035b0 con 0x7fc198105f90 2024-02-05T07:12:07.004 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.474+0000 7fc196ffd700 1 -- 172.21.15.184:0/2780495560 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19810a020 con 0x7fc198105f90 2024-02-05T07:12:07.005 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.474+0000 7fc196ffd700 1 -- 172.21.15.184:0/2780495560 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fc188001580 con 0x7fc198105f90 2024-02-05T07:12:07.005 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.474+0000 7fc196ffd700 1 -- 172.21.15.184:0/2780495560 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7fc188001ce0 con 0x7fc198105f90 2024-02-05T07:12:07.005 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.474+0000 7fc196ffd700 1 -- 172.21.15.184:0/2780495560 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fc188005960 con 0x7fc198105f90 2024-02-05T07:12:07.005 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.475+0000 7fc19e24a700 1 -- 172.21.15.184:0/2780495560 >> v1:172.21.15.184:6789/0 conn(0x7fc198105f90 legacy=0x7fc1981063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:07.005 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.475+0000 7fc19e24a700 1 -- 172.21.15.184:0/2780495560 shutdown_connections 2024-02-05T07:12:07.005 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.475+0000 7fc19e24a700 1 -- 172.21.15.184:0/2780495560 >> 172.21.15.184:0/2780495560 conn(0x7fc1980ff6f0 msgr2=0x7fc198101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:07.005 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.475+0000 7fc19e24a700 1 -- 172.21.15.184:0/2780495560 shutdown_connections 2024-02-05T07:12:07.005 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.475+0000 7fc19e24a700 1 -- 172.21.15.184:0/2780495560 wait complete. 2024-02-05T07:12:07.005 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.475+0000 7fc19e24a700 1 Processor -- start 2024-02-05T07:12:07.005 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.475+0000 7fc19e24a700 1 -- start start 2024-02-05T07:12:07.005 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.476+0000 7fc19e24a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc198197a80 con 0x7fc198105f90 2024-02-05T07:12:07.005 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.476+0000 7fc1977fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fc198105f90 0x7fc198197370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:50784/0 (socket says 172.21.15.184:50784) 2024-02-05T07:12:07.005 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.476+0000 7fc1977fe700 1 -- 172.21.15.184:0/304039682 learned_addr learned my addr 172.21.15.184:0/304039682 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:07.005 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.476+0000 7fc1957fa700 1 -- 172.21.15.184:0/304039682 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296866967 0 0) 0x7fc198197a80 con 0x7fc198105f90 2024-02-05T07:12:07.006 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.476+0000 7fc1957fa700 1 -- 172.21.15.184:0/304039682 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1840054f0 con 0x7fc198105f90 2024-02-05T07:12:07.006 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.476+0000 7fc1957fa700 1 -- 172.21.15.184:0/304039682 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2166076278 0 0) 0x7fc1840054f0 con 0x7fc198105f90 2024-02-05T07:12:07.006 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.476+0000 7fc1957fa700 1 -- 172.21.15.184:0/304039682 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc198197a80 con 0x7fc198105f90 2024-02-05T07:12:07.006 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.476+0000 7fc1957fa700 1 -- 172.21.15.184:0/304039682 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fc188001080 con 0x7fc198105f90 2024-02-05T07:12:07.006 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.476+0000 7fc1957fa700 1 -- 172.21.15.184:0/304039682 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 248148290 0 0) 0x7fc198197a80 con 0x7fc198105f90 2024-02-05T07:12:07.006 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.476+0000 7fc1957fa700 1 -- 172.21.15.184:0/304039682 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc198197c10 con 0x7fc198105f90 2024-02-05T07:12:07.006 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.476+0000 7fc19e24a700 1 -- 172.21.15.184:0/304039682 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc198197ec0 con 0x7fc198105f90 2024-02-05T07:12:07.006 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.476+0000 7fc19e24a700 1 -- 172.21.15.184:0/304039682 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19819ba10 con 0x7fc198105f90 2024-02-05T07:12:07.006 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.477+0000 7fc1957fa700 1 -- 172.21.15.184:0/304039682 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7fc188005340 con 0x7fc198105f90 2024-02-05T07:12:07.006 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.477+0000 7fc1957fa700 1 -- 172.21.15.184:0/304039682 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fc188006070 con 0x7fc198105f90 2024-02-05T07:12:07.006 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.477+0000 7fc1957fa700 1 -- 172.21.15.184:0/304039682 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 3) v1 ==== 45780+0+0 (unknown 2845256794 0 0) 0x7fc188011570 con 0x7fc198105f90 2024-02-05T07:12:07.006 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.477+0000 7fc19e24a700 1 -- 172.21.15.184:0/304039682 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc178005150 con 0x7fc198105f90 2024-02-05T07:12:07.006 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.477+0000 7fc1957fa700 1 -- 172.21.15.184:0/304039682 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 389070130 0 0) 0x7fc188046ed0 con 0x7fc198105f90 2024-02-05T07:12:07.007 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.482+0000 7fc1957fa700 1 -- 172.21.15.184:0/304039682 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fc188012d90 con 0x7fc198105f90 2024-02-05T07:12:07.007 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.759+0000 7fc19e24a700 1 -- 172.21.15.184:0/304039682 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fc178005400 con 0x7fc198105f90 2024-02-05T07:12:07.007 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.759+0000 7fc1957fa700 1 -- 172.21.15.184:0/304039682 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (unknown 4201413639 0 3261217624) 0x7fc188014e50 con 0x7fc198105f90 2024-02-05T07:12:07.007 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.761+0000 7fc19e24a700 1 -- 172.21.15.184:0/304039682 >> v1:172.21.15.184:6800/668972809 conn(0x7fc18403e360 legacy=0x7fc184040820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:07.007 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.761+0000 7fc19e24a700 1 -- 172.21.15.184:0/304039682 >> v1:172.21.15.184:6789/0 conn(0x7fc198105f90 legacy=0x7fc198197370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:07.007 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.761+0000 7fc19e24a700 1 -- 172.21.15.184:0/304039682 shutdown_connections 2024-02-05T07:12:07.007 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.761+0000 7fc19e24a700 1 -- 172.21.15.184:0/304039682 >> 172.21.15.184:0/304039682 conn(0x7fc1980ff6f0 msgr2=0x7fc198101ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:07.007 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.761+0000 7fc19e24a700 1 -- 172.21.15.184:0/304039682 shutdown_connections 2024-02-05T07:12:07.007 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:00.761+0000 7fc19e24a700 1 -- 172.21.15.184:0/304039682 wait complete. 2024-02-05T07:12:07.007 INFO:teuthology.orchestra.run.smithi184.stdout:mgr is available 2024-02-05T07:12:08.393 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/419898113' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-05T07:12:08.627 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 2024-02-05T07:12:08.627 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout [global] 2024-02-05T07:12:08.627 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout fsid = ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:12:08.627 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-05T07:12:08.627 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-05T07:12:08.628 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-05T07:12:08.628 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-05T07:12:08.628 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 2024-02-05T07:12:08.628 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-05T07:12:08.628 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-05T07:12:08.628 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 2024-02-05T07:12:08.628 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout [osd] 2024-02-05T07:12:08.628 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-05T07:12:08.628 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-05T07:12:08.628 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.883+0000 7f2445774700 1 Processor -- start 2024-02-05T07:12:08.628 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.883+0000 7f2445774700 1 -- start start 2024-02-05T07:12:08.628 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.883+0000 7f2445774700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2440106b50 con 0x7f2440105fb0 2024-02-05T07:12:08.629 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.883+0000 7f243effd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2440105fb0 0x7f24401063b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:53574/0 (socket says 172.21.15.184:53574) 2024-02-05T07:12:08.629 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.883+0000 7f243effd700 1 -- 172.21.15.184:0/3445980814 learned_addr learned my addr 172.21.15.184:0/3445980814 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:08.629 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.883+0000 7f243dffb700 1 -- 172.21.15.184:0/3445980814 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3710785434 0 0) 0x7f2440106b50 con 0x7f2440105fb0 2024-02-05T07:12:08.629 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.883+0000 7f243dffb700 1 -- 172.21.15.184:0/3445980814 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24280035b0 con 0x7f2440105fb0 2024-02-05T07:12:08.629 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.883+0000 7f243dffb700 1 -- 172.21.15.184:0/3445980814 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2353589832 0 0) 0x7f24280035b0 con 0x7f2440105fb0 2024-02-05T07:12:08.629 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.883+0000 7f243dffb700 1 -- 172.21.15.184:0/3445980814 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2440104ba0 con 0x7f2440105fb0 2024-02-05T07:12:08.629 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.883+0000 7f243dffb700 1 -- 172.21.15.184:0/3445980814 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f2430001580 con 0x7f2440105fb0 2024-02-05T07:12:08.629 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.884+0000 7f243dffb700 1 -- 172.21.15.184:0/3445980814 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f2430001ce0 con 0x7f2440105fb0 2024-02-05T07:12:08.630 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.884+0000 7f243dffb700 1 -- 172.21.15.184:0/3445980814 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f2430005960 con 0x7f2440105fb0 2024-02-05T07:12:08.630 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.884+0000 7f2445774700 1 -- 172.21.15.184:0/3445980814 >> v1:172.21.15.184:6789/0 conn(0x7f2440105fb0 legacy=0x7f24401063b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:08.630 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.884+0000 7f2445774700 1 -- 172.21.15.184:0/3445980814 shutdown_connections 2024-02-05T07:12:08.630 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.884+0000 7f2445774700 1 -- 172.21.15.184:0/3445980814 >> 172.21.15.184:0/3445980814 conn(0x7f24400ff740 msgr2=0x7f2440101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:08.630 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.884+0000 7f2445774700 1 -- 172.21.15.184:0/3445980814 shutdown_connections 2024-02-05T07:12:08.631 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.884+0000 7f2445774700 1 -- 172.21.15.184:0/3445980814 wait complete. 2024-02-05T07:12:08.631 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.885+0000 7f2445774700 1 Processor -- start 2024-02-05T07:12:08.631 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.885+0000 7f2445774700 1 -- start start 2024-02-05T07:12:08.631 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.886+0000 7f2445774700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f244019bec0 con 0x7f2440105fb0 2024-02-05T07:12:08.631 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.886+0000 7f243effd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2440105fb0 0x7f244019b7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:53584/0 (socket says 172.21.15.184:53584) 2024-02-05T07:12:08.631 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.886+0000 7f243effd700 1 -- 172.21.15.184:0/419898113 learned_addr learned my addr 172.21.15.184:0/419898113 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:08.631 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.886+0000 7f2427fff700 1 -- 172.21.15.184:0/419898113 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879889474 0 0) 0x7f244019bec0 con 0x7f2440105fb0 2024-02-05T07:12:08.632 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.886+0000 7f2427fff700 1 -- 172.21.15.184:0/419898113 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24280054f0 con 0x7f2440105fb0 2024-02-05T07:12:08.632 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.886+0000 7f2427fff700 1 -- 172.21.15.184:0/419898113 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2899127867 0 0) 0x7f24280054f0 con 0x7f2440105fb0 2024-02-05T07:12:08.632 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.886+0000 7f2427fff700 1 -- 172.21.15.184:0/419898113 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f244019bec0 con 0x7f2440105fb0 2024-02-05T07:12:08.632 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.886+0000 7f2427fff700 1 -- 172.21.15.184:0/419898113 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f2430001080 con 0x7f2440105fb0 2024-02-05T07:12:08.632 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.886+0000 7f2427fff700 1 -- 172.21.15.184:0/419898113 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 466179999 0 0) 0x7f244019bec0 con 0x7f2440105fb0 2024-02-05T07:12:08.632 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.886+0000 7f2427fff700 1 -- 172.21.15.184:0/419898113 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f244019c050 con 0x7f2440105fb0 2024-02-05T07:12:08.632 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.886+0000 7f2445774700 1 -- 172.21.15.184:0/419898113 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f244019c300 con 0x7f2440105fb0 2024-02-05T07:12:08.632 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.887+0000 7f2445774700 1 -- 172.21.15.184:0/419898113 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f244019fe00 con 0x7f2440105fb0 2024-02-05T07:12:08.632 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.887+0000 7f2427fff700 1 -- 172.21.15.184:0/419898113 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f2430004a40 con 0x7f2440105fb0 2024-02-05T07:12:08.633 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.887+0000 7f2427fff700 1 -- 172.21.15.184:0/419898113 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f2430006110 con 0x7f2440105fb0 2024-02-05T07:12:08.633 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.887+0000 7f2427fff700 1 -- 172.21.15.184:0/419898113 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 4) v1 ==== 45886+0+0 (unknown 24359498 0 0) 0x7f24300115c0 con 0x7f2440105fb0 2024-02-05T07:12:08.633 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.887+0000 7f2445774700 1 -- 172.21.15.184:0/419898113 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242c005150 con 0x7f2440105fb0 2024-02-05T07:12:08.633 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.888+0000 7f2427fff700 1 -- 172.21.15.184:0/419898113 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 389070130 0 0) 0x7f2430004f50 con 0x7f2440105fb0 2024-02-05T07:12:08.633 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:07.892+0000 7f2427fff700 1 -- 172.21.15.184:0/419898113 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f2430012d90 con 0x7f2440105fb0 2024-02-05T07:12:08.633 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:08.097+0000 7f2445774700 1 -- 172.21.15.184:0/419898113 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f242c005980 con 0x7f2440105fb0 2024-02-05T07:12:08.633 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:08.098+0000 7f2427fff700 1 -- 172.21.15.184:0/419898113 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+282 (unknown 1187553405 0 2881246989) 0x7f2430014e70 con 0x7f2440105fb0 2024-02-05T07:12:08.633 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:08.101+0000 7f2445774700 1 -- 172.21.15.184:0/419898113 >> v1:172.21.15.184:6800/668972809 conn(0x7f242803a0d0 legacy=0x7f242803c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:08.633 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:08.101+0000 7f2445774700 1 -- 172.21.15.184:0/419898113 >> v1:172.21.15.184:6789/0 conn(0x7f2440105fb0 legacy=0x7f244019b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:08.633 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:08.101+0000 7f2445774700 1 -- 172.21.15.184:0/419898113 shutdown_connections 2024-02-05T07:12:08.633 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:08.101+0000 7f2445774700 1 -- 172.21.15.184:0/419898113 >> 172.21.15.184:0/419898113 conn(0x7f24400ff740 msgr2=0x7f2440192530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:08.634 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:08.102+0000 7f2445774700 1 -- 172.21.15.184:0/419898113 shutdown_connections 2024-02-05T07:12:08.634 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:08.102+0000 7f2445774700 1 -- 172.21.15.184:0/419898113 wait complete. 2024-02-05T07:12:08.634 INFO:teuthology.orchestra.run.smithi184.stdout:Enabling cephadm module... 2024-02-05T07:12:10.425 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1848619964' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-05T07:12:10.425 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:10 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ignoring --setuser ceph since I am not root 2024-02-05T07:12:10.425 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:10 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ignoring --setgroup ceph since I am not root 2024-02-05T07:12:10.665 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.064+0000 7f8de0b6d700 1 Processor -- start 2024-02-05T07:12:10.665 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.064+0000 7f8de0b6d700 1 -- start start 2024-02-05T07:12:10.665 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.065+0000 7f8de0b6d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8ddc108de0 con 0x7f8ddc1049b0 2024-02-05T07:12:10.666 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.065+0000 7f8dda59c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f8ddc1049b0 0x7f8ddc104dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:53590/0 (socket says 172.21.15.184:53590) 2024-02-05T07:12:10.666 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.065+0000 7f8dda59c700 1 -- 172.21.15.184:0/3043801512 learned_addr learned my addr 172.21.15.184:0/3043801512 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:10.666 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.065+0000 7f8dd959a700 1 -- 172.21.15.184:0/3043801512 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826367507 0 0) 0x7f8ddc108de0 con 0x7f8ddc1049b0 2024-02-05T07:12:10.666 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.065+0000 7f8dd959a700 1 -- 172.21.15.184:0/3043801512 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dc40057c0 con 0x7f8ddc1049b0 2024-02-05T07:12:10.666 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.065+0000 7f8dd959a700 1 -- 172.21.15.184:0/3043801512 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 199486439 0 0) 0x7f8dc40057c0 con 0x7f8ddc1049b0 2024-02-05T07:12:10.666 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.065+0000 7f8dd959a700 1 -- 172.21.15.184:0/3043801512 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc109f80 con 0x7f8ddc1049b0 2024-02-05T07:12:10.666 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.065+0000 7f8dd959a700 1 -- 172.21.15.184:0/3043801512 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f8dcc001580 con 0x7f8ddc1049b0 2024-02-05T07:12:10.666 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.065+0000 7f8dd959a700 1 -- 172.21.15.184:0/3043801512 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f8dcc001ce0 con 0x7f8ddc1049b0 2024-02-05T07:12:10.666 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.065+0000 7f8dd959a700 1 -- 172.21.15.184:0/3043801512 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f8dcc005960 con 0x7f8ddc1049b0 2024-02-05T07:12:10.666 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.066+0000 7f8de0b6d700 1 -- 172.21.15.184:0/3043801512 >> v1:172.21.15.184:6789/0 conn(0x7f8ddc1049b0 legacy=0x7f8ddc104dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:10.666 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.066+0000 7f8de0b6d700 1 -- 172.21.15.184:0/3043801512 shutdown_connections 2024-02-05T07:12:10.666 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.066+0000 7f8de0b6d700 1 -- 172.21.15.184:0/3043801512 >> 172.21.15.184:0/3043801512 conn(0x7f8ddc0fff70 msgr2=0x7f8ddc102390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:10.666 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.066+0000 7f8de0b6d700 1 -- 172.21.15.184:0/3043801512 shutdown_connections 2024-02-05T07:12:10.666 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.066+0000 7f8de0b6d700 1 -- 172.21.15.184:0/3043801512 wait complete. 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.067+0000 7f8de0b6d700 1 Processor -- start 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.067+0000 7f8de0b6d700 1 -- start start 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.067+0000 7f8de0b6d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8ddc197a60 con 0x7f8ddc1049b0 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.067+0000 7f8dda59c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f8ddc1049b0 0x7f8ddc197350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:53596/0 (socket says 172.21.15.184:53596) 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.067+0000 7f8dda59c700 1 -- 172.21.15.184:0/1848619964 learned_addr learned my addr 172.21.15.184:0/1848619964 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.067+0000 7f8dcb7fe700 1 -- 172.21.15.184:0/1848619964 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812243236 0 0) 0x7f8ddc197a60 con 0x7f8ddc1049b0 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.067+0000 7f8dcb7fe700 1 -- 172.21.15.184:0/1848619964 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dc4007700 con 0x7f8ddc1049b0 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.067+0000 7f8dcb7fe700 1 -- 172.21.15.184:0/1848619964 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1524764973 0 0) 0x7f8dc4007700 con 0x7f8ddc1049b0 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.067+0000 7f8dcb7fe700 1 -- 172.21.15.184:0/1848619964 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8ddc197a60 con 0x7f8ddc1049b0 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.067+0000 7f8dcb7fe700 1 -- 172.21.15.184:0/1848619964 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f8dcc005940 con 0x7f8ddc1049b0 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.067+0000 7f8dcb7fe700 1 -- 172.21.15.184:0/1848619964 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 451340188 0 0) 0x7f8ddc197a60 con 0x7f8ddc1049b0 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.067+0000 7f8dcb7fe700 1 -- 172.21.15.184:0/1848619964 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc197bf0 con 0x7f8ddc1049b0 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.067+0000 7f8de0b6d700 1 -- 172.21.15.184:0/1848619964 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ddc197ea0 con 0x7f8ddc1049b0 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.068+0000 7f8de0b6d700 1 -- 172.21.15.184:0/1848619964 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ddc19b9a0 con 0x7f8ddc1049b0 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.068+0000 7f8dcb7fe700 1 -- 172.21.15.184:0/1848619964 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f8dcc0052d0 con 0x7f8ddc1049b0 2024-02-05T07:12:10.667 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.068+0000 7f8dcb7fe700 1 -- 172.21.15.184:0/1848619964 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f8dcc0060a0 con 0x7f8ddc1049b0 2024-02-05T07:12:10.668 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.068+0000 7f8dcb7fe700 1 -- 172.21.15.184:0/1848619964 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 4) v1 ==== 45886+0+0 (unknown 24359498 0 0) 0x7f8dcc011610 con 0x7f8ddc1049b0 2024-02-05T07:12:10.668 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.068+0000 7f8de0b6d700 1 -- 172.21.15.184:0/1848619964 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dbc005150 con 0x7f8ddc1049b0 2024-02-05T07:12:10.668 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.069+0000 7f8dcb7fe700 1 -- 172.21.15.184:0/1848619964 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 389070130 0 0) 0x7f8dcc047240 con 0x7f8ddc1049b0 2024-02-05T07:12:10.668 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.073+0000 7f8dcb7fe700 1 -- 172.21.15.184:0/1848619964 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f8dcc012e30 con 0x7f8ddc1049b0 2024-02-05T07:12:10.668 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:09.318+0000 7f8de0b6d700 1 -- 172.21.15.184:0/1848619964 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f8dbc005400 con 0x7f8ddc1049b0 2024-02-05T07:12:10.668 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:10.103+0000 7f8dcb7fe700 1 -- 172.21.15.184:0/1848619964 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (unknown 2263024820 0 0) 0x7f8dcc014f10 con 0x7f8ddc1049b0 2024-02-05T07:12:10.668 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:10.104+0000 7f8dcb7fe700 1 -- 172.21.15.184:0/1848619964 <== mon.0 v1:172.21.15.184:6789/0 11 ==== mgrmap(e 5) v1 ==== 45897+0+0 (unknown 485493536 0 0) 0x7f8dcc045c90 con 0x7f8ddc1049b0 2024-02-05T07:12:10.668 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:10.106+0000 7f8de0b6d700 1 -- 172.21.15.184:0/1848619964 >> v1:172.21.15.184:6800/668972809 conn(0x7f8dc403c2e0 legacy=0x7f8dc403e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:10.668 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:10.106+0000 7f8de0b6d700 1 -- 172.21.15.184:0/1848619964 >> v1:172.21.15.184:6789/0 conn(0x7f8ddc1049b0 legacy=0x7f8ddc197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:10.668 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:10.107+0000 7f8de0b6d700 1 -- 172.21.15.184:0/1848619964 shutdown_connections 2024-02-05T07:12:10.668 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:10.107+0000 7f8de0b6d700 1 -- 172.21.15.184:0/1848619964 >> 172.21.15.184:0/1848619964 conn(0x7f8ddc0fff70 msgr2=0x7f8ddc102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:10.668 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:10.107+0000 7f8de0b6d700 1 -- 172.21.15.184:0/1848619964 shutdown_connections 2024-02-05T07:12:10.669 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:10.107+0000 7f8de0b6d700 1 -- 172.21.15.184:0/1848619964 wait complete. 2024-02-05T07:12:10.771 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:10 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:10.672+0000 7fd63ec82200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-05T07:12:11.026 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:10 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:10.772+0000 7fd63ec82200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-05T07:12:11.328 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1848619964' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-05T07:12:11.328 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:11 smithi184 ceph-mon[29861]: mgrmap e5: y(active, since 12s) 2024-02-05T07:12:11.690 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:11.452+0000 7fd63ec82200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-05T07:12:11.690 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:11.544+0000 7fd63ec82200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-05T07:12:11.690 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:11.688+0000 7fd63ec82200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-05T07:12:11.965 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:11.784+0000 7fd63ec82200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-05T07:12:11.965 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:11.867+0000 7fd63ec82200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-05T07:12:11.976 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout { 2024-02-05T07:12:11.976 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-02-05T07:12:11.977 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-05T07:12:11.977 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-02-05T07:12:11.977 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-05T07:12:11.977 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout } 2024-02-05T07:12:11.977 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.120+0000 7f7641fb0700 1 Processor -- start 2024-02-05T07:12:11.977 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.120+0000 7f7641fb0700 1 -- start start 2024-02-05T07:12:11.977 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.120+0000 7f7641fb0700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f763c078e50 con 0x7f763c104390 2024-02-05T07:12:11.977 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.120+0000 7f763b7fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f763c104390 0x7f763c1047b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:53630/0 (socket says 172.21.15.184:53630) 2024-02-05T07:12:11.978 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.120+0000 7f763b7fe700 1 -- 172.21.15.184:0/2241998130 learned_addr learned my addr 172.21.15.184:0/2241998130 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:11.978 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.120+0000 7f763a7fc700 1 -- 172.21.15.184:0/2241998130 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769267306 0 0) 0x7f763c078e50 con 0x7f763c104390 2024-02-05T07:12:11.978 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.120+0000 7f763a7fc700 1 -- 172.21.15.184:0/2241998130 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76240035b0 con 0x7f763c104390 2024-02-05T07:12:11.978 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.121+0000 7f763a7fc700 1 -- 172.21.15.184:0/2241998130 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3291689392 0 0) 0x7f76240035b0 con 0x7f763c104390 2024-02-05T07:12:11.978 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.121+0000 7f763a7fc700 1 -- 172.21.15.184:0/2241998130 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c105ed0 con 0x7f763c104390 2024-02-05T07:12:11.978 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.121+0000 7f763a7fc700 1 -- 172.21.15.184:0/2241998130 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f762c001580 con 0x7f763c104390 2024-02-05T07:12:11.978 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.121+0000 7f763a7fc700 1 -- 172.21.15.184:0/2241998130 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f762c001c10 con 0x7f763c104390 2024-02-05T07:12:11.978 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.121+0000 7f763a7fc700 1 -- 172.21.15.184:0/2241998130 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f762c0057b0 con 0x7f763c104390 2024-02-05T07:12:11.978 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.121+0000 7f7641fb0700 1 -- 172.21.15.184:0/2241998130 >> v1:172.21.15.184:6789/0 conn(0x7f763c104390 legacy=0x7f763c1047b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:11.978 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.122+0000 7f7641fb0700 1 -- 172.21.15.184:0/2241998130 shutdown_connections 2024-02-05T07:12:11.978 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.122+0000 7f7641fb0700 1 -- 172.21.15.184:0/2241998130 >> 172.21.15.184:0/2241998130 conn(0x7f763c0fff70 msgr2=0x7f763c102390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:11.978 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.122+0000 7f7641fb0700 1 -- 172.21.15.184:0/2241998130 shutdown_connections 2024-02-05T07:12:11.978 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.122+0000 7f7641fb0700 1 -- 172.21.15.184:0/2241998130 wait complete. 2024-02-05T07:12:11.979 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.122+0000 7f7641fb0700 1 Processor -- start 2024-02-05T07:12:11.979 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.122+0000 7f7641fb0700 1 -- start start 2024-02-05T07:12:11.979 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.123+0000 7f7641fb0700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f763c19be40 con 0x7f763c104390 2024-02-05T07:12:11.979 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.123+0000 7f763b7fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f763c104390 0x7f763c19b730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:53632/0 (socket says 172.21.15.184:53632) 2024-02-05T07:12:11.979 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.123+0000 7f763b7fe700 1 -- 172.21.15.184:0/1719785406 learned_addr learned my addr 172.21.15.184:0/1719785406 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:11.979 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.123+0000 7f7638ff9700 1 -- 172.21.15.184:0/1719785406 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174174586 0 0) 0x7f763c19be40 con 0x7f763c104390 2024-02-05T07:12:11.979 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.123+0000 7f7638ff9700 1 -- 172.21.15.184:0/1719785406 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7624005540 con 0x7f763c104390 2024-02-05T07:12:11.979 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.123+0000 7f7638ff9700 1 -- 172.21.15.184:0/1719785406 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 462273292 0 0) 0x7f7624005540 con 0x7f763c104390 2024-02-05T07:12:11.979 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.123+0000 7f7638ff9700 1 -- 172.21.15.184:0/1719785406 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f763c19be40 con 0x7f763c104390 2024-02-05T07:12:11.979 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.123+0000 7f7638ff9700 1 -- 172.21.15.184:0/1719785406 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f762c001080 con 0x7f763c104390 2024-02-05T07:12:11.979 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.123+0000 7f7638ff9700 1 -- 172.21.15.184:0/1719785406 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3305259363 0 0) 0x7f763c19be40 con 0x7f763c104390 2024-02-05T07:12:11.979 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.123+0000 7f7638ff9700 1 -- 172.21.15.184:0/1719785406 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c19bfd0 con 0x7f763c104390 2024-02-05T07:12:11.980 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.123+0000 7f7641fb0700 1 -- 172.21.15.184:0/1719785406 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763c19c280 con 0x7f763c104390 2024-02-05T07:12:11.980 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.124+0000 7f7641fb0700 1 -- 172.21.15.184:0/1719785406 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f763c19fdd0 con 0x7f763c104390 2024-02-05T07:12:11.980 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.124+0000 7f7638ff9700 1 -- 172.21.15.184:0/1719785406 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f762c004990 con 0x7f763c104390 2024-02-05T07:12:11.980 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.124+0000 7f7638ff9700 1 -- 172.21.15.184:0/1719785406 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f762c006110 con 0x7f763c104390 2024-02-05T07:12:11.980 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.124+0000 7f7638ff9700 1 -- 172.21.15.184:0/1719785406 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 5) v1 ==== 45897+0+0 (unknown 485493536 0 0) 0x7f762c011690 con 0x7f763c104390 2024-02-05T07:12:11.980 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.125+0000 7f7641fb0700 1 -- 172.21.15.184:0/1719785406 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7628005150 con 0x7f763c104390 2024-02-05T07:12:11.980 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.125+0000 7f763affd700 1 -- 172.21.15.184:0/1719785406 >> v1:172.21.15.184:6800/668972809 conn(0x7f762403a120 legacy=0x7f762403c5e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/668972809 2024-02-05T07:12:11.980 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.125+0000 7f7638ff9700 1 -- 172.21.15.184:0/1719785406 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 389070130 0 0) 0x7f762c048170 con 0x7f763c104390 2024-02-05T07:12:11.980 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.129+0000 7f7638ff9700 1 -- 172.21.15.184:0/1719785406 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f762c012f00 con 0x7f763c104390 2024-02-05T07:12:11.980 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.326+0000 7f763affd700 1 -- 172.21.15.184:0/1719785406 >> v1:172.21.15.184:6800/668972809 conn(0x7f762403a120 legacy=0x7f762403c5e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/668972809 2024-02-05T07:12:11.980 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.384+0000 7f7641fb0700 1 -- 172.21.15.184:0/1719785406 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f7628005c10 con 0x7f763c104390 2024-02-05T07:12:11.980 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.384+0000 7f7638ff9700 1 -- 172.21.15.184:0/1719785406 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (unknown 3768197548 0 15966916) 0x7f762c0477c0 con 0x7f763c104390 2024-02-05T07:12:11.981 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.386+0000 7f7641fb0700 1 -- 172.21.15.184:0/1719785406 >> v1:172.21.15.184:6800/668972809 conn(0x7f762403a120 legacy=0x7f762403c5e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-05T07:12:11.981 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.386+0000 7f7641fb0700 1 -- 172.21.15.184:0/1719785406 >> v1:172.21.15.184:6789/0 conn(0x7f763c104390 legacy=0x7f763c19b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:11.981 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.387+0000 7f7641fb0700 1 -- 172.21.15.184:0/1719785406 shutdown_connections 2024-02-05T07:12:11.981 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.387+0000 7f7641fb0700 1 -- 172.21.15.184:0/1719785406 >> 172.21.15.184:0/1719785406 conn(0x7f763c0fff70 msgr2=0x7f763c1924d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:11.981 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.387+0000 7f7641fb0700 1 -- 172.21.15.184:0/1719785406 shutdown_connections 2024-02-05T07:12:11.981 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:11.387+0000 7f7641fb0700 1 -- 172.21.15.184:0/1719785406 wait complete. 2024-02-05T07:12:11.981 INFO:teuthology.orchestra.run.smithi184.stdout:Waiting for the mgr to restart... 2024-02-05T07:12:11.981 INFO:teuthology.orchestra.run.smithi184.stdout:Waiting for mgr epoch 5... 2024-02-05T07:12:12.252 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1719785406' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-05T07:12:12.252 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:12 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:12.139+0000 7fd63ec82200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-05T07:12:12.252 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:12 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:12.249+0000 7fd63ec82200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-05T07:12:12.521 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:12 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:12.340+0000 7fd63ec82200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-05T07:12:12.522 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:12 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:12.438+0000 7fd63ec82200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-05T07:12:13.022 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:12 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:12.622+0000 7fd63ec82200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-05T07:12:13.982 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:13 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:13.576+0000 7fd63ec82200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-05T07:12:13.982 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:13 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:13.707+0000 7fd63ec82200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-05T07:12:14.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:14.041+0000 7fd63ec82200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-05T07:12:14.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:14.132+0000 7fd63ec82200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-05T07:12:14.772 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:14.327+0000 7fd63ec82200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-05T07:12:14.772 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:14.509+0000 7fd63ec82200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-05T07:12:15.055 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:14.790+0000 7fd63ec82200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-05T07:12:15.055 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:15 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:15.053+0000 7fd63ec82200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-05T07:12:15.521 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:15 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:15.288+0000 7fd63ec82200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-05T07:12:16.521 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:16 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:16.081+0000 7fd63ec82200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-05T07:12:16.970 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:16 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:16.655+0000 7fd63ec82200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-05T07:12:16.970 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:16 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:16.753+0000 7fd63ec82200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-05T07:12:16.970 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:16 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:16.967+0000 7fd63ec82200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-05T07:12:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:17 smithi184 ceph-mon[29861]: Active manager daemon y restarted 2024-02-05T07:12:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:17 smithi184 ceph-mon[29861]: Activating manager daemon y 2024-02-05T07:12:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:17 smithi184 ceph-mon[29861]: osdmap e2: 0 total, 0 up, 0 in 2024-02-05T07:12:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:17 smithi184 ceph-mon[29861]: mgrmap e6: y(active, starting, since 0.00325075s) 2024-02-05T07:12:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:17 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:12:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:17 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-05T07:12:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:17 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-05T07:12:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:17 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-05T07:12:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:17 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-05T07:12:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:17 smithi184 ceph-mon[29861]: Manager daemon y is now available 2024-02-05T07:12:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:17 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' 2024-02-05T07:12:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:17 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' 2024-02-05T07:12:17.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:17 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:12:17.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:17 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:12:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:18 smithi184 ceph-mon[29861]: Found migration_current of "None". Setting to last migration. 2024-02-05T07:12:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:18 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:12:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:18 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-05T07:12:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:18 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-05T07:12:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:18 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' 2024-02-05T07:12:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:18 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' 2024-02-05T07:12:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:18 smithi184 ceph-mon[29861]: mgrmap e7: y(active, since 1.00592s) 2024-02-05T07:12:18.622 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout { 2024-02-05T07:12:18.622 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-02-05T07:12:18.622 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-05T07:12:18.622 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout } 2024-02-05T07:12:18.622 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.572+0000 7f8051def700 1 Processor -- start 2024-02-05T07:12:18.622 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.572+0000 7f8051def700 1 -- start start 2024-02-05T07:12:18.622 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.572+0000 7f8051def700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f804c079720 con 0x7f804c106580 2024-02-05T07:12:18.622 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.573+0000 7f804b7fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f804c106580 0x7f804c108970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:53644/0 (socket says 172.21.15.184:53644) 2024-02-05T07:12:18.622 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.573+0000 7f804b7fe700 1 -- 172.21.15.184:0/3774704502 learned_addr learned my addr 172.21.15.184:0/3774704502 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:18.622 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.573+0000 7f804a7fc700 1 -- 172.21.15.184:0/3774704502 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104884728 0 0) 0x7f804c079720 con 0x7f804c106580 2024-02-05T07:12:18.622 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.573+0000 7f804a7fc700 1 -- 172.21.15.184:0/3774704502 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80340035b0 con 0x7f804c106580 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.573+0000 7f804a7fc700 1 -- 172.21.15.184:0/3774704502 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4072509347 0 0) 0x7f80340035b0 con 0x7f804c106580 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.573+0000 7f804a7fc700 1 -- 172.21.15.184:0/3774704502 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c10b0a0 con 0x7f804c106580 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.573+0000 7f804a7fc700 1 -- 172.21.15.184:0/3774704502 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f8040001580 con 0x7f804c106580 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.573+0000 7f804a7fc700 1 -- 172.21.15.184:0/3774704502 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f8040001c10 con 0x7f804c106580 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.573+0000 7f804a7fc700 1 -- 172.21.15.184:0/3774704502 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f80400057b0 con 0x7f804c106580 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.574+0000 7f8051def700 1 -- 172.21.15.184:0/3774704502 >> v1:172.21.15.184:6789/0 conn(0x7f804c106580 legacy=0x7f804c108970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.574+0000 7f8051def700 1 -- 172.21.15.184:0/3774704502 shutdown_connections 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.574+0000 7f8051def700 1 -- 172.21.15.184:0/3774704502 >> 172.21.15.184:0/3774704502 conn(0x7f804c0fff30 msgr2=0x7f804c1023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.574+0000 7f8051def700 1 -- 172.21.15.184:0/3774704502 shutdown_connections 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.574+0000 7f8051def700 1 -- 172.21.15.184:0/3774704502 wait complete. 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.575+0000 7f8051def700 1 Processor -- start 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.575+0000 7f8051def700 1 -- start start 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.575+0000 7f8051def700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f804c199c70 con 0x7f804c106580 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.575+0000 7f804b7fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f804c106580 0x7f804c199560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:53660/0 (socket says 172.21.15.184:53660) 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.575+0000 7f804b7fe700 1 -- 172.21.15.184:0/2342201600 learned_addr learned my addr 172.21.15.184:0/2342201600 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:18.623 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.576+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230452521 0 0) 0x7f804c199c70 con 0x7f804c106580 2024-02-05T07:12:18.624 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.576+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8034005540 con 0x7f804c106580 2024-02-05T07:12:18.624 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.576+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2671987609 0 0) 0x7f8034005540 con 0x7f804c106580 2024-02-05T07:12:18.624 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.576+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f804c199c70 con 0x7f804c106580 2024-02-05T07:12:18.624 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.576+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f8040001080 con 0x7f804c106580 2024-02-05T07:12:18.624 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.576+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 649139780 0 0) 0x7f804c199c70 con 0x7f804c106580 2024-02-05T07:12:18.624 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.576+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c199e00 con 0x7f804c106580 2024-02-05T07:12:18.624 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.576+0000 7f8051def700 1 -- 172.21.15.184:0/2342201600 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c19a0b0 con 0x7f804c106580 2024-02-05T07:12:18.624 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.576+0000 7f8051def700 1 -- 172.21.15.184:0/2342201600 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c19dc00 con 0x7f804c106580 2024-02-05T07:12:18.624 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.576+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f8040004990 con 0x7f804c106580 2024-02-05T07:12:18.624 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.576+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f8040006150 con 0x7f804c106580 2024-02-05T07:12:18.624 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.577+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 5) v1 ==== 45897+0+0 (unknown 485493536 0 0) 0x7f8040011610 con 0x7f804c106580 2024-02-05T07:12:18.624 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.577+0000 7f8051def700 1 -- 172.21.15.184:0/2342201600 --> v1:172.21.15.184:6800/668972809 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8038000d40 con 0x7f803403a130 2024-02-05T07:12:18.624 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.577+0000 7f804affd700 1 -- 172.21.15.184:0/2342201600 >> v1:172.21.15.184:6800/668972809 conn(0x7f803403a130 legacy=0x7f803403c5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/668972809 2024-02-05T07:12:18.624 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.577+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 389070130 0 0) 0x7f8040048060 con 0x7f804c106580 2024-02-05T07:12:18.624 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:12.778+0000 7f804affd700 1 -- 172.21.15.184:0/2342201600 >> v1:172.21.15.184:6800/668972809 conn(0x7f803403a130 legacy=0x7f803403c5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/668972809 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:13.179+0000 7f804affd700 1 -- 172.21.15.184:0/2342201600 >> v1:172.21.15.184:6800/668972809 conn(0x7f803403a130 legacy=0x7f803403c5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/668972809 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:13.980+0000 7f804affd700 1 -- 172.21.15.184:0/2342201600 >> v1:172.21.15.184:6800/668972809 conn(0x7f803403a130 legacy=0x7f803403c5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/668972809 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:15.581+0000 7f804affd700 1 -- 172.21.15.184:0/2342201600 >> v1:172.21.15.184:6800/668972809 conn(0x7f803403a130 legacy=0x7f803403c5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/668972809 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:16.983+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mgrmap(e 6) v1 ==== 45699+0+0 (unknown 3649701848 0 0) 0x7f80400133d0 con 0x7f804c106580 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:16.983+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 >> v1:172.21.15.184:6800/668972809 conn(0x7f803403a130 legacy=0x7f803403c5d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:17.985+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mgrmap(e 7) v1 ==== 45791+0+0 (unknown 16127897 0 0) 0x7f8040048a10 con 0x7f804c106580 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:17.985+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 --> v1:172.21.15.184:6800/2693451489 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8038000d40 con 0x7f803403e940 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:17.986+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 <== mgr.14118 v1:172.21.15.184:6800/2693451489 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (unknown 0 0 4109177037) 0x7f8038000d40 con 0x7f803403e940 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:17.997+0000 7f8051def700 1 -- 172.21.15.184:0/2342201600 --> v1:172.21.15.184:6800/2693451489 -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f8038002800 con 0x7f803403e940 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:17.997+0000 7f8048ff9700 1 -- 172.21.15.184:0/2342201600 <== mgr.14118 v1:172.21.15.184:6800/2693451489 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (unknown 0 0 96372106) 0x7f8038002800 con 0x7f803403e940 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:17.997+0000 7f8051def700 1 -- 172.21.15.184:0/2342201600 >> v1:172.21.15.184:6800/2693451489 conn(0x7f803403e940 legacy=0x7f8034040d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:17.997+0000 7f8051def700 1 -- 172.21.15.184:0/2342201600 >> v1:172.21.15.184:6789/0 conn(0x7f804c106580 legacy=0x7f804c199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:17.998+0000 7f8051def700 1 -- 172.21.15.184:0/2342201600 shutdown_connections 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:17.998+0000 7f8051def700 1 -- 172.21.15.184:0/2342201600 >> 172.21.15.184:0/2342201600 conn(0x7f804c0fff30 msgr2=0x7f804c108090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:17.998+0000 7f8051def700 1 -- 172.21.15.184:0/2342201600 shutdown_connections 2024-02-05T07:12:18.625 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:17.998+0000 7f8051def700 1 -- 172.21.15.184:0/2342201600 wait complete. 2024-02-05T07:12:18.626 INFO:teuthology.orchestra.run.smithi184.stdout:mgr epoch 5 is available 2024-02-05T07:12:18.626 INFO:teuthology.orchestra.run.smithi184.stdout:Setting orchestrator backend to cephadm... 2024-02-05T07:12:19.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:19 smithi184 ceph-mon[29861]: from='client.14122 v1:172.21.15.184:0/2342201600' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-05T07:12:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:19 smithi184 ceph-mon[29861]: from='client.14122 v1:172.21.15.184:0/2342201600' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-05T07:12:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:19 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:12:19.910 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.070+0000 7f0ffa0fa700 1 Processor -- start 2024-02-05T07:12:19.911 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.070+0000 7f0ffa0fa700 1 -- start start 2024-02-05T07:12:19.911 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.071+0000 7f0ffa0fa700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0ff4109f30 con 0x7f0ff4105b00 2024-02-05T07:12:19.911 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.071+0000 7f0ff37fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f0ff4105b00 0x7f0ff4105f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:38198/0 (socket says 172.21.15.184:38198) 2024-02-05T07:12:19.911 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.071+0000 7f0ff37fe700 1 -- 172.21.15.184:0/3181257655 learned_addr learned my addr 172.21.15.184:0/3181257655 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:19.911 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.071+0000 7f0ff27fc700 1 -- 172.21.15.184:0/3181257655 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365774165 0 0) 0x7f0ff4109f30 con 0x7f0ff4105b00 2024-02-05T07:12:19.911 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.071+0000 7f0ff27fc700 1 -- 172.21.15.184:0/3181257655 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fdc0035b0 con 0x7f0ff4105b00 2024-02-05T07:12:19.911 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.071+0000 7f0ff27fc700 1 -- 172.21.15.184:0/3181257655 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 424616028 0 0) 0x7f0fdc0035b0 con 0x7f0ff4105b00 2024-02-05T07:12:19.911 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.071+0000 7f0ff27fc700 1 -- 172.21.15.184:0/3181257655 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff410b0d0 con 0x7f0ff4105b00 2024-02-05T07:12:19.911 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.071+0000 7f0ff27fc700 1 -- 172.21.15.184:0/3181257655 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f0fe8001580 con 0x7f0ff4105b00 2024-02-05T07:12:19.911 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.071+0000 7f0ff27fc700 1 -- 172.21.15.184:0/3181257655 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f0fe8001ce0 con 0x7f0ff4105b00 2024-02-05T07:12:19.911 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.071+0000 7f0ff27fc700 1 -- 172.21.15.184:0/3181257655 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f0fe8005960 con 0x7f0ff4105b00 2024-02-05T07:12:19.911 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.072+0000 7f0ffa0fa700 1 -- 172.21.15.184:0/3181257655 >> v1:172.21.15.184:6789/0 conn(0x7f0ff4105b00 legacy=0x7f0ff4105f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:19.912 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.072+0000 7f0ffa0fa700 1 -- 172.21.15.184:0/3181257655 shutdown_connections 2024-02-05T07:12:19.912 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.072+0000 7f0ffa0fa700 1 -- 172.21.15.184:0/3181257655 >> 172.21.15.184:0/3181257655 conn(0x7f0ff41010e0 msgr2=0x7f0ff4103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:19.912 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.072+0000 7f0ffa0fa700 1 -- 172.21.15.184:0/3181257655 shutdown_connections 2024-02-05T07:12:19.912 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.072+0000 7f0ffa0fa700 1 -- 172.21.15.184:0/3181257655 wait complete. 2024-02-05T07:12:19.912 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.073+0000 7f0ffa0fa700 1 Processor -- start 2024-02-05T07:12:19.912 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.073+0000 7f0ffa0fa700 1 -- start start 2024-02-05T07:12:19.912 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.073+0000 7f0ffa0fa700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0ff4199c20 con 0x7f0ff4105b00 2024-02-05T07:12:19.912 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.073+0000 7f0ff37fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f0ff4105b00 0x7f0ff4199510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:38206/0 (socket says 172.21.15.184:38206) 2024-02-05T07:12:19.912 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.073+0000 7f0ff37fe700 1 -- 172.21.15.184:0/2415650442 learned_addr learned my addr 172.21.15.184:0/2415650442 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:19.912 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.073+0000 7f0ff0ff9700 1 -- 172.21.15.184:0/2415650442 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881987516 0 0) 0x7f0ff4199c20 con 0x7f0ff4105b00 2024-02-05T07:12:19.912 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.073+0000 7f0ff0ff9700 1 -- 172.21.15.184:0/2415650442 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fdc0054f0 con 0x7f0ff4105b00 2024-02-05T07:12:19.912 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.073+0000 7f0ff0ff9700 1 -- 172.21.15.184:0/2415650442 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 528550335 0 0) 0x7f0fdc0054f0 con 0x7f0ff4105b00 2024-02-05T07:12:19.912 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.073+0000 7f0ff0ff9700 1 -- 172.21.15.184:0/2415650442 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0ff4199c20 con 0x7f0ff4105b00 2024-02-05T07:12:19.912 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.073+0000 7f0ff0ff9700 1 -- 172.21.15.184:0/2415650442 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f0fe8005940 con 0x7f0ff4105b00 2024-02-05T07:12:19.913 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.074+0000 7f0ff0ff9700 1 -- 172.21.15.184:0/2415650442 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3309876362 0 0) 0x7f0ff4199c20 con 0x7f0ff4105b00 2024-02-05T07:12:19.913 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.074+0000 7f0ff0ff9700 1 -- 172.21.15.184:0/2415650442 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff4199db0 con 0x7f0ff4105b00 2024-02-05T07:12:19.913 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.074+0000 7f0ffa0fa700 1 -- 172.21.15.184:0/2415650442 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff419a060 con 0x7f0ff4105b00 2024-02-05T07:12:19.913 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.074+0000 7f0ffa0fa700 1 -- 172.21.15.184:0/2415650442 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff419dbb0 con 0x7f0ff4105b00 2024-02-05T07:12:19.913 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.074+0000 7f0ff0ff9700 1 -- 172.21.15.184:0/2415650442 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f0fe80052d0 con 0x7f0ff4105b00 2024-02-05T07:12:19.913 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.074+0000 7f0ff0ff9700 1 -- 172.21.15.184:0/2415650442 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f0fe80060a0 con 0x7f0ff4105b00 2024-02-05T07:12:19.913 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.074+0000 7f0ff0ff9700 1 -- 172.21.15.184:0/2415650442 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 8) v1 ==== 45897+0+0 (unknown 2671873510 0 0) 0x7f0fe8011620 con 0x7f0ff4105b00 2024-02-05T07:12:19.913 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.075+0000 7f0ffa0fa700 1 -- 172.21.15.184:0/2415650442 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fe0005150 con 0x7f0ff4105b00 2024-02-05T07:12:19.913 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.075+0000 7f0ff0ff9700 1 -- 172.21.15.184:0/2415650442 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 3316935985 0 0) 0x7f0fe8047300 con 0x7f0ff4105b00 2024-02-05T07:12:19.913 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.080+0000 7f0ff0ff9700 1 -- 172.21.15.184:0/2415650442 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f0fe8012e90 con 0x7f0ff4105b00 2024-02-05T07:12:19.913 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.287+0000 7f0ffa0fa700 1 -- 172.21.15.184:0/2415650442 --> v1:172.21.15.184:6800/2693451489 -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fe0000bc0 con 0x7f0fdc03a120 2024-02-05T07:12:19.913 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.293+0000 7f0ff0ff9700 1 -- 172.21.15.184:0/2415650442 <== mgr.14118 v1:172.21.15.184:6800/2693451489 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (unknown 0 0 0) 0x7f0fe0000bc0 con 0x7f0fdc03a120 2024-02-05T07:12:19.913 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.295+0000 7f0ffa0fa700 1 -- 172.21.15.184:0/2415650442 >> v1:172.21.15.184:6800/2693451489 conn(0x7f0fdc03a120 legacy=0x7f0fdc03c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:19.913 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.295+0000 7f0ffa0fa700 1 -- 172.21.15.184:0/2415650442 >> v1:172.21.15.184:6789/0 conn(0x7f0ff4105b00 legacy=0x7f0ff4199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:19.914 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.295+0000 7f0ffa0fa700 1 -- 172.21.15.184:0/2415650442 shutdown_connections 2024-02-05T07:12:19.914 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.295+0000 7f0ffa0fa700 1 -- 172.21.15.184:0/2415650442 >> 172.21.15.184:0/2415650442 conn(0x7f0ff41010e0 msgr2=0x7f0ff41034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:19.914 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.295+0000 7f0ffa0fa700 1 -- 172.21.15.184:0/2415650442 shutdown_connections 2024-02-05T07:12:19.914 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:19.295+0000 7f0ffa0fa700 1 -- 172.21.15.184:0/2415650442 wait complete. 2024-02-05T07:12:20.257 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:20 smithi184 ceph-mon[29861]: [05/Feb/2024:07:12:18] ENGINE Bus STARTING 2024-02-05T07:12:20.257 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:20 smithi184 ceph-mon[29861]: [05/Feb/2024:07:12:18] ENGINE Serving on https://172.21.15.184:7150 2024-02-05T07:12:20.257 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:20 smithi184 ceph-mon[29861]: [05/Feb/2024:07:12:18] ENGINE Serving on http://172.21.15.184:8765 2024-02-05T07:12:20.257 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:20 smithi184 ceph-mon[29861]: [05/Feb/2024:07:12:18] ENGINE Bus STARTED 2024-02-05T07:12:20.257 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:20 smithi184 ceph-mon[29861]: mgrmap e8: y(active, since 2s) 2024-02-05T07:12:20.257 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:20 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' 2024-02-05T07:12:20.257 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:20 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:12:21.092 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout value unchanged 2024-02-05T07:12:21.092 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.355+0000 7f9858ab3700 1 Processor -- start 2024-02-05T07:12:21.092 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.355+0000 7f9858ab3700 1 -- start start 2024-02-05T07:12:21.092 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.355+0000 7f9858ab3700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9854108e40 con 0x7f9854104a10 2024-02-05T07:12:21.092 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.355+0000 7f985259c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f9854104a10 0x7f9854104e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:38208/0 (socket says 172.21.15.184:38208) 2024-02-05T07:12:21.092 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.355+0000 7f985259c700 1 -- 172.21.15.184:0/2021105975 learned_addr learned my addr 172.21.15.184:0/2021105975 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:21.092 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.356+0000 7f9851d9b700 1 -- 172.21.15.184:0/2021105975 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2423767689 0 0) 0x7f9854108e40 con 0x7f9854104a10 2024-02-05T07:12:21.092 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.356+0000 7f9851d9b700 1 -- 172.21.15.184:0/2021105975 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98400057c0 con 0x7f9854104a10 2024-02-05T07:12:21.092 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.356+0000 7f9851d9b700 1 -- 172.21.15.184:0/2021105975 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4023603863 0 0) 0x7f98400057c0 con 0x7f9854104a10 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.356+0000 7f9851d9b700 1 -- 172.21.15.184:0/2021105975 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9854109fe0 con 0x7f9854104a10 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.356+0000 7f9851d9b700 1 -- 172.21.15.184:0/2021105975 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9844001580 con 0x7f9854104a10 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.356+0000 7f9851d9b700 1 -- 172.21.15.184:0/2021105975 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f9844001c10 con 0x7f9854104a10 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.356+0000 7f9851d9b700 1 -- 172.21.15.184:0/2021105975 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9844005780 con 0x7f9854104a10 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.357+0000 7f9858ab3700 1 -- 172.21.15.184:0/2021105975 >> v1:172.21.15.184:6789/0 conn(0x7f9854104a10 legacy=0x7f9854104e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.357+0000 7f9858ab3700 1 -- 172.21.15.184:0/2021105975 shutdown_connections 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.357+0000 7f9858ab3700 1 -- 172.21.15.184:0/2021105975 >> 172.21.15.184:0/2021105975 conn(0x7f98540fffd0 msgr2=0x7f98541023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.357+0000 7f9858ab3700 1 -- 172.21.15.184:0/2021105975 shutdown_connections 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.357+0000 7f9858ab3700 1 -- 172.21.15.184:0/2021105975 wait complete. 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.357+0000 7f9858ab3700 1 Processor -- start 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.358+0000 7f9858ab3700 1 -- start start 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.358+0000 7f9858ab3700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9854197a50 con 0x7f9854104a10 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.358+0000 7f985259c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f9854104a10 0x7f9854197340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:38218/0 (socket says 172.21.15.184:38218) 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.358+0000 7f985259c700 1 -- 172.21.15.184:0/4024660417 learned_addr learned my addr 172.21.15.184:0/4024660417 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.358+0000 7f984bfff700 1 -- 172.21.15.184:0/4024660417 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815300431 0 0) 0x7f9854197a50 con 0x7f9854104a10 2024-02-05T07:12:21.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.358+0000 7f984bfff700 1 -- 172.21.15.184:0/4024660417 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9840007750 con 0x7f9854104a10 2024-02-05T07:12:21.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.358+0000 7f984bfff700 1 -- 172.21.15.184:0/4024660417 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2817878090 0 0) 0x7f9840007750 con 0x7f9854104a10 2024-02-05T07:12:21.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.358+0000 7f984bfff700 1 -- 172.21.15.184:0/4024660417 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9854197a50 con 0x7f9854104a10 2024-02-05T07:12:21.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.358+0000 7f984bfff700 1 -- 172.21.15.184:0/4024660417 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9844001080 con 0x7f9854104a10 2024-02-05T07:12:21.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.358+0000 7f984bfff700 1 -- 172.21.15.184:0/4024660417 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2694063145 0 0) 0x7f9854197a50 con 0x7f9854104a10 2024-02-05T07:12:21.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.358+0000 7f984bfff700 1 -- 172.21.15.184:0/4024660417 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9854197be0 con 0x7f9854104a10 2024-02-05T07:12:21.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.358+0000 7f9858ab3700 1 -- 172.21.15.184:0/4024660417 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9854197e90 con 0x7f9854104a10 2024-02-05T07:12:21.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.358+0000 7f9858ab3700 1 -- 172.21.15.184:0/4024660417 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f985419b9e0 con 0x7f9854104a10 2024-02-05T07:12:21.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.358+0000 7f984bfff700 1 -- 172.21.15.184:0/4024660417 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f9844001a90 con 0x7f9854104a10 2024-02-05T07:12:21.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.358+0000 7f984bfff700 1 -- 172.21.15.184:0/4024660417 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9844006150 con 0x7f9854104a10 2024-02-05T07:12:21.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.359+0000 7f984bfff700 1 -- 172.21.15.184:0/4024660417 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 8) v1 ==== 45897+0+0 (unknown 2671873510 0 0) 0x7f98440116f0 con 0x7f9854104a10 2024-02-05T07:12:21.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.359+0000 7f9858ab3700 1 -- 172.21.15.184:0/4024660417 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9834005150 con 0x7f9854104a10 2024-02-05T07:12:21.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.359+0000 7f984bfff700 1 -- 172.21.15.184:0/4024660417 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 3316935985 0 0) 0x7f98440477c0 con 0x7f9854104a10 2024-02-05T07:12:21.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.364+0000 7f984bfff700 1 -- 172.21.15.184:0/4024660417 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f9844016c70 con 0x7f9854104a10 2024-02-05T07:12:21.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.562+0000 7f9858ab3700 1 -- 172.21.15.184:0/4024660417 --> v1:172.21.15.184:6800/2693451489 -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f9834000bc0 con 0x7f984003c280 2024-02-05T07:12:21.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.562+0000 7f984bfff700 1 -- 172.21.15.184:0/4024660417 <== mgr.14118 v1:172.21.15.184:6800/2693451489 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (unknown 0 0 2070689548) 0x7f9834000bc0 con 0x7f984003c280 2024-02-05T07:12:21.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.564+0000 7f9858ab3700 1 -- 172.21.15.184:0/4024660417 >> v1:172.21.15.184:6800/2693451489 conn(0x7f984003c280 legacy=0x7f984003e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:21.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.564+0000 7f9858ab3700 1 -- 172.21.15.184:0/4024660417 >> v1:172.21.15.184:6789/0 conn(0x7f9854104a10 legacy=0x7f9854197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:21.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.564+0000 7f9858ab3700 1 -- 172.21.15.184:0/4024660417 shutdown_connections 2024-02-05T07:12:21.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.564+0000 7f9858ab3700 1 -- 172.21.15.184:0/4024660417 >> 172.21.15.184:0/4024660417 conn(0x7f98540fffd0 msgr2=0x7f98541023c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:21.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.564+0000 7f9858ab3700 1 -- 172.21.15.184:0/4024660417 shutdown_connections 2024-02-05T07:12:21.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:20.564+0000 7f9858ab3700 1 -- 172.21.15.184:0/4024660417 wait complete. 2024-02-05T07:12:21.095 INFO:teuthology.orchestra.run.smithi184.stdout:Generating ssh key... 2024-02-05T07:12:21.211 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:21 smithi184 ceph-mon[29861]: from='client.14130 v1:172.21.15.184:0/2415650442' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:12:22.291 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-mon[29861]: from='client.14132 v1:172.21.15.184:0/4024660417' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:12:22.291 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' 2024-02-05T07:12:22.291 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' 2024-02-05T07:12:22.292 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: Generating public/private rsa key pair. 2024-02-05T07:12:22.292 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: Your identification has been saved in /tmp/tmp7s6xfz_j/key. 2024-02-05T07:12:22.292 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: Your public key has been saved in /tmp/tmp7s6xfz_j/key.pub. 2024-02-05T07:12:22.292 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: The key fingerprint is: 2024-02-05T07:12:22.292 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: SHA256:vz/RAqaLCt1qrkW0zZoK0h4/ORa/G/Qhc+Zuc3fU3SI ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:12:22.292 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: The key's randomart image is: 2024-02-05T07:12:22.292 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: +---[RSA 3072]----+ 2024-02-05T07:12:22.292 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: | | 2024-02-05T07:12:22.292 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: | | 2024-02-05T07:12:22.292 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: | . | 2024-02-05T07:12:22.292 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: | . + o | 2024-02-05T07:12:22.292 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: | o * So . . .o| 2024-02-05T07:12:22.293 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: | . o.= B.o E + +| 2024-02-05T07:12:22.293 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: |o + =+o.o.. = . | 2024-02-05T07:12:22.293 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: |.o **.oo+ ..o . | 2024-02-05T07:12:22.293 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: | +==+o+.o.o.o | 2024-02-05T07:12:22.293 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: +----[SHA256]-----+ 2024-02-05T07:12:22.531 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.547+0000 7f4bcd89f700 1 Processor -- start 2024-02-05T07:12:22.531 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.547+0000 7f4bcd89f700 1 -- start start 2024-02-05T07:12:22.531 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.547+0000 7f4bcd89f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4bc8109f30 con 0x7f4bc8105b00 2024-02-05T07:12:22.531 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.547+0000 7f4bc6ffd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f4bc8105b00 0x7f4bc8105f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:38232/0 (socket says 172.21.15.184:38232) 2024-02-05T07:12:22.531 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.547+0000 7f4bc6ffd700 1 -- 172.21.15.184:0/1363386640 learned_addr learned my addr 172.21.15.184:0/1363386640 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:22.531 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.547+0000 7f4bc5ffb700 1 -- 172.21.15.184:0/1363386640 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566730493 0 0) 0x7f4bc8109f30 con 0x7f4bc8105b00 2024-02-05T07:12:22.531 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.547+0000 7f4bc5ffb700 1 -- 172.21.15.184:0/1363386640 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb00035b0 con 0x7f4bc8105b00 2024-02-05T07:12:22.531 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.548+0000 7f4bc5ffb700 1 -- 172.21.15.184:0/1363386640 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2795865871 0 0) 0x7f4bb00035b0 con 0x7f4bc8105b00 2024-02-05T07:12:22.532 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.548+0000 7f4bc5ffb700 1 -- 172.21.15.184:0/1363386640 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc810b0d0 con 0x7f4bc8105b00 2024-02-05T07:12:22.532 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.548+0000 7f4bc5ffb700 1 -- 172.21.15.184:0/1363386640 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f4bb8001580 con 0x7f4bc8105b00 2024-02-05T07:12:22.532 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.548+0000 7f4bc5ffb700 1 -- 172.21.15.184:0/1363386640 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f4bb8001ce0 con 0x7f4bc8105b00 2024-02-05T07:12:22.532 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.548+0000 7f4bc5ffb700 1 -- 172.21.15.184:0/1363386640 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f4bb8005960 con 0x7f4bc8105b00 2024-02-05T07:12:22.532 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.548+0000 7f4bcd89f700 1 -- 172.21.15.184:0/1363386640 >> v1:172.21.15.184:6789/0 conn(0x7f4bc8105b00 legacy=0x7f4bc8105f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:22.532 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.548+0000 7f4bcd89f700 1 -- 172.21.15.184:0/1363386640 shutdown_connections 2024-02-05T07:12:22.532 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.548+0000 7f4bcd89f700 1 -- 172.21.15.184:0/1363386640 >> 172.21.15.184:0/1363386640 conn(0x7f4bc81010e0 msgr2=0x7f4bc8103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:22.532 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.548+0000 7f4bcd89f700 1 -- 172.21.15.184:0/1363386640 shutdown_connections 2024-02-05T07:12:22.532 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.548+0000 7f4bcd89f700 1 -- 172.21.15.184:0/1363386640 wait complete. 2024-02-05T07:12:22.532 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.549+0000 7f4bcd89f700 1 Processor -- start 2024-02-05T07:12:22.532 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.549+0000 7f4bcd89f700 1 -- start start 2024-02-05T07:12:22.532 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.549+0000 7f4bcd89f700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4bc8199c20 con 0x7f4bc8105b00 2024-02-05T07:12:22.532 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.549+0000 7f4bc6ffd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f4bc8105b00 0x7f4bc8199510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:38242/0 (socket says 172.21.15.184:38242) 2024-02-05T07:12:22.532 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.549+0000 7f4bc6ffd700 1 -- 172.21.15.184:0/2339949542 learned_addr learned my addr 172.21.15.184:0/2339949542 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:22.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.549+0000 7f4bcc89d700 1 -- 172.21.15.184:0/2339949542 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954892721 0 0) 0x7f4bc8199c20 con 0x7f4bc8105b00 2024-02-05T07:12:22.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.549+0000 7f4bcc89d700 1 -- 172.21.15.184:0/2339949542 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bb00054f0 con 0x7f4bc8105b00 2024-02-05T07:12:22.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.550+0000 7f4bcc89d700 1 -- 172.21.15.184:0/2339949542 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2270776735 0 0) 0x7f4bb00054f0 con 0x7f4bc8105b00 2024-02-05T07:12:22.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.550+0000 7f4bcc89d700 1 -- 172.21.15.184:0/2339949542 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4bc8199c20 con 0x7f4bc8105b00 2024-02-05T07:12:22.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.550+0000 7f4bcc89d700 1 -- 172.21.15.184:0/2339949542 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f4bb8005940 con 0x7f4bc8105b00 2024-02-05T07:12:22.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.550+0000 7f4bcc89d700 1 -- 172.21.15.184:0/2339949542 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2298628334 0 0) 0x7f4bc8199c20 con 0x7f4bc8105b00 2024-02-05T07:12:22.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.550+0000 7f4bcc89d700 1 -- 172.21.15.184:0/2339949542 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc8199db0 con 0x7f4bc8105b00 2024-02-05T07:12:22.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.550+0000 7f4bcd89f700 1 -- 172.21.15.184:0/2339949542 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc819a060 con 0x7f4bc8105b00 2024-02-05T07:12:22.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.550+0000 7f4bcd89f700 1 -- 172.21.15.184:0/2339949542 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc819dbb0 con 0x7f4bc8105b00 2024-02-05T07:12:22.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.550+0000 7f4bcc89d700 1 -- 172.21.15.184:0/2339949542 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f4bb80052d0 con 0x7f4bc8105b00 2024-02-05T07:12:22.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.550+0000 7f4bcc89d700 1 -- 172.21.15.184:0/2339949542 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f4bb80060f0 con 0x7f4bc8105b00 2024-02-05T07:12:22.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.551+0000 7f4bcc89d700 1 -- 172.21.15.184:0/2339949542 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 8) v1 ==== 45897+0+0 (unknown 2671873510 0 0) 0x7f4bb8011630 con 0x7f4bc8105b00 2024-02-05T07:12:22.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.551+0000 7f4bcd89f700 1 -- 172.21.15.184:0/2339949542 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb4005150 con 0x7f4bc8105b00 2024-02-05T07:12:22.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.551+0000 7f4bcc89d700 1 -- 172.21.15.184:0/2339949542 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 3316935985 0 0) 0x7f4bb80472d0 con 0x7f4bc8105b00 2024-02-05T07:12:22.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.556+0000 7f4bcc89d700 1 -- 172.21.15.184:0/2339949542 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f4bb8012ea0 con 0x7f4bc8105b00 2024-02-05T07:12:22.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:21.749+0000 7f4bcd89f700 1 -- 172.21.15.184:0/2339949542 --> v1:172.21.15.184:6800/2693451489 -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bb4000bc0 con 0x7f4bb003a120 2024-02-05T07:12:22.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.036+0000 7f4bcc89d700 1 -- 172.21.15.184:0/2339949542 <== mgr.14118 v1:172.21.15.184:6800/2693451489 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (unknown 0 0 0) 0x7f4bb4000bc0 con 0x7f4bb003a120 2024-02-05T07:12:22.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.038+0000 7f4bcd89f700 1 -- 172.21.15.184:0/2339949542 >> v1:172.21.15.184:6800/2693451489 conn(0x7f4bb003a120 legacy=0x7f4bb003c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:22.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.038+0000 7f4bcd89f700 1 -- 172.21.15.184:0/2339949542 >> v1:172.21.15.184:6789/0 conn(0x7f4bc8105b00 legacy=0x7f4bc8199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:22.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.038+0000 7f4bcd89f700 1 -- 172.21.15.184:0/2339949542 shutdown_connections 2024-02-05T07:12:22.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.038+0000 7f4bcd89f700 1 -- 172.21.15.184:0/2339949542 >> 172.21.15.184:0/2339949542 conn(0x7f4bc81010e0 msgr2=0x7f4bc81034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:22.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.038+0000 7f4bcd89f700 1 -- 172.21.15.184:0/2339949542 shutdown_connections 2024-02-05T07:12:22.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.039+0000 7f4bcd89f700 1 -- 172.21.15.184:0/2339949542 wait complete. 2024-02-05T07:12:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:23 smithi184 ceph-mon[29861]: from='client.14134 v1:172.21.15.184:0/2339949542' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:12:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:23 smithi184 ceph-mon[29861]: Generating ssh key... 2024-02-05T07:12:23.797 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGN+uXjJUZxwv5nvDs6DUaXYkduKGlUgIK35aT0pbh3kiGhZJqqnOoxfTiXID/Agdml4K15BCa1hWk07WYBRLCk8MsvQ3FWsV89oG632XqJr8tRZqykxzMCL6dijLx+Oe5ktxuMreLperIaJjcMzR6QCdCQpkDxjwFirxzuIHC4lczkGVP2LZc3FWEH6uceyehk4BxgX5lYLdA4Hu784VdizXjlQcUycThpYEBDRJV3pGPq/kHGHFgSFFyhITpri8wVs1E4HMQOjTiiIMpr2vdRbH+xvTu4E7vAc5xvqGdcC7CAnB67FIlaws6HIqYD4oSRpr8jLcODwxo+UNHC5Bv3Wy2nOkrL+r7KQlxDrDznhmebuZBkn231XgCwL0BwzQn7y+7Zks/yYpEQSAv0qY6efuCk/0k3wh8O/L20JmhU02PaTdFVwCJjxjOtNzqQviiwZBT0kjMPZBdbJJ/EbM0euH1/laiGO1lgNErYOpf9ri9xYlS156igoxxX4wgt4E= ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:12:23.797 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.977+0000 7fac9d863700 1 Processor -- start 2024-02-05T07:12:23.797 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.977+0000 7fac9d863700 1 -- start start 2024-02-05T07:12:23.797 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.977+0000 7fac9d863700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fac980796e0 con 0x7fac981043f0 2024-02-05T07:12:23.797 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.978+0000 7fac96ffd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fac981043f0 0x7fac98104810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:38256/0 (socket says 172.21.15.184:38256) 2024-02-05T07:12:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.978+0000 7fac96ffd700 1 -- 172.21.15.184:0/3681975799 learned_addr learned my addr 172.21.15.184:0/3681975799 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.978+0000 7fac95ffb700 1 -- 172.21.15.184:0/3681975799 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919689716 0 0) 0x7fac980796e0 con 0x7fac981043f0 2024-02-05T07:12:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.978+0000 7fac95ffb700 1 -- 172.21.15.184:0/3681975799 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac840035b0 con 0x7fac981043f0 2024-02-05T07:12:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.978+0000 7fac95ffb700 1 -- 172.21.15.184:0/3681975799 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1952863652 0 0) 0x7fac840035b0 con 0x7fac981043f0 2024-02-05T07:12:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.978+0000 7fac95ffb700 1 -- 172.21.15.184:0/3681975799 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac98105f30 con 0x7fac981043f0 2024-02-05T07:12:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.978+0000 7fac95ffb700 1 -- 172.21.15.184:0/3681975799 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fac90001900 con 0x7fac981043f0 2024-02-05T07:12:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.978+0000 7fac95ffb700 1 -- 172.21.15.184:0/3681975799 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7fac90002060 con 0x7fac981043f0 2024-02-05T07:12:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.978+0000 7fac95ffb700 1 -- 172.21.15.184:0/3681975799 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fac90005ce0 con 0x7fac981043f0 2024-02-05T07:12:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.979+0000 7fac9d863700 1 -- 172.21.15.184:0/3681975799 >> v1:172.21.15.184:6789/0 conn(0x7fac981043f0 legacy=0x7fac98104810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.979+0000 7fac9d863700 1 -- 172.21.15.184:0/3681975799 shutdown_connections 2024-02-05T07:12:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.979+0000 7fac9d863700 1 -- 172.21.15.184:0/3681975799 >> 172.21.15.184:0/3681975799 conn(0x7fac980fffd0 msgr2=0x7fac981023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.979+0000 7fac9d863700 1 -- 172.21.15.184:0/3681975799 shutdown_connections 2024-02-05T07:12:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.979+0000 7fac9d863700 1 -- 172.21.15.184:0/3681975799 wait complete. 2024-02-05T07:12:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.979+0000 7fac9d863700 1 Processor -- start 2024-02-05T07:12:23.798 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.980+0000 7fac9d863700 1 -- start start 2024-02-05T07:12:23.799 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.980+0000 7fac9d863700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fac9819bea0 con 0x7fac981043f0 2024-02-05T07:12:23.799 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.980+0000 7fac96ffd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fac981043f0 0x7fac9819b790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:38262/0 (socket says 172.21.15.184:38262) 2024-02-05T07:12:23.799 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.980+0000 7fac96ffd700 1 -- 172.21.15.184:0/3448969027 learned_addr learned my addr 172.21.15.184:0/3448969027 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:23.799 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.980+0000 7fac9c861700 1 -- 172.21.15.184:0/3448969027 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130483610 0 0) 0x7fac9819bea0 con 0x7fac981043f0 2024-02-05T07:12:23.799 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.980+0000 7fac9c861700 1 -- 172.21.15.184:0/3448969027 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac840054f0 con 0x7fac981043f0 2024-02-05T07:12:23.799 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.980+0000 7fac9c861700 1 -- 172.21.15.184:0/3448969027 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3962729937 0 0) 0x7fac840054f0 con 0x7fac981043f0 2024-02-05T07:12:23.799 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.980+0000 7fac9c861700 1 -- 172.21.15.184:0/3448969027 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fac9819bea0 con 0x7fac981043f0 2024-02-05T07:12:23.799 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.980+0000 7fac9c861700 1 -- 172.21.15.184:0/3448969027 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fac90001400 con 0x7fac981043f0 2024-02-05T07:12:23.799 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.980+0000 7fac9c861700 1 -- 172.21.15.184:0/3448969027 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4221830567 0 0) 0x7fac9819bea0 con 0x7fac981043f0 2024-02-05T07:12:23.799 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.980+0000 7fac9c861700 1 -- 172.21.15.184:0/3448969027 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9819c030 con 0x7fac981043f0 2024-02-05T07:12:23.799 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.980+0000 7fac9d863700 1 -- 172.21.15.184:0/3448969027 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9819c2e0 con 0x7fac981043f0 2024-02-05T07:12:23.799 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.980+0000 7fac9d863700 1 -- 172.21.15.184:0/3448969027 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9819fe30 con 0x7fac981043f0 2024-02-05T07:12:23.799 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.981+0000 7fac9c861700 1 -- 172.21.15.184:0/3448969027 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7fac900056c0 con 0x7fac981043f0 2024-02-05T07:12:23.799 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.981+0000 7fac9c861700 1 -- 172.21.15.184:0/3448969027 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fac90006420 con 0x7fac981043f0 2024-02-05T07:12:23.799 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.981+0000 7fac9c861700 1 -- 172.21.15.184:0/3448969027 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 8) v1 ==== 45897+0+0 (unknown 2671873510 0 0) 0x7fac900118e0 con 0x7fac981043f0 2024-02-05T07:12:23.800 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.981+0000 7fac9d863700 1 -- 172.21.15.184:0/3448969027 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac78005150 con 0x7fac981043f0 2024-02-05T07:12:23.800 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.981+0000 7fac9c861700 1 -- 172.21.15.184:0/3448969027 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 3316935985 0 0) 0x7fac90047710 con 0x7fac981043f0 2024-02-05T07:12:23.800 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:22.986+0000 7fac9c861700 1 -- 172.21.15.184:0/3448969027 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fac90013140 con 0x7fac981043f0 2024-02-05T07:12:23.800 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:23.181+0000 7fac9d863700 1 -- 172.21.15.184:0/3448969027 --> v1:172.21.15.184:6800/2693451489 -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fac78000bc0 con 0x7fac8403a110 2024-02-05T07:12:23.800 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:23.182+0000 7fac9c861700 1 -- 172.21.15.184:0/3448969027 <== mgr.14118 v1:172.21.15.184:6800/2693451489 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (unknown 0 0 2516257207) 0x7fac78000bc0 con 0x7fac8403a110 2024-02-05T07:12:23.800 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:23.184+0000 7fac9d863700 1 -- 172.21.15.184:0/3448969027 >> v1:172.21.15.184:6800/2693451489 conn(0x7fac8403a110 legacy=0x7fac8403c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:23.800 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:23.184+0000 7fac9d863700 1 -- 172.21.15.184:0/3448969027 >> v1:172.21.15.184:6789/0 conn(0x7fac981043f0 legacy=0x7fac9819b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:23.800 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:23.184+0000 7fac9d863700 1 -- 172.21.15.184:0/3448969027 shutdown_connections 2024-02-05T07:12:23.800 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:23.184+0000 7fac9d863700 1 -- 172.21.15.184:0/3448969027 >> 172.21.15.184:0/3448969027 conn(0x7fac980fffd0 msgr2=0x7fac98192530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:23.800 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:23.184+0000 7fac9d863700 1 -- 172.21.15.184:0/3448969027 shutdown_connections 2024-02-05T07:12:23.800 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:23.184+0000 7fac9d863700 1 -- 172.21.15.184:0/3448969027 wait complete. 2024-02-05T07:12:23.800 INFO:teuthology.orchestra.run.smithi184.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-05T07:12:23.800 INFO:teuthology.orchestra.run.smithi184.stdout:Adding key to root@localhost authorized_keys... 2024-02-05T07:12:23.800 INFO:teuthology.orchestra.run.smithi184.stdout:Adding host smithi184... 2024-02-05T07:12:25.439 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:25 smithi184 ceph-mon[29861]: from='client.14136 v1:172.21.15.184:0/3448969027' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:12:26.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:26 smithi184 ceph-mon[29861]: from='client.14138 v1:172.21.15.184:0/3512625224' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi184", "addr": "172.21.15.184", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:12:26.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:26 smithi184 ceph-mon[29861]: Deploying cephadm binary to smithi184 2024-02-05T07:12:29.264 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout Added host 'smithi184' with addr '172.21.15.184' 2024-02-05T07:12:29.264 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.263+0000 7f948b7b5700 1 Processor -- start 2024-02-05T07:12:29.264 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.263+0000 7f948b7b5700 1 -- start start 2024-02-05T07:12:29.264 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.263+0000 7f948b7b5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9484079700 con 0x7f94841065d0 2024-02-05T07:12:29.264 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.263+0000 7f9489551700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f94841065d0 0x7f94841089c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:38274/0 (socket says 172.21.15.184:38274) 2024-02-05T07:12:29.264 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.264+0000 7f9489551700 1 -- 172.21.15.184:0/3678036337 learned_addr learned my addr 172.21.15.184:0/3678036337 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:29.264 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.264+0000 7f947bfff700 1 -- 172.21.15.184:0/3678036337 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4258205364 0 0) 0x7f9484079700 con 0x7f94841065d0 2024-02-05T07:12:29.264 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.264+0000 7f947bfff700 1 -- 172.21.15.184:0/3678036337 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94700035b0 con 0x7f94841065d0 2024-02-05T07:12:29.264 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.264+0000 7f947bfff700 1 -- 172.21.15.184:0/3678036337 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2523731473 0 0) 0x7f94700035b0 con 0x7f94841065d0 2024-02-05T07:12:29.265 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.264+0000 7f947bfff700 1 -- 172.21.15.184:0/3678036337 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948410b0f0 con 0x7f94841065d0 2024-02-05T07:12:29.265 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.264+0000 7f947bfff700 1 -- 172.21.15.184:0/3678036337 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9480001580 con 0x7f94841065d0 2024-02-05T07:12:29.265 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.264+0000 7f947bfff700 1 -- 172.21.15.184:0/3678036337 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f9480001ce0 con 0x7f94841065d0 2024-02-05T07:12:29.265 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.264+0000 7f947bfff700 1 -- 172.21.15.184:0/3678036337 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9480005960 con 0x7f94841065d0 2024-02-05T07:12:29.265 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.265+0000 7f948b7b5700 1 -- 172.21.15.184:0/3678036337 >> v1:172.21.15.184:6789/0 conn(0x7f94841065d0 legacy=0x7f94841089c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:29.265 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.265+0000 7f948b7b5700 1 -- 172.21.15.184:0/3678036337 shutdown_connections 2024-02-05T07:12:29.265 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.265+0000 7f948b7b5700 1 -- 172.21.15.184:0/3678036337 >> 172.21.15.184:0/3678036337 conn(0x7f94840fffe0 msgr2=0x7f9484102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:29.265 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.265+0000 7f948b7b5700 1 -- 172.21.15.184:0/3678036337 shutdown_connections 2024-02-05T07:12:29.265 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.265+0000 7f948b7b5700 1 -- 172.21.15.184:0/3678036337 wait complete. 2024-02-05T07:12:29.265 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.265+0000 7f948b7b5700 1 Processor -- start 2024-02-05T07:12:29.265 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.265+0000 7f948b7b5700 1 -- start start 2024-02-05T07:12:29.265 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.266+0000 7f948b7b5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9484199c70 con 0x7f94841065d0 2024-02-05T07:12:29.265 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.266+0000 7f9489551700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f94841065d0 0x7f9484199560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:38284/0 (socket says 172.21.15.184:38284) 2024-02-05T07:12:29.265 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.266+0000 7f9489551700 1 -- 172.21.15.184:0/3512625224 learned_addr learned my addr 172.21.15.184:0/3512625224 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:29.266 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.266+0000 7f947a7fc700 1 -- 172.21.15.184:0/3512625224 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112987946 0 0) 0x7f9484199c70 con 0x7f94841065d0 2024-02-05T07:12:29.266 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.266+0000 7f947a7fc700 1 -- 172.21.15.184:0/3512625224 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94700054f0 con 0x7f94841065d0 2024-02-05T07:12:29.266 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.266+0000 7f947a7fc700 1 -- 172.21.15.184:0/3512625224 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2643076811 0 0) 0x7f94700054f0 con 0x7f94841065d0 2024-02-05T07:12:29.266 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.266+0000 7f947a7fc700 1 -- 172.21.15.184:0/3512625224 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9484199c70 con 0x7f94841065d0 2024-02-05T07:12:29.266 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.266+0000 7f947a7fc700 1 -- 172.21.15.184:0/3512625224 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9480001080 con 0x7f94841065d0 2024-02-05T07:12:29.266 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.266+0000 7f947a7fc700 1 -- 172.21.15.184:0/3512625224 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1135145277 0 0) 0x7f9484199c70 con 0x7f94841065d0 2024-02-05T07:12:29.266 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.266+0000 7f947a7fc700 1 -- 172.21.15.184:0/3512625224 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9484199e00 con 0x7f94841065d0 2024-02-05T07:12:29.266 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.266+0000 7f948b7b5700 1 -- 172.21.15.184:0/3512625224 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948419a0b0 con 0x7f94841065d0 2024-02-05T07:12:29.266 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.266+0000 7f948b7b5700 1 -- 172.21.15.184:0/3512625224 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f948419dc00 con 0x7f94841065d0 2024-02-05T07:12:29.266 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.266+0000 7f947a7fc700 1 -- 172.21.15.184:0/3512625224 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7f9480005340 con 0x7f94841065d0 2024-02-05T07:12:29.266 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.266+0000 7f947a7fc700 1 -- 172.21.15.184:0/3512625224 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9480006080 con 0x7f94841065d0 2024-02-05T07:12:29.266 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.267+0000 7f947a7fc700 1 -- 172.21.15.184:0/3512625224 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 8) v1 ==== 45897+0+0 (unknown 2671873510 0 0) 0x7f9480007310 con 0x7f94841065d0 2024-02-05T07:12:29.266 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.267+0000 7f948b7b5700 1 -- 172.21.15.184:0/3512625224 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9468005120 con 0x7f94841065d0 2024-02-05T07:12:29.266 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.267+0000 7f947a7fc700 1 -- 172.21.15.184:0/3512625224 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 3316935985 0 0) 0x7f9480047210 con 0x7f94841065d0 2024-02-05T07:12:29.267 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.272+0000 7f947a7fc700 1 -- 172.21.15.184:0/3512625224 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f94800080b0 con 0x7f94841065d0 2024-02-05T07:12:29.267 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:24.469+0000 7f948b7b5700 1 -- 172.21.15.184:0/3512625224 --> v1:172.21.15.184:6800/2693451489 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi184", "addr": "172.21.15.184", "target": ["mon-mgr", ""]}) v1 -- 0x7f9468000b90 con 0x7f947003a110 2024-02-05T07:12:29.267 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:28.672+0000 7f947a7fc700 1 -- 172.21.15.184:0/3512625224 <== mgr.14118 v1:172.21.15.184:6800/2693451489 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (unknown 0 0 2438226024) 0x7f9468000b90 con 0x7f947003a110 2024-02-05T07:12:29.267 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:28.674+0000 7f948b7b5700 1 -- 172.21.15.184:0/3512625224 >> v1:172.21.15.184:6800/2693451489 conn(0x7f947003a110 legacy=0x7f947003c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:29.267 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:28.674+0000 7f948b7b5700 1 -- 172.21.15.184:0/3512625224 >> v1:172.21.15.184:6789/0 conn(0x7f94841065d0 legacy=0x7f9484199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:29.267 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:28.675+0000 7f948b7b5700 1 -- 172.21.15.184:0/3512625224 shutdown_connections 2024-02-05T07:12:29.267 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:28.675+0000 7f948b7b5700 1 -- 172.21.15.184:0/3512625224 >> 172.21.15.184:0/3512625224 conn(0x7f94840fffe0 msgr2=0x7f94841903b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:29.267 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:28.675+0000 7f948b7b5700 1 -- 172.21.15.184:0/3512625224 shutdown_connections 2024-02-05T07:12:29.267 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:28.675+0000 7f948b7b5700 1 -- 172.21.15.184:0/3512625224 wait complete. 2024-02-05T07:12:29.267 INFO:teuthology.orchestra.run.smithi184.stdout:Deploying unmanaged mon service... 2024-02-05T07:12:29.959 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:29 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' 2024-02-05T07:12:29.959 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:29 smithi184 ceph-mon[29861]: Added host smithi184 2024-02-05T07:12:29.959 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:29 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:12:30.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-02-05T07:12:30.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.740+0000 7fe4e2f38700 1 Processor -- start 2024-02-05T07:12:30.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.740+0000 7fe4e2f38700 1 -- start start 2024-02-05T07:12:30.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.740+0000 7fe4e2f38700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe4dc07a370 con 0x7fe4dc07b770 2024-02-05T07:12:30.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.740+0000 7fe4e0cd4700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fe4dc07b770 0x7fe4dc079bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46718/0 (socket says 172.21.15.184:46718) 2024-02-05T07:12:30.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.741+0000 7fe4e0cd4700 1 -- 172.21.15.184:0/3599915128 learned_addr learned my addr 172.21.15.184:0/3599915128 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:30.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.741+0000 7fe4d37fe700 1 -- 172.21.15.184:0/3599915128 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270775964 0 0) 0x7fe4dc07a370 con 0x7fe4dc07b770 2024-02-05T07:12:30.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.741+0000 7fe4d37fe700 1 -- 172.21.15.184:0/3599915128 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c40035b0 con 0x7fe4dc07b770 2024-02-05T07:12:30.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.741+0000 7fe4d37fe700 1 -- 172.21.15.184:0/3599915128 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2238130387 0 0) 0x7fe4c40035b0 con 0x7fe4dc07b770 2024-02-05T07:12:30.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.741+0000 7fe4d37fe700 1 -- 172.21.15.184:0/3599915128 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc07a500 con 0x7fe4dc07b770 2024-02-05T07:12:30.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.741+0000 7fe4d37fe700 1 -- 172.21.15.184:0/3599915128 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fe4d8001900 con 0x7fe4dc07b770 2024-02-05T07:12:30.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.741+0000 7fe4d37fe700 1 -- 172.21.15.184:0/3599915128 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7fe4d8002060 con 0x7fe4dc07b770 2024-02-05T07:12:30.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.741+0000 7fe4d37fe700 1 -- 172.21.15.184:0/3599915128 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fe4d8005ce0 con 0x7fe4dc07b770 2024-02-05T07:12:30.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.742+0000 7fe4e2f38700 1 -- 172.21.15.184:0/3599915128 >> v1:172.21.15.184:6789/0 conn(0x7fe4dc07b770 legacy=0x7fe4dc079bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:30.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.742+0000 7fe4e2f38700 1 -- 172.21.15.184:0/3599915128 shutdown_connections 2024-02-05T07:12:30.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.742+0000 7fe4e2f38700 1 -- 172.21.15.184:0/3599915128 >> 172.21.15.184:0/3599915128 conn(0x7fe4dc1010e0 msgr2=0x7fe4dc103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:30.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.742+0000 7fe4e2f38700 1 -- 172.21.15.184:0/3599915128 shutdown_connections 2024-02-05T07:12:30.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.742+0000 7fe4e2f38700 1 -- 172.21.15.184:0/3599915128 wait complete. 2024-02-05T07:12:30.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.742+0000 7fe4e2f38700 1 Processor -- start 2024-02-05T07:12:30.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.742+0000 7fe4e2f38700 1 -- start start 2024-02-05T07:12:30.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.742+0000 7fe4e2f38700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe4dc19be60 con 0x7fe4dc07b770 2024-02-05T07:12:30.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.743+0000 7fe4e0cd4700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fe4dc07b770 0x7fe4dc19b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46734/0 (socket says 172.21.15.184:46734) 2024-02-05T07:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.743+0000 7fe4e0cd4700 1 -- 172.21.15.184:0/3984775608 learned_addr learned my addr 172.21.15.184:0/3984775608 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.743+0000 7fe4d1ffb700 1 -- 172.21.15.184:0/3984775608 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319113542 0 0) 0x7fe4dc19be60 con 0x7fe4dc07b770 2024-02-05T07:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.743+0000 7fe4d1ffb700 1 -- 172.21.15.184:0/3984775608 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4c40054f0 con 0x7fe4dc07b770 2024-02-05T07:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.743+0000 7fe4d1ffb700 1 -- 172.21.15.184:0/3984775608 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1884706380 0 0) 0x7fe4c40054f0 con 0x7fe4dc07b770 2024-02-05T07:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.743+0000 7fe4d1ffb700 1 -- 172.21.15.184:0/3984775608 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe4dc19be60 con 0x7fe4dc07b770 2024-02-05T07:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.743+0000 7fe4d1ffb700 1 -- 172.21.15.184:0/3984775608 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fe4d8001400 con 0x7fe4dc07b770 2024-02-05T07:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.743+0000 7fe4d1ffb700 1 -- 172.21.15.184:0/3984775608 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3324053572 0 0) 0x7fe4dc19be60 con 0x7fe4dc07b770 2024-02-05T07:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.743+0000 7fe4d1ffb700 1 -- 172.21.15.184:0/3984775608 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4dc19bff0 con 0x7fe4dc07b770 2024-02-05T07:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.743+0000 7fe4e2f38700 1 -- 172.21.15.184:0/3984775608 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4dc19c2a0 con 0x7fe4dc07b770 2024-02-05T07:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.743+0000 7fe4d1ffb700 1 -- 172.21.15.184:0/3984775608 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7fe4d8004dc0 con 0x7fe4dc07b770 2024-02-05T07:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.743+0000 7fe4d1ffb700 1 -- 172.21.15.184:0/3984775608 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fe4d80065b0 con 0x7fe4dc07b770 2024-02-05T07:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.743+0000 7fe4e2f38700 1 -- 172.21.15.184:0/3984775608 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc19fdf0 con 0x7fe4dc07b770 2024-02-05T07:12:30.786 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.744+0000 7fe4d1ffb700 1 -- 172.21.15.184:0/3984775608 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 8) v1 ==== 45897+0+0 (unknown 2671873510 0 0) 0x7fe4d8011bc0 con 0x7fe4dc07b770 2024-02-05T07:12:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.744+0000 7fe4d1ffb700 1 -- 172.21.15.184:0/3984775608 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 3316935985 0 0) 0x7fe4d8047750 con 0x7fe4dc07b770 2024-02-05T07:12:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.744+0000 7fe4e2f38700 1 -- 172.21.15.184:0/3984775608 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc063350 con 0x7fe4dc07b770 2024-02-05T07:12:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.749+0000 7fe4d1ffb700 1 -- 172.21.15.184:0/3984775608 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fe4d8013840 con 0x7fe4dc07b770 2024-02-05T07:12:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.957+0000 7fe4e2f38700 1 -- 172.21.15.184:0/3984775608 --> v1:172.21.15.184:6800/2693451489 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fe4dc10bd70 con 0x7fe4c403a0d0 2024-02-05T07:12:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.961+0000 7fe4d1ffb700 1 -- 172.21.15.184:0/3984775608 <== mgr.14118 v1:172.21.15.184:6800/2693451489 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (unknown 0 0 3265049985) 0x7fe4dc10bd70 con 0x7fe4c403a0d0 2024-02-05T07:12:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.963+0000 7fe4e2f38700 1 -- 172.21.15.184:0/3984775608 >> v1:172.21.15.184:6800/2693451489 conn(0x7fe4c403a0d0 legacy=0x7fe4c403c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.963+0000 7fe4e2f38700 1 -- 172.21.15.184:0/3984775608 >> v1:172.21.15.184:6789/0 conn(0x7fe4dc07b770 legacy=0x7fe4dc19b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.963+0000 7fe4e2f38700 1 -- 172.21.15.184:0/3984775608 shutdown_connections 2024-02-05T07:12:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.963+0000 7fe4e2f38700 1 -- 172.21.15.184:0/3984775608 >> 172.21.15.184:0/3984775608 conn(0x7fe4dc1010e0 msgr2=0x7fe4dc109ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.963+0000 7fe4e2f38700 1 -- 172.21.15.184:0/3984775608 shutdown_connections 2024-02-05T07:12:30.787 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:29.964+0000 7fe4e2f38700 1 -- 172.21.15.184:0/3984775608 wait complete. 2024-02-05T07:12:30.788 INFO:teuthology.orchestra.run.smithi184.stdout:Deploying unmanaged mgr service... 2024-02-05T07:12:31.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:30 smithi184 ceph-mon[29861]: from='client.14140 v1:172.21.15.184:0/3984775608' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:12:31.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:30 smithi184 ceph-mon[29861]: Saving service mon spec with placement count:5 2024-02-05T07:12:31.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:30 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' 2024-02-05T07:12:32.553 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-02-05T07:12:32.553 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.664+0000 7ffb5c11e700 1 Processor -- start 2024-02-05T07:12:32.553 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.664+0000 7ffb5c11e700 1 -- start start 2024-02-05T07:12:32.553 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.664+0000 7ffb5c11e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ffb54109f30 con 0x7ffb54105b00 2024-02-05T07:12:32.553 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.664+0000 7ffb59eba700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7ffb54105b00 0x7ffb54105f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46746/0 (socket says 172.21.15.184:46746) 2024-02-05T07:12:32.553 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.664+0000 7ffb59eba700 1 -- 172.21.15.184:0/487476919 learned_addr learned my addr 172.21.15.184:0/487476919 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:32.553 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.664+0000 7ffb58eb8700 1 -- 172.21.15.184:0/487476919 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3958667628 0 0) 0x7ffb54109f30 con 0x7ffb54105b00 2024-02-05T07:12:32.553 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.664+0000 7ffb58eb8700 1 -- 172.21.15.184:0/487476919 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb400035b0 con 0x7ffb54105b00 2024-02-05T07:12:32.554 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.665+0000 7ffb58eb8700 1 -- 172.21.15.184:0/487476919 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3350836410 0 0) 0x7ffb400035b0 con 0x7ffb54105b00 2024-02-05T07:12:32.554 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.665+0000 7ffb58eb8700 1 -- 172.21.15.184:0/487476919 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5410b0d0 con 0x7ffb54105b00 2024-02-05T07:12:32.554 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.665+0000 7ffb58eb8700 1 -- 172.21.15.184:0/487476919 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7ffb50001580 con 0x7ffb54105b00 2024-02-05T07:12:32.554 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.665+0000 7ffb58eb8700 1 -- 172.21.15.184:0/487476919 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7ffb50001c10 con 0x7ffb54105b00 2024-02-05T07:12:32.554 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.665+0000 7ffb58eb8700 1 -- 172.21.15.184:0/487476919 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7ffb50005780 con 0x7ffb54105b00 2024-02-05T07:12:32.554 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.665+0000 7ffb5c11e700 1 -- 172.21.15.184:0/487476919 >> v1:172.21.15.184:6789/0 conn(0x7ffb54105b00 legacy=0x7ffb54105f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:32.554 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.665+0000 7ffb5c11e700 1 -- 172.21.15.184:0/487476919 shutdown_connections 2024-02-05T07:12:32.554 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.665+0000 7ffb5c11e700 1 -- 172.21.15.184:0/487476919 >> 172.21.15.184:0/487476919 conn(0x7ffb541010e0 msgr2=0x7ffb54103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:32.554 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.665+0000 7ffb5c11e700 1 -- 172.21.15.184:0/487476919 shutdown_connections 2024-02-05T07:12:32.554 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.665+0000 7ffb5c11e700 1 -- 172.21.15.184:0/487476919 wait complete. 2024-02-05T07:12:32.554 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.666+0000 7ffb5c11e700 1 Processor -- start 2024-02-05T07:12:32.554 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.666+0000 7ffb5c11e700 1 -- start start 2024-02-05T07:12:32.554 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.666+0000 7ffb5c11e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ffb5419f5b0 con 0x7ffb54105b00 2024-02-05T07:12:32.555 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.666+0000 7ffb59eba700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7ffb54105b00 0x7ffb5407b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46754/0 (socket says 172.21.15.184:46754) 2024-02-05T07:12:32.555 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.666+0000 7ffb59eba700 1 -- 172.21.15.184:0/4101704905 learned_addr learned my addr 172.21.15.184:0/4101704905 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:32.555 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.666+0000 7ffb4affd700 1 -- 172.21.15.184:0/4101704905 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932637390 0 0) 0x7ffb5419f5b0 con 0x7ffb54105b00 2024-02-05T07:12:32.555 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.666+0000 7ffb4affd700 1 -- 172.21.15.184:0/4101704905 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb40005540 con 0x7ffb54105b00 2024-02-05T07:12:32.555 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.667+0000 7ffb4affd700 1 -- 172.21.15.184:0/4101704905 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1809142425 0 0) 0x7ffb40005540 con 0x7ffb54105b00 2024-02-05T07:12:32.555 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.667+0000 7ffb4affd700 1 -- 172.21.15.184:0/4101704905 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffb5419f5b0 con 0x7ffb54105b00 2024-02-05T07:12:32.555 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.667+0000 7ffb4affd700 1 -- 172.21.15.184:0/4101704905 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7ffb50001080 con 0x7ffb54105b00 2024-02-05T07:12:32.555 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.667+0000 7ffb4affd700 1 -- 172.21.15.184:0/4101704905 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1306986433 0 0) 0x7ffb5419f5b0 con 0x7ffb54105b00 2024-02-05T07:12:32.555 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.667+0000 7ffb4affd700 1 -- 172.21.15.184:0/4101704905 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb541a0750 con 0x7ffb54105b00 2024-02-05T07:12:32.555 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.667+0000 7ffb5c11e700 1 -- 172.21.15.184:0/4101704905 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb5419f7a0 con 0x7ffb54105b00 2024-02-05T07:12:32.555 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.667+0000 7ffb5c11e700 1 -- 172.21.15.184:0/4101704905 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5419fca0 con 0x7ffb54105b00 2024-02-05T07:12:32.555 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.667+0000 7ffb4affd700 1 -- 172.21.15.184:0/4101704905 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 1670703156 0 0) 0x7ffb50001a90 con 0x7ffb54105b00 2024-02-05T07:12:32.555 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.667+0000 7ffb4affd700 1 -- 172.21.15.184:0/4101704905 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7ffb50006120 con 0x7ffb54105b00 2024-02-05T07:12:32.555 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.668+0000 7ffb4affd700 1 -- 172.21.15.184:0/4101704905 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 8) v1 ==== 45897+0+0 (unknown 2671873510 0 0) 0x7ffb50011600 con 0x7ffb54105b00 2024-02-05T07:12:32.556 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.668+0000 7ffb5c11e700 1 -- 172.21.15.184:0/4101704905 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb38005150 con 0x7ffb54105b00 2024-02-05T07:12:32.556 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.668+0000 7ffb4affd700 1 -- 172.21.15.184:0/4101704905 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 3316935985 0 0) 0x7ffb50047360 con 0x7ffb54105b00 2024-02-05T07:12:32.556 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.673+0000 7ffb4affd700 1 -- 172.21.15.184:0/4101704905 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7ffb50012eb0 con 0x7ffb54105b00 2024-02-05T07:12:32.556 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.885+0000 7ffb5c11e700 1 -- 172.21.15.184:0/4101704905 --> v1:172.21.15.184:6800/2693451489 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ffb38000bc0 con 0x7ffb4003a0b0 2024-02-05T07:12:32.556 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.889+0000 7ffb4affd700 1 -- 172.21.15.184:0/4101704905 <== mgr.14118 v1:172.21.15.184:6800/2693451489 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (unknown 0 0 325935098) 0x7ffb38000bc0 con 0x7ffb4003a0b0 2024-02-05T07:12:32.556 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.892+0000 7ffb5c11e700 1 -- 172.21.15.184:0/4101704905 >> v1:172.21.15.184:6800/2693451489 conn(0x7ffb4003a0b0 legacy=0x7ffb4003c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:32.556 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.892+0000 7ffb5c11e700 1 -- 172.21.15.184:0/4101704905 >> v1:172.21.15.184:6789/0 conn(0x7ffb54105b00 legacy=0x7ffb5407b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:32.556 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.892+0000 7ffb5c11e700 1 -- 172.21.15.184:0/4101704905 shutdown_connections 2024-02-05T07:12:32.556 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.892+0000 7ffb5c11e700 1 -- 172.21.15.184:0/4101704905 >> 172.21.15.184:0/4101704905 conn(0x7ffb541010e0 msgr2=0x7ffb54190360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:32.556 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.892+0000 7ffb5c11e700 1 -- 172.21.15.184:0/4101704905 shutdown_connections 2024-02-05T07:12:32.556 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:31.892+0000 7ffb5c11e700 1 -- 172.21.15.184:0/4101704905 wait complete. 2024-02-05T07:12:32.974 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:32 smithi184 ceph-mon[29861]: from='client.14142 v1:172.21.15.184:0/4101704905' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:12:32.974 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:32 smithi184 ceph-mon[29861]: Saving service mgr spec with placement count:2 2024-02-05T07:12:32.974 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:32 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' 2024-02-05T07:12:32.974 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:32 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' 2024-02-05T07:12:32.974 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:32 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' 2024-02-05T07:12:34.481 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/68534095' entity='client.admin' 2024-02-05T07:12:34.481 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:34 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' 2024-02-05T07:12:34.488 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.012+0000 7f3567af4700 1 Processor -- start 2024-02-05T07:12:34.488 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.012+0000 7f3567af4700 1 -- start start 2024-02-05T07:12:34.488 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.012+0000 7f3567af4700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3560109ef0 con 0x7f3560105ac0 2024-02-05T07:12:34.488 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.013+0000 7f3565890700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f3560105ac0 0x7f3560105ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46764/0 (socket says 172.21.15.184:46764) 2024-02-05T07:12:34.488 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.013+0000 7f3565890700 1 -- 172.21.15.184:0/1609153094 learned_addr learned my addr 172.21.15.184:0/1609153094 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:34.488 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.013+0000 7f356488e700 1 -- 172.21.15.184:0/1609153094 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690079272 0 0) 0x7f3560109ef0 con 0x7f3560105ac0 2024-02-05T07:12:34.488 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.013+0000 7f356488e700 1 -- 172.21.15.184:0/1609153094 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f354c0035b0 con 0x7f3560105ac0 2024-02-05T07:12:34.488 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.013+0000 7f356488e700 1 -- 172.21.15.184:0/1609153094 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 145409059 0 0) 0x7f354c0035b0 con 0x7f3560105ac0 2024-02-05T07:12:34.488 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.013+0000 7f356488e700 1 -- 172.21.15.184:0/1609153094 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356010b090 con 0x7f3560105ac0 2024-02-05T07:12:34.489 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.013+0000 7f356488e700 1 -- 172.21.15.184:0/1609153094 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f355c001580 con 0x7f3560105ac0 2024-02-05T07:12:34.489 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.013+0000 7f356488e700 1 -- 172.21.15.184:0/1609153094 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f355c001d00 con 0x7f3560105ac0 2024-02-05T07:12:34.489 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.013+0000 7f356488e700 1 -- 172.21.15.184:0/1609153094 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f355c005960 con 0x7f3560105ac0 2024-02-05T07:12:34.489 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.014+0000 7f3567af4700 1 -- 172.21.15.184:0/1609153094 >> v1:172.21.15.184:6789/0 conn(0x7f3560105ac0 legacy=0x7f3560105ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:34.489 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.014+0000 7f3567af4700 1 -- 172.21.15.184:0/1609153094 shutdown_connections 2024-02-05T07:12:34.489 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.014+0000 7f3567af4700 1 -- 172.21.15.184:0/1609153094 >> 172.21.15.184:0/1609153094 conn(0x7f3560101060 msgr2=0x7f35601034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:34.489 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.014+0000 7f3567af4700 1 -- 172.21.15.184:0/1609153094 shutdown_connections 2024-02-05T07:12:34.489 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.014+0000 7f3567af4700 1 -- 172.21.15.184:0/1609153094 wait complete. 2024-02-05T07:12:34.489 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.015+0000 7f3567af4700 1 Processor -- start 2024-02-05T07:12:34.489 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.015+0000 7f3567af4700 1 -- start start 2024-02-05T07:12:34.489 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.015+0000 7f3567af4700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3560199bc0 con 0x7f3560105ac0 2024-02-05T07:12:34.489 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.015+0000 7f3565890700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f3560105ac0 0x7f35601994b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46772/0 (socket says 172.21.15.184:46772) 2024-02-05T07:12:34.489 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.015+0000 7f3565890700 1 -- 172.21.15.184:0/68534095 learned_addr learned my addr 172.21.15.184:0/68534095 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:34.489 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.015+0000 7f3556ffd700 1 -- 172.21.15.184:0/68534095 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988993203 0 0) 0x7f3560199bc0 con 0x7f3560105ac0 2024-02-05T07:12:34.490 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.015+0000 7f3556ffd700 1 -- 172.21.15.184:0/68534095 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f354c0054f0 con 0x7f3560105ac0 2024-02-05T07:12:34.490 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.015+0000 7f3556ffd700 1 -- 172.21.15.184:0/68534095 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1877391471 0 0) 0x7f354c0054f0 con 0x7f3560105ac0 2024-02-05T07:12:34.490 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.015+0000 7f3556ffd700 1 -- 172.21.15.184:0/68534095 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3560199bc0 con 0x7f3560105ac0 2024-02-05T07:12:34.490 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.015+0000 7f3556ffd700 1 -- 172.21.15.184:0/68534095 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f355c001080 con 0x7f3560105ac0 2024-02-05T07:12:34.490 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.015+0000 7f3556ffd700 1 -- 172.21.15.184:0/68534095 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3746976744 0 0) 0x7f3560199bc0 con 0x7f3560105ac0 2024-02-05T07:12:34.490 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.015+0000 7f3556ffd700 1 -- 172.21.15.184:0/68534095 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3560199d50 con 0x7f3560105ac0 2024-02-05T07:12:34.490 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.015+0000 7f3567af4700 1 -- 172.21.15.184:0/68534095 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356019a000 con 0x7f3560105ac0 2024-02-05T07:12:34.490 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.016+0000 7f3567af4700 1 -- 172.21.15.184:0/68534095 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f356019db50 con 0x7f3560105ac0 2024-02-05T07:12:34.490 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.016+0000 7f3556ffd700 1 -- 172.21.15.184:0/68534095 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f355c005940 con 0x7f3560105ac0 2024-02-05T07:12:34.490 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.016+0000 7f3556ffd700 1 -- 172.21.15.184:0/68534095 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f355c006230 con 0x7f3560105ac0 2024-02-05T07:12:34.490 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.016+0000 7f3567af4700 1 -- 172.21.15.184:0/68534095 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3544005150 con 0x7f3560105ac0 2024-02-05T07:12:34.490 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.016+0000 7f3556ffd700 1 -- 172.21.15.184:0/68534095 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 8) v1 ==== 45897+0+0 (unknown 2671873510 0 0) 0x7f355c011710 con 0x7f3560105ac0 2024-02-05T07:12:34.490 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.017+0000 7f3556ffd700 1 -- 172.21.15.184:0/68534095 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 3316935985 0 0) 0x7f355c0474d0 con 0x7f3560105ac0 2024-02-05T07:12:34.491 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.021+0000 7f3556ffd700 1 -- 172.21.15.184:0/68534095 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f355c012f70 con 0x7f3560105ac0 2024-02-05T07:12:34.491 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.237+0000 7f3567af4700 1 -- 172.21.15.184:0/68534095 --> v1:172.21.15.184:6789/0 -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f3544005400 con 0x7f3560105ac0 2024-02-05T07:12:34.491 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.239+0000 7f3556ffd700 1 -- 172.21.15.184:0/68534095 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (unknown 2684808024 0 0) 0x7f355c015050 con 0x7f3560105ac0 2024-02-05T07:12:34.491 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.242+0000 7f3567af4700 1 -- 172.21.15.184:0/68534095 >> v1:172.21.15.184:6800/2693451489 conn(0x7f354c03a120 legacy=0x7f354c03c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:34.491 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.242+0000 7f3567af4700 1 -- 172.21.15.184:0/68534095 >> v1:172.21.15.184:6789/0 conn(0x7f3560105ac0 legacy=0x7f35601994b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:34.491 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.242+0000 7f3567af4700 1 -- 172.21.15.184:0/68534095 shutdown_connections 2024-02-05T07:12:34.491 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.242+0000 7f3567af4700 1 -- 172.21.15.184:0/68534095 >> 172.21.15.184:0/68534095 conn(0x7f3560101060 msgr2=0x7f35601034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:34.491 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.242+0000 7f3567af4700 1 -- 172.21.15.184:0/68534095 shutdown_connections 2024-02-05T07:12:34.491 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:33.242+0000 7f3567af4700 1 -- 172.21.15.184:0/68534095 wait complete. 2024-02-05T07:12:36.029 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.958+0000 7f28f0b72700 1 Processor -- start 2024-02-05T07:12:36.029 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.958+0000 7f28f0b72700 1 -- start start 2024-02-05T07:12:36.029 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.958+0000 7f28f0b72700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f28ec10a000 con 0x7f28ec103da0 2024-02-05T07:12:36.029 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.958+0000 7f28ea59c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f28ec103da0 0x7f28ec1041c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46782/0 (socket says 172.21.15.184:46782) 2024-02-05T07:12:36.029 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.958+0000 7f28ea59c700 1 -- 172.21.15.184:0/4070675530 learned_addr learned my addr 172.21.15.184:0/4070675530 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:36.029 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.958+0000 7f28e959a700 1 -- 172.21.15.184:0/4070675530 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762597274 0 0) 0x7f28ec10a000 con 0x7f28ec103da0 2024-02-05T07:12:36.030 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.958+0000 7f28e959a700 1 -- 172.21.15.184:0/4070675530 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d40035b0 con 0x7f28ec103da0 2024-02-05T07:12:36.030 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.959+0000 7f28e959a700 1 -- 172.21.15.184:0/4070675530 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1173437849 0 0) 0x7f28d40035b0 con 0x7f28ec103da0 2024-02-05T07:12:36.030 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.959+0000 7f28e959a700 1 -- 172.21.15.184:0/4070675530 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec10b1a0 con 0x7f28ec103da0 2024-02-05T07:12:36.030 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.959+0000 7f28e959a700 1 -- 172.21.15.184:0/4070675530 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f28e0001580 con 0x7f28ec103da0 2024-02-05T07:12:36.030 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.959+0000 7f28e959a700 1 -- 172.21.15.184:0/4070675530 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f28e0001d00 con 0x7f28ec103da0 2024-02-05T07:12:36.030 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.959+0000 7f28e959a700 1 -- 172.21.15.184:0/4070675530 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f28e0005960 con 0x7f28ec103da0 2024-02-05T07:12:36.030 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.959+0000 7f28f0b72700 1 -- 172.21.15.184:0/4070675530 >> v1:172.21.15.184:6789/0 conn(0x7f28ec103da0 legacy=0x7f28ec1041c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:36.030 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.959+0000 7f28f0b72700 1 -- 172.21.15.184:0/4070675530 shutdown_connections 2024-02-05T07:12:36.030 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.959+0000 7f28f0b72700 1 -- 172.21.15.184:0/4070675530 >> 172.21.15.184:0/4070675530 conn(0x7f28ec0ff6f0 msgr2=0x7f28ec101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:36.030 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.959+0000 7f28f0b72700 1 -- 172.21.15.184:0/4070675530 shutdown_connections 2024-02-05T07:12:36.030 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.959+0000 7f28f0b72700 1 -- 172.21.15.184:0/4070675530 wait complete. 2024-02-05T07:12:36.030 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.960+0000 7f28f0b72700 1 Processor -- start 2024-02-05T07:12:36.030 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.960+0000 7f28f0b72700 1 -- start start 2024-02-05T07:12:36.030 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.960+0000 7f28f0b72700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f28ec19f600 con 0x7f28ec103da0 2024-02-05T07:12:36.031 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.960+0000 7f28ea59c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f28ec103da0 0x7f28ec106650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46798/0 (socket says 172.21.15.184:46798) 2024-02-05T07:12:36.031 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.960+0000 7f28ea59c700 1 -- 172.21.15.184:0/756440525 learned_addr learned my addr 172.21.15.184:0/756440525 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:36.031 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.961+0000 7f28db7fe700 1 -- 172.21.15.184:0/756440525 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3770288850 0 0) 0x7f28ec19f600 con 0x7f28ec103da0 2024-02-05T07:12:36.031 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.961+0000 7f28db7fe700 1 -- 172.21.15.184:0/756440525 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d40054f0 con 0x7f28ec103da0 2024-02-05T07:12:36.031 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.961+0000 7f28db7fe700 1 -- 172.21.15.184:0/756440525 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 693486932 0 0) 0x7f28d40054f0 con 0x7f28ec103da0 2024-02-05T07:12:36.031 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.961+0000 7f28db7fe700 1 -- 172.21.15.184:0/756440525 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f28ec19f600 con 0x7f28ec103da0 2024-02-05T07:12:36.031 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.961+0000 7f28db7fe700 1 -- 172.21.15.184:0/756440525 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f28e0001080 con 0x7f28ec103da0 2024-02-05T07:12:36.031 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.961+0000 7f28db7fe700 1 -- 172.21.15.184:0/756440525 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1064582250 0 0) 0x7f28ec19f600 con 0x7f28ec103da0 2024-02-05T07:12:36.031 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.961+0000 7f28db7fe700 1 -- 172.21.15.184:0/756440525 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec1a07a0 con 0x7f28ec103da0 2024-02-05T07:12:36.031 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.961+0000 7f28f0b72700 1 -- 172.21.15.184:0/756440525 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ec19f7f0 con 0x7f28ec103da0 2024-02-05T07:12:36.031 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.961+0000 7f28f0b72700 1 -- 172.21.15.184:0/756440525 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ec19fcf0 con 0x7f28ec103da0 2024-02-05T07:12:36.031 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.961+0000 7f28db7fe700 1 -- 172.21.15.184:0/756440525 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f28e0004a60 con 0x7f28ec103da0 2024-02-05T07:12:36.031 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.961+0000 7f28db7fe700 1 -- 172.21.15.184:0/756440525 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f28e00060d0 con 0x7f28ec103da0 2024-02-05T07:12:36.032 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.962+0000 7f28f0b72700 1 -- 172.21.15.184:0/756440525 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28cc005150 con 0x7f28ec103da0 2024-02-05T07:12:36.032 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.962+0000 7f28db7fe700 1 -- 172.21.15.184:0/756440525 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 8) v1 ==== 45897+0+0 (unknown 2671873510 0 0) 0x7f28e0011690 con 0x7f28ec103da0 2024-02-05T07:12:36.032 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.962+0000 7f28db7fe700 1 -- 172.21.15.184:0/756440525 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 3316935985 0 0) 0x7f28e0047330 con 0x7f28ec103da0 2024-02-05T07:12:36.032 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:34.967+0000 7f28db7fe700 1 -- 172.21.15.184:0/756440525 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f28e0012f40 con 0x7f28ec103da0 2024-02-05T07:12:36.032 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:35.164+0000 7f28f0b72700 1 -- 172.21.15.184:0/756440525 --> v1:172.21.15.184:6789/0 -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f28cc005980 con 0x7f28ec103da0 2024-02-05T07:12:36.032 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:35.167+0000 7f28db7fe700 1 -- 172.21.15.184:0/756440525 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (unknown 1496729260 0 0) 0x7f28e0015040 con 0x7f28ec103da0 2024-02-05T07:12:36.032 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:35.169+0000 7f28f0b72700 1 -- 172.21.15.184:0/756440525 >> v1:172.21.15.184:6800/2693451489 conn(0x7f28d403a0d0 legacy=0x7f28d403c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:36.032 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:35.169+0000 7f28f0b72700 1 -- 172.21.15.184:0/756440525 >> v1:172.21.15.184:6789/0 conn(0x7f28ec103da0 legacy=0x7f28ec106650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:36.032 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:35.170+0000 7f28f0b72700 1 -- 172.21.15.184:0/756440525 shutdown_connections 2024-02-05T07:12:36.032 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:35.170+0000 7f28f0b72700 1 -- 172.21.15.184:0/756440525 >> 172.21.15.184:0/756440525 conn(0x7f28ec0ff6f0 msgr2=0x7f28ec190390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:36.032 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:35.170+0000 7f28f0b72700 1 -- 172.21.15.184:0/756440525 shutdown_connections 2024-02-05T07:12:36.032 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:35.170+0000 7f28f0b72700 1 -- 172.21.15.184:0/756440525 wait complete. 2024-02-05T07:12:36.032 INFO:teuthology.orchestra.run.smithi184.stdout:Enabling the dashboard module... 2024-02-05T07:12:36.293 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/756440525' entity='client.admin' 2024-02-05T07:12:36.293 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:36 smithi184 ceph-mon[29861]: from='mgr.14118 v1:172.21.15.184:0/3468866972' entity='mgr.y' 2024-02-05T07:12:37.188 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3514685444' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-05T07:12:37.188 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:37 smithi184 ceph-mon[29861]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:12:37.483 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:37 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ignoring --setuser ceph since I am not root 2024-02-05T07:12:37.483 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:37 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ignoring --setgroup ceph since I am not root 2024-02-05T07:12:37.781 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.517+0000 7f0a669df700 1 Processor -- start 2024-02-05T07:12:37.781 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.517+0000 7f0a669df700 1 -- start start 2024-02-05T07:12:37.782 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.517+0000 7f0a669df700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0a60109f50 con 0x7f0a60105b20 2024-02-05T07:12:37.782 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.517+0000 7f0a5ffff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f0a60105b20 0x7f0a60105f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46802/0 (socket says 172.21.15.184:46802) 2024-02-05T07:12:37.782 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.517+0000 7f0a5ffff700 1 -- 172.21.15.184:0/2990723071 learned_addr learned my addr 172.21.15.184:0/2990723071 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:37.782 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.518+0000 7f0a5effd700 1 -- 172.21.15.184:0/2990723071 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673580733 0 0) 0x7f0a60109f50 con 0x7f0a60105b20 2024-02-05T07:12:37.782 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.518+0000 7f0a5effd700 1 -- 172.21.15.184:0/2990723071 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a480035b0 con 0x7f0a60105b20 2024-02-05T07:12:37.782 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.518+0000 7f0a5effd700 1 -- 172.21.15.184:0/2990723071 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 790060438 0 0) 0x7f0a480035b0 con 0x7f0a60105b20 2024-02-05T07:12:37.782 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.518+0000 7f0a5effd700 1 -- 172.21.15.184:0/2990723071 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a6010b0f0 con 0x7f0a60105b20 2024-02-05T07:12:37.782 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.518+0000 7f0a5effd700 1 -- 172.21.15.184:0/2990723071 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f0a50001580 con 0x7f0a60105b20 2024-02-05T07:12:37.782 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.518+0000 7f0a5effd700 1 -- 172.21.15.184:0/2990723071 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f0a50001d00 con 0x7f0a60105b20 2024-02-05T07:12:37.782 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.518+0000 7f0a5effd700 1 -- 172.21.15.184:0/2990723071 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f0a50005960 con 0x7f0a60105b20 2024-02-05T07:12:37.782 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.519+0000 7f0a669df700 1 -- 172.21.15.184:0/2990723071 >> v1:172.21.15.184:6789/0 conn(0x7f0a60105b20 legacy=0x7f0a60105f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:37.782 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.519+0000 7f0a669df700 1 -- 172.21.15.184:0/2990723071 shutdown_connections 2024-02-05T07:12:37.782 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.519+0000 7f0a669df700 1 -- 172.21.15.184:0/2990723071 >> 172.21.15.184:0/2990723071 conn(0x7f0a601010c0 msgr2=0x7f0a60103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:37.782 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.519+0000 7f0a669df700 1 -- 172.21.15.184:0/2990723071 shutdown_connections 2024-02-05T07:12:37.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.519+0000 7f0a669df700 1 -- 172.21.15.184:0/2990723071 wait complete. 2024-02-05T07:12:37.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.520+0000 7f0a669df700 1 Processor -- start 2024-02-05T07:12:37.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.520+0000 7f0a669df700 1 -- start start 2024-02-05T07:12:37.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.520+0000 7f0a669df700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0a60199ca0 con 0x7f0a60105b20 2024-02-05T07:12:37.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.520+0000 7f0a5ffff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f0a60105b20 0x7f0a60199590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46806/0 (socket says 172.21.15.184:46806) 2024-02-05T07:12:37.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.520+0000 7f0a5ffff700 1 -- 172.21.15.184:0/3514685444 learned_addr learned my addr 172.21.15.184:0/3514685444 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:37.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.520+0000 7f0a5d7fa700 1 -- 172.21.15.184:0/3514685444 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286570593 0 0) 0x7f0a60199ca0 con 0x7f0a60105b20 2024-02-05T07:12:37.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.520+0000 7f0a5d7fa700 1 -- 172.21.15.184:0/3514685444 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a480054f0 con 0x7f0a60105b20 2024-02-05T07:12:37.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.520+0000 7f0a5d7fa700 1 -- 172.21.15.184:0/3514685444 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3859414371 0 0) 0x7f0a480054f0 con 0x7f0a60105b20 2024-02-05T07:12:37.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.521+0000 7f0a5d7fa700 1 -- 172.21.15.184:0/3514685444 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0a60199ca0 con 0x7f0a60105b20 2024-02-05T07:12:37.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.521+0000 7f0a5d7fa700 1 -- 172.21.15.184:0/3514685444 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f0a50001080 con 0x7f0a60105b20 2024-02-05T07:12:37.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.521+0000 7f0a5d7fa700 1 -- 172.21.15.184:0/3514685444 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 144318301 0 0) 0x7f0a60199ca0 con 0x7f0a60105b20 2024-02-05T07:12:37.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.521+0000 7f0a5d7fa700 1 -- 172.21.15.184:0/3514685444 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a60199e30 con 0x7f0a60105b20 2024-02-05T07:12:37.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.521+0000 7f0a669df700 1 -- 172.21.15.184:0/3514685444 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a6019a0e0 con 0x7f0a60105b20 2024-02-05T07:12:37.783 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.521+0000 7f0a669df700 1 -- 172.21.15.184:0/3514685444 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a6019dc30 con 0x7f0a60105b20 2024-02-05T07:12:37.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.521+0000 7f0a5d7fa700 1 -- 172.21.15.184:0/3514685444 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f0a500049f0 con 0x7f0a60105b20 2024-02-05T07:12:37.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.521+0000 7f0a5d7fa700 1 -- 172.21.15.184:0/3514685444 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f0a50006180 con 0x7f0a60105b20 2024-02-05T07:12:37.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.522+0000 7f0a5d7fa700 1 -- 172.21.15.184:0/3514685444 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 8) v1 ==== 45897+0+0 (unknown 2671873510 0 0) 0x7f0a50011660 con 0x7f0a60105b20 2024-02-05T07:12:37.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.522+0000 7f0a669df700 1 -- 172.21.15.184:0/3514685444 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4c005150 con 0x7f0a60105b20 2024-02-05T07:12:37.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.522+0000 7f0a5d7fa700 1 -- 172.21.15.184:0/3514685444 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 3316935985 0 0) 0x7f0a500481e0 con 0x7f0a60105b20 2024-02-05T07:12:37.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.527+0000 7f0a5d7fa700 1 -- 172.21.15.184:0/3514685444 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f0a50012ec0 con 0x7f0a60105b20 2024-02-05T07:12:37.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:36.800+0000 7f0a669df700 1 -- 172.21.15.184:0/3514685444 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f0a4c005400 con 0x7f0a60105b20 2024-02-05T07:12:37.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:37.170+0000 7f0a5d7fa700 1 -- 172.21.15.184:0/3514685444 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (unknown 1498667528 0 0) 0x7f0a50014fa0 con 0x7f0a60105b20 2024-02-05T07:12:37.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:37.171+0000 7f0a5d7fa700 1 -- 172.21.15.184:0/3514685444 <== mon.0 v1:172.21.15.184:6789/0 11 ==== mgrmap(e 9) v1 ==== 45910+0+0 (unknown 1967391998 0 0) 0x7f0a50046b80 con 0x7f0a60105b20 2024-02-05T07:12:37.784 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:37.173+0000 7f0a669df700 1 -- 172.21.15.184:0/3514685444 >> v1:172.21.15.184:6800/2693451489 conn(0x7f0a4803a120 legacy=0x7f0a4803c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:37.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:37.173+0000 7f0a669df700 1 -- 172.21.15.184:0/3514685444 >> v1:172.21.15.184:6789/0 conn(0x7f0a60105b20 legacy=0x7f0a60199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:37.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:37.173+0000 7f0a669df700 1 -- 172.21.15.184:0/3514685444 shutdown_connections 2024-02-05T07:12:37.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:37.173+0000 7f0a669df700 1 -- 172.21.15.184:0/3514685444 >> 172.21.15.184:0/3514685444 conn(0x7f0a601010c0 msgr2=0x7f0a60103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:37.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:37.173+0000 7f0a669df700 1 -- 172.21.15.184:0/3514685444 shutdown_connections 2024-02-05T07:12:37.785 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:37.173+0000 7f0a669df700 1 -- 172.21.15.184:0/3514685444 wait complete. 2024-02-05T07:12:38.021 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:37 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:37.745+0000 7f5b7f9c8200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-05T07:12:38.021 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:37 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:37.843+0000 7f5b7f9c8200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-05T07:12:38.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3514685444' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-05T07:12:38.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:38 smithi184 ceph-mon[29861]: mgrmap e9: y(active, since 20s) 2024-02-05T07:12:38.750 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:38 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:38.503+0000 7f5b7f9c8200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-05T07:12:38.750 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:38 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:38.601+0000 7f5b7f9c8200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-05T07:12:38.750 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:38 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:38.748+0000 7f5b7f9c8200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-05T07:12:39.021 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:38 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:38.848+0000 7f5b7f9c8200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-05T07:12:39.021 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:38 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:38.933+0000 7f5b7f9c8200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-05T07:12:39.502 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1485922290' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-05T07:12:39.502 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:39 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:39.204+0000 7f5b7f9c8200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-05T07:12:39.502 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:39 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:39.315+0000 7f5b7f9c8200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-05T07:12:39.502 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:39 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:39.402+0000 7f5b7f9c8200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-05T07:12:39.502 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:39 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:39.499+0000 7f5b7f9c8200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-05T07:12:39.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout { 2024-02-05T07:12:39.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-02-05T07:12:39.533 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-05T07:12:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-02-05T07:12:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-05T07:12:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout } 2024-02-05T07:12:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.547+0000 7fcd2a146700 1 Processor -- start 2024-02-05T07:12:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.547+0000 7fcd2a146700 1 -- start start 2024-02-05T07:12:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.547+0000 7fcd2a146700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcd24079720 con 0x7fcd24106580 2024-02-05T07:12:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.547+0000 7fcd237fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fcd24106580 0x7fcd24108970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:44432/0 (socket says 172.21.15.184:44432) 2024-02-05T07:12:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.547+0000 7fcd237fe700 1 -- 172.21.15.184:0/3862109344 learned_addr learned my addr 172.21.15.184:0/3862109344 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.548+0000 7fcd227fc700 1 -- 172.21.15.184:0/3862109344 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092638016 0 0) 0x7fcd24079720 con 0x7fcd24106580 2024-02-05T07:12:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.548+0000 7fcd227fc700 1 -- 172.21.15.184:0/3862109344 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd0c0035b0 con 0x7fcd24106580 2024-02-05T07:12:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.548+0000 7fcd227fc700 1 -- 172.21.15.184:0/3862109344 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2922479097 0 0) 0x7fcd0c0035b0 con 0x7fcd24106580 2024-02-05T07:12:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.548+0000 7fcd227fc700 1 -- 172.21.15.184:0/3862109344 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2410b0a0 con 0x7fcd24106580 2024-02-05T07:12:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.548+0000 7fcd227fc700 1 -- 172.21.15.184:0/3862109344 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fcd14001580 con 0x7fcd24106580 2024-02-05T07:12:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.548+0000 7fcd227fc700 1 -- 172.21.15.184:0/3862109344 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fcd14001d00 con 0x7fcd24106580 2024-02-05T07:12:39.534 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.548+0000 7fcd227fc700 1 -- 172.21.15.184:0/3862109344 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fcd14005960 con 0x7fcd24106580 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.549+0000 7fcd2a146700 1 -- 172.21.15.184:0/3862109344 >> v1:172.21.15.184:6789/0 conn(0x7fcd24106580 legacy=0x7fcd24108970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.549+0000 7fcd2a146700 1 -- 172.21.15.184:0/3862109344 shutdown_connections 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.549+0000 7fcd2a146700 1 -- 172.21.15.184:0/3862109344 >> 172.21.15.184:0/3862109344 conn(0x7fcd240fff30 msgr2=0x7fcd241023b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.549+0000 7fcd2a146700 1 -- 172.21.15.184:0/3862109344 shutdown_connections 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.549+0000 7fcd2a146700 1 -- 172.21.15.184:0/3862109344 wait complete. 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.549+0000 7fcd2a146700 1 Processor -- start 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.549+0000 7fcd2a146700 1 -- start start 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.550+0000 7fcd2a146700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcd2419f610 con 0x7fcd24106580 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.550+0000 7fcd237fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fcd24106580 0x7fcd24105e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:44440/0 (socket says 172.21.15.184:44440) 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.550+0000 7fcd237fe700 1 -- 172.21.15.184:0/1485922290 learned_addr learned my addr 172.21.15.184:0/1485922290 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.550+0000 7fcd20ff9700 1 -- 172.21.15.184:0/1485922290 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960319740 0 0) 0x7fcd2419f610 con 0x7fcd24106580 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.550+0000 7fcd20ff9700 1 -- 172.21.15.184:0/1485922290 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd0c0054f0 con 0x7fcd24106580 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.550+0000 7fcd20ff9700 1 -- 172.21.15.184:0/1485922290 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4006996040 0 0) 0x7fcd0c0054f0 con 0x7fcd24106580 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.550+0000 7fcd20ff9700 1 -- 172.21.15.184:0/1485922290 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcd2419f610 con 0x7fcd24106580 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.550+0000 7fcd20ff9700 1 -- 172.21.15.184:0/1485922290 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fcd14001080 con 0x7fcd24106580 2024-02-05T07:12:39.535 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.550+0000 7fcd20ff9700 1 -- 172.21.15.184:0/1485922290 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1624044544 0 0) 0x7fcd2419f610 con 0x7fcd24106580 2024-02-05T07:12:39.536 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.550+0000 7fcd20ff9700 1 -- 172.21.15.184:0/1485922290 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd241a07b0 con 0x7fcd24106580 2024-02-05T07:12:39.536 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.550+0000 7fcd2a146700 1 -- 172.21.15.184:0/1485922290 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2419f800 con 0x7fcd24106580 2024-02-05T07:12:39.536 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.551+0000 7fcd20ff9700 1 -- 172.21.15.184:0/1485922290 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fcd14004a60 con 0x7fcd24106580 2024-02-05T07:12:39.536 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.551+0000 7fcd20ff9700 1 -- 172.21.15.184:0/1485922290 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fcd14006220 con 0x7fcd24106580 2024-02-05T07:12:39.536 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.551+0000 7fcd2a146700 1 -- 172.21.15.184:0/1485922290 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2419fd00 con 0x7fcd24106580 2024-02-05T07:12:39.536 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.551+0000 7fcd20ff9700 1 -- 172.21.15.184:0/1485922290 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 9) v1 ==== 45910+0+0 (unknown 1967391998 0 0) 0x7fcd14011850 con 0x7fcd24106580 2024-02-05T07:12:39.536 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.552+0000 7fcd20ff9700 1 -- 172.21.15.184:0/1485922290 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 3316935985 0 0) 0x7fcd14048230 con 0x7fcd24106580 2024-02-05T07:12:39.536 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.552+0000 7fcd22ffd700 1 -- 172.21.15.184:0/1485922290 >> v1:172.21.15.184:6800/2693451489 conn(0x7fcd0c03a180 legacy=0x7fcd0c03c640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/2693451489 2024-02-05T07:12:39.536 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.552+0000 7fcd2a146700 1 -- 172.21.15.184:0/1485922290 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd24063350 con 0x7fcd24106580 2024-02-05T07:12:39.536 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.556+0000 7fcd20ff9700 1 -- 172.21.15.184:0/1485922290 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fcd14016c60 con 0x7fcd24106580 2024-02-05T07:12:39.536 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.753+0000 7fcd22ffd700 1 -- 172.21.15.184:0/1485922290 >> v1:172.21.15.184:6800/2693451489 conn(0x7fcd0c03a180 legacy=0x7fcd0c03c640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/2693451489 2024-02-05T07:12:39.536 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.812+0000 7fcd2a146700 1 -- 172.21.15.184:0/1485922290 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fcd24192cd0 con 0x7fcd24106580 2024-02-05T07:12:39.536 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.813+0000 7fcd20ff9700 1 -- 172.21.15.184:0/1485922290 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (unknown 2005831594 0 1748205903) 0x7fcd14015030 con 0x7fcd24106580 2024-02-05T07:12:39.537 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.815+0000 7fcd2a146700 1 -- 172.21.15.184:0/1485922290 >> v1:172.21.15.184:6800/2693451489 conn(0x7fcd0c03a180 legacy=0x7fcd0c03c640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-05T07:12:39.537 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.815+0000 7fcd2a146700 1 -- 172.21.15.184:0/1485922290 >> v1:172.21.15.184:6789/0 conn(0x7fcd24106580 legacy=0x7fcd24105e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:39.537 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.815+0000 7fcd2a146700 1 -- 172.21.15.184:0/1485922290 shutdown_connections 2024-02-05T07:12:39.537 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.815+0000 7fcd2a146700 1 -- 172.21.15.184:0/1485922290 >> 172.21.15.184:0/1485922290 conn(0x7fcd240fff30 msgr2=0x7fcd24190340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:39.537 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.815+0000 7fcd2a146700 1 -- 172.21.15.184:0/1485922290 shutdown_connections 2024-02-05T07:12:39.537 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:38.815+0000 7fcd2a146700 1 -- 172.21.15.184:0/1485922290 wait complete. 2024-02-05T07:12:39.537 INFO:teuthology.orchestra.run.smithi184.stdout:Waiting for the mgr to restart... 2024-02-05T07:12:39.537 INFO:teuthology.orchestra.run.smithi184.stdout:Waiting for mgr epoch 9... 2024-02-05T07:12:39.760 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:39 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:39.684+0000 7f5b7f9c8200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-05T07:12:41.021 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:40 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:40.689+0000 7f5b7f9c8200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-05T07:12:41.022 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:40 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:40.822+0000 7f5b7f9c8200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-05T07:12:41.419 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:41.161+0000 7f5b7f9c8200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-05T07:12:41.419 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:41.251+0000 7f5b7f9c8200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-05T07:12:41.771 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:41.448+0000 7f5b7f9c8200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-05T07:12:41.771 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:41.638+0000 7f5b7f9c8200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-05T07:12:42.196 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:41.929+0000 7f5b7f9c8200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-05T07:12:42.196 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:42 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:42.193+0000 7f5b7f9c8200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-05T07:12:42.521 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:42 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:42.432+0000 7f5b7f9c8200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-05T07:12:43.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:43 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:43.239+0000 7f5b7f9c8200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-05T07:12:44.137 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:43 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:43.813+0000 7f5b7f9c8200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-05T07:12:44.137 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:43 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:43.913+0000 7f5b7f9c8200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-05T07:12:44.137 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:12:44 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:12:44.134+0000 7f5b7f9c8200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-05T07:12:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:45 smithi184 ceph-mon[29861]: Active manager daemon y restarted 2024-02-05T07:12:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:45 smithi184 ceph-mon[29861]: Activating manager daemon y 2024-02-05T07:12:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:45 smithi184 ceph-mon[29861]: osdmap e3: 0 total, 0 up, 0 in 2024-02-05T07:12:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:45 smithi184 ceph-mon[29861]: mgrmap e10: y(active, starting, since 0.00319836s) 2024-02-05T07:12:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:12:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-05T07:12:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-05T07:12:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-05T07:12:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-05T07:12:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:45 smithi184 ceph-mon[29861]: Manager daemon y is now available 2024-02-05T07:12:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:12:45.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:12:45.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-05T07:12:45.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-05T07:12:45.849 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout { 2024-02-05T07:12:45.850 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-02-05T07:12:45.850 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-05T07:12:45.850 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout } 2024-02-05T07:12:45.850 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.008+0000 7f235e5f8700 1 Processor -- start 2024-02-05T07:12:45.851 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.008+0000 7f235e5f8700 1 -- start start 2024-02-05T07:12:45.851 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.008+0000 7f235e5f8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2358109f40 con 0x7f2358105b10 2024-02-05T07:12:45.851 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.009+0000 7f2357fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2358105b10 0x7f2358105f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:44450/0 (socket says 172.21.15.184:44450) 2024-02-05T07:12:45.851 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.009+0000 7f2357fff700 1 -- 172.21.15.184:0/48531361 learned_addr learned my addr 172.21.15.184:0/48531361 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:45.851 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.009+0000 7f2356ffd700 1 -- 172.21.15.184:0/48531361 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484520591 0 0) 0x7f2358109f40 con 0x7f2358105b10 2024-02-05T07:12:45.851 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.009+0000 7f2356ffd700 1 -- 172.21.15.184:0/48531361 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23400035b0 con 0x7f2358105b10 2024-02-05T07:12:45.851 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.009+0000 7f2356ffd700 1 -- 172.21.15.184:0/48531361 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1556149831 0 0) 0x7f23400035b0 con 0x7f2358105b10 2024-02-05T07:12:45.851 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.009+0000 7f2356ffd700 1 -- 172.21.15.184:0/48531361 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f235810b0e0 con 0x7f2358105b10 2024-02-05T07:12:45.851 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.009+0000 7f2356ffd700 1 -- 172.21.15.184:0/48531361 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f2348001580 con 0x7f2358105b10 2024-02-05T07:12:45.851 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.009+0000 7f2356ffd700 1 -- 172.21.15.184:0/48531361 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f2348001d00 con 0x7f2358105b10 2024-02-05T07:12:45.851 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.009+0000 7f2356ffd700 1 -- 172.21.15.184:0/48531361 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f2348005960 con 0x7f2358105b10 2024-02-05T07:12:45.851 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.010+0000 7f235e5f8700 1 -- 172.21.15.184:0/48531361 >> v1:172.21.15.184:6789/0 conn(0x7f2358105b10 legacy=0x7f2358105f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:45.851 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.010+0000 7f235e5f8700 1 -- 172.21.15.184:0/48531361 shutdown_connections 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.010+0000 7f235e5f8700 1 -- 172.21.15.184:0/48531361 >> 172.21.15.184:0/48531361 conn(0x7f23581010d0 msgr2=0x7f23581034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.010+0000 7f235e5f8700 1 -- 172.21.15.184:0/48531361 shutdown_connections 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.010+0000 7f235e5f8700 1 -- 172.21.15.184:0/48531361 wait complete. 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.011+0000 7f235e5f8700 1 Processor -- start 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.011+0000 7f235e5f8700 1 -- start start 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.011+0000 7f235e5f8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2358199cf0 con 0x7f2358105b10 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.011+0000 7f2357fff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2358105b10 0x7f23581995e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:44458/0 (socket says 172.21.15.184:44458) 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.011+0000 7f2357fff700 1 -- 172.21.15.184:0/1808394438 learned_addr learned my addr 172.21.15.184:0/1808394438 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.012+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024320468 0 0) 0x7f2358199cf0 con 0x7f2358105b10 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.012+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23400054f0 con 0x7f2358105b10 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.012+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1031850892 0 0) 0x7f23400054f0 con 0x7f2358105b10 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.012+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2358199cf0 con 0x7f2358105b10 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.012+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f2348001080 con 0x7f2358105b10 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.012+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3171582167 0 0) 0x7f2358199cf0 con 0x7f2358105b10 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.012+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2358199e80 con 0x7f2358105b10 2024-02-05T07:12:45.852 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.012+0000 7f235e5f8700 1 -- 172.21.15.184:0/1808394438 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235819a130 con 0x7f2358105b10 2024-02-05T07:12:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.012+0000 7f235e5f8700 1 -- 172.21.15.184:0/1808394438 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f235819dc30 con 0x7f2358105b10 2024-02-05T07:12:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.012+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f23480049f0 con 0x7f2358105b10 2024-02-05T07:12:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.012+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f23480061c0 con 0x7f2358105b10 2024-02-05T07:12:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.013+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 9) v1 ==== 45910+0+0 (unknown 1967391998 0 0) 0x7f23480074f0 con 0x7f2358105b10 2024-02-05T07:12:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.014+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 --> v1:172.21.15.184:6800/2693451489 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f234003ddf0 con 0x7f234003a120 2024-02-05T07:12:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.014+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 3316935985 0 0) 0x7f2348047510 con 0x7f2358105b10 2024-02-05T07:12:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.014+0000 7f23577fe700 1 -- 172.21.15.184:0/1808394438 >> v1:172.21.15.184:6800/2693451489 conn(0x7f234003a120 legacy=0x7f234003c5e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/2693451489 2024-02-05T07:12:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.215+0000 7f23577fe700 1 -- 172.21.15.184:0/1808394438 >> v1:172.21.15.184:6800/2693451489 conn(0x7f234003a120 legacy=0x7f234003c5e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/2693451489 2024-02-05T07:12:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:40.616+0000 7f23577fe700 1 -- 172.21.15.184:0/1808394438 >> v1:172.21.15.184:6800/2693451489 conn(0x7f234003a120 legacy=0x7f234003c5e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/2693451489 2024-02-05T07:12:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:41.417+0000 7f23577fe700 1 -- 172.21.15.184:0/1808394438 >> v1:172.21.15.184:6800/2693451489 conn(0x7f234003a120 legacy=0x7f234003c5e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/2693451489 2024-02-05T07:12:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:43.018+0000 7f23577fe700 1 -- 172.21.15.184:0/1808394438 >> v1:172.21.15.184:6800/2693451489 conn(0x7f234003a120 legacy=0x7f234003c5e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/2693451489 2024-02-05T07:12:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:44.149+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mgrmap(e 10) v1 ==== 45712+0+0 (unknown 1839825748 0 0) 0x7f2348005610 con 0x7f2358105b10 2024-02-05T07:12:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:44.150+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 >> v1:172.21.15.184:6800/2693451489 conn(0x7f234003a120 legacy=0x7f234003c5e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-05T07:12:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:45.151+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mgrmap(e 11) v1 ==== 45804+0+0 (unknown 436604022 0 0) 0x7f23480486b0 con 0x7f2358105b10 2024-02-05T07:12:45.853 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:45.152+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 --> v1:172.21.15.184:6800/2865218501 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f234003ddf0 con 0x7f234003ec70 2024-02-05T07:12:45.854 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:45.153+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (unknown 0 0 4109177037) 0x7f234003ddf0 con 0x7f234003ec70 2024-02-05T07:12:45.854 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:45.159+0000 7f235e5f8700 1 -- 172.21.15.184:0/1808394438 --> v1:172.21.15.184:6800/2865218501 -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f2344002630 con 0x7f234003ec70 2024-02-05T07:12:45.854 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:45.160+0000 7f23557fa700 1 -- 172.21.15.184:0/1808394438 <== mgr.14150 v1:172.21.15.184:6800/2865218501 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (unknown 0 0 3086460295) 0x7f2344002630 con 0x7f234003ec70 2024-02-05T07:12:45.854 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:45.160+0000 7f235e5f8700 1 -- 172.21.15.184:0/1808394438 >> v1:172.21.15.184:6800/2865218501 conn(0x7f234003ec70 legacy=0x7f2340041060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:45.854 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:45.160+0000 7f235e5f8700 1 -- 172.21.15.184:0/1808394438 >> v1:172.21.15.184:6789/0 conn(0x7f2358105b10 legacy=0x7f23581995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:45.854 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:45.160+0000 7f235e5f8700 1 -- 172.21.15.184:0/1808394438 shutdown_connections 2024-02-05T07:12:45.854 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:45.160+0000 7f235e5f8700 1 -- 172.21.15.184:0/1808394438 >> 172.21.15.184:0/1808394438 conn(0x7f23581010d0 msgr2=0x7f2358190370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:45.854 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:45.160+0000 7f235e5f8700 1 -- 172.21.15.184:0/1808394438 shutdown_connections 2024-02-05T07:12:45.854 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:45.160+0000 7f235e5f8700 1 -- 172.21.15.184:0/1808394438 wait complete. 2024-02-05T07:12:45.854 INFO:teuthology.orchestra.run.smithi184.stdout:mgr epoch 9 is available 2024-02-05T07:12:45.854 INFO:teuthology.orchestra.run.smithi184.stdout:Generating a dashboard self-signed certificate... 2024-02-05T07:12:46.405 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:46 smithi184 ceph-mon[29861]: from='client.14154 v1:172.21.15.184:0/1808394438' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-05T07:12:46.405 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:46 smithi184 ceph-mon[29861]: mgrmap e11: y(active, since 1.00609s) 2024-02-05T07:12:46.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:46 smithi184 ceph-mon[29861]: from='client.14154 v1:172.21.15.184:0/1808394438' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-05T07:12:47.384 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:47 smithi184 ceph-mon[29861]: [05/Feb/2024:07:12:45] ENGINE Bus STARTING 2024-02-05T07:12:47.384 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:47 smithi184 ceph-mon[29861]: [05/Feb/2024:07:12:45] ENGINE Serving on https://172.21.15.184:7150 2024-02-05T07:12:47.384 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:47 smithi184 ceph-mon[29861]: [05/Feb/2024:07:12:45] ENGINE Serving on http://172.21.15.184:8765 2024-02-05T07:12:47.384 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:47 smithi184 ceph-mon[29861]: [05/Feb/2024:07:12:45] ENGINE Bus STARTED 2024-02-05T07:12:47.384 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:47 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:12:47.384 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:47 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:12:47.384 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:47 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:12:47.390 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-02-05T07:12:47.390 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.507+0000 7f9eff6dc700 1 Processor -- start 2024-02-05T07:12:47.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.507+0000 7f9eff6dc700 1 -- start start 2024-02-05T07:12:47.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.507+0000 7f9eff6dc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9ef8108560 con 0x7f9ef8104130 2024-02-05T07:12:47.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.507+0000 7f9efd478700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f9ef8104130 0x7f9ef8104550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:44542/0 (socket says 172.21.15.184:44542) 2024-02-05T07:12:47.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.507+0000 7f9efd478700 1 -- 172.21.15.184:0/290553470 learned_addr learned my addr 172.21.15.184:0/290553470 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:47.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.508+0000 7f9eeffff700 1 -- 172.21.15.184:0/290553470 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605498290 0 0) 0x7f9ef8108560 con 0x7f9ef8104130 2024-02-05T07:12:47.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.508+0000 7f9eeffff700 1 -- 172.21.15.184:0/290553470 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ee40046c0 con 0x7f9ef8104130 2024-02-05T07:12:47.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.508+0000 7f9eeffff700 1 -- 172.21.15.184:0/290553470 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1101651796 0 0) 0x7f9ee40046c0 con 0x7f9ef8104130 2024-02-05T07:12:47.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.508+0000 7f9eeffff700 1 -- 172.21.15.184:0/290553470 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef8109700 con 0x7f9ef8104130 2024-02-05T07:12:47.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.508+0000 7f9eeffff700 1 -- 172.21.15.184:0/290553470 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9ef4001580 con 0x7f9ef8104130 2024-02-05T07:12:47.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.508+0000 7f9eeffff700 1 -- 172.21.15.184:0/290553470 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f9ef4001d00 con 0x7f9ef8104130 2024-02-05T07:12:47.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.508+0000 7f9eeffff700 1 -- 172.21.15.184:0/290553470 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9ef4005960 con 0x7f9ef8104130 2024-02-05T07:12:47.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.509+0000 7f9eff6dc700 1 -- 172.21.15.184:0/290553470 >> v1:172.21.15.184:6789/0 conn(0x7f9ef8104130 legacy=0x7f9ef8104550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:47.391 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.509+0000 7f9eff6dc700 1 -- 172.21.15.184:0/290553470 shutdown_connections 2024-02-05T07:12:47.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.509+0000 7f9eff6dc700 1 -- 172.21.15.184:0/290553470 >> 172.21.15.184:0/290553470 conn(0x7f9ef80ff6f0 msgr2=0x7f9ef8101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:47.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.509+0000 7f9eff6dc700 1 -- 172.21.15.184:0/290553470 shutdown_connections 2024-02-05T07:12:47.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.509+0000 7f9eff6dc700 1 -- 172.21.15.184:0/290553470 wait complete. 2024-02-05T07:12:47.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.509+0000 7f9eff6dc700 1 Processor -- start 2024-02-05T07:12:47.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.509+0000 7f9eff6dc700 1 -- start start 2024-02-05T07:12:47.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.510+0000 7f9eff6dc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9ef819f5e0 con 0x7f9ef8104130 2024-02-05T07:12:47.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.510+0000 7f9efd478700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f9ef8104130 0x7f9ef8101560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:44550/0 (socket says 172.21.15.184:44550) 2024-02-05T07:12:47.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.510+0000 7f9efd478700 1 -- 172.21.15.184:0/1103349241 learned_addr learned my addr 172.21.15.184:0/1103349241 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:47.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.510+0000 7f9eee7fc700 1 -- 172.21.15.184:0/1103349241 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694576664 0 0) 0x7f9ef819f5e0 con 0x7f9ef8104130 2024-02-05T07:12:47.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.510+0000 7f9eee7fc700 1 -- 172.21.15.184:0/1103349241 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ee4006600 con 0x7f9ef8104130 2024-02-05T07:12:47.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.510+0000 7f9eee7fc700 1 -- 172.21.15.184:0/1103349241 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 659809176 0 0) 0x7f9ee4006600 con 0x7f9ef8104130 2024-02-05T07:12:47.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.510+0000 7f9eee7fc700 1 -- 172.21.15.184:0/1103349241 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9ef819f5e0 con 0x7f9ef8104130 2024-02-05T07:12:47.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.510+0000 7f9eee7fc700 1 -- 172.21.15.184:0/1103349241 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9ef4001080 con 0x7f9ef8104130 2024-02-05T07:12:47.392 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.510+0000 7f9eee7fc700 1 -- 172.21.15.184:0/1103349241 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2125505803 0 0) 0x7f9ef819f5e0 con 0x7f9ef8104130 2024-02-05T07:12:47.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.510+0000 7f9eee7fc700 1 -- 172.21.15.184:0/1103349241 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef81a0780 con 0x7f9ef8104130 2024-02-05T07:12:47.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.510+0000 7f9eff6dc700 1 -- 172.21.15.184:0/1103349241 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef819f7d0 con 0x7f9ef8104130 2024-02-05T07:12:47.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.511+0000 7f9eff6dc700 1 -- 172.21.15.184:0/1103349241 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef819fcd0 con 0x7f9ef8104130 2024-02-05T07:12:47.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.511+0000 7f9eee7fc700 1 -- 172.21.15.184:0/1103349241 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f9ef40049f0 con 0x7f9ef8104130 2024-02-05T07:12:47.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.511+0000 7f9eee7fc700 1 -- 172.21.15.184:0/1103349241 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9ef4006200 con 0x7f9ef8104130 2024-02-05T07:12:47.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.511+0000 7f9eee7fc700 1 -- 172.21.15.184:0/1103349241 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 11) v1 ==== 45804+0+0 (unknown 436604022 0 0) 0x7f9ef40064d0 con 0x7f9ef8104130 2024-02-05T07:12:47.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.511+0000 7f9eff6dc700 1 -- 172.21.15.184:0/1103349241 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9edc005120 con 0x7f9ef8104130 2024-02-05T07:12:47.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.512+0000 7f9eee7fc700 1 -- 172.21.15.184:0/1103349241 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2686923126 0 0) 0x7f9ef40480c0 con 0x7f9ef8104130 2024-02-05T07:12:47.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.520+0000 7f9eee7fc700 1 -- 172.21.15.184:0/1103349241 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f9ef4007310 con 0x7f9ef8104130 2024-02-05T07:12:47.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.726+0000 7f9eff6dc700 1 -- 172.21.15.184:0/1103349241 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f9edc000b90 con 0x7f9ee403a040 2024-02-05T07:12:47.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.815+0000 7f9eee7fc700 1 -- 172.21.15.184:0/1103349241 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (unknown 0 0 3317752739) 0x7f9edc000b90 con 0x7f9ee403a040 2024-02-05T07:12:47.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.817+0000 7f9eff6dc700 1 -- 172.21.15.184:0/1103349241 >> v1:172.21.15.184:6800/2865218501 conn(0x7f9ee403a040 legacy=0x7f9ee403c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:47.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.817+0000 7f9eff6dc700 1 -- 172.21.15.184:0/1103349241 >> v1:172.21.15.184:6789/0 conn(0x7f9ef8104130 legacy=0x7f9ef8101560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:47.393 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.817+0000 7f9eff6dc700 1 -- 172.21.15.184:0/1103349241 shutdown_connections 2024-02-05T07:12:47.394 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.817+0000 7f9eff6dc700 1 -- 172.21.15.184:0/1103349241 >> 172.21.15.184:0/1103349241 conn(0x7f9ef80ff6f0 msgr2=0x7f9ef8107850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:47.394 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.817+0000 7f9eff6dc700 1 -- 172.21.15.184:0/1103349241 shutdown_connections 2024-02-05T07:12:47.394 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:46.817+0000 7f9eff6dc700 1 -- 172.21.15.184:0/1103349241 wait complete. 2024-02-05T07:12:47.394 INFO:teuthology.orchestra.run.smithi184.stdout:Creating initial admin user... 2024-02-05T07:12:48.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:48 smithi184 ceph-mon[29861]: from='client.14162 v1:172.21.15.184:0/1103349241' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:12:48.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:48 smithi184 ceph-mon[29861]: mgrmap e12: y(active, since 3s) 2024-02-05T07:12:48.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:48 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:12:48.856 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$ZHTJKeOFXE2PYQw.OrOqt.yQzIcS5YNG.OiMo9uOgxJYUJvYAMMiC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1707117168, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-05T07:12:48.856 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.834+0000 7f03d6132700 1 Processor -- start 2024-02-05T07:12:48.856 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.834+0000 7f03d6132700 1 -- start start 2024-02-05T07:12:48.856 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.834+0000 7f03d6132700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f03d0109fe0 con 0x7f03d0103e10 2024-02-05T07:12:48.856 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.835+0000 7f03cf7fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f03d0103e10 0x7f03d0104230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43222/0 (socket says 172.21.15.184:43222) 2024-02-05T07:12:48.856 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.835+0000 7f03cf7fe700 1 -- 172.21.15.184:0/2792508210 learned_addr learned my addr 172.21.15.184:0/2792508210 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:48.856 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.835+0000 7f03ce7fc700 1 -- 172.21.15.184:0/2792508210 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450510346 0 0) 0x7f03d0109fe0 con 0x7f03d0103e10 2024-02-05T07:12:48.856 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.835+0000 7f03ce7fc700 1 -- 172.21.15.184:0/2792508210 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03b80035b0 con 0x7f03d0103e10 2024-02-05T07:12:48.856 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.835+0000 7f03ce7fc700 1 -- 172.21.15.184:0/2792508210 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3976552173 0 0) 0x7f03b80035b0 con 0x7f03d0103e10 2024-02-05T07:12:48.856 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.835+0000 7f03ce7fc700 1 -- 172.21.15.184:0/2792508210 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d010b180 con 0x7f03d0103e10 2024-02-05T07:12:48.856 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.835+0000 7f03ce7fc700 1 -- 172.21.15.184:0/2792508210 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f03c0001580 con 0x7f03d0103e10 2024-02-05T07:12:48.857 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.835+0000 7f03ce7fc700 1 -- 172.21.15.184:0/2792508210 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f03c0001d00 con 0x7f03d0103e10 2024-02-05T07:12:48.857 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.835+0000 7f03ce7fc700 1 -- 172.21.15.184:0/2792508210 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f03c0005960 con 0x7f03d0103e10 2024-02-05T07:12:48.857 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.836+0000 7f03d6132700 1 -- 172.21.15.184:0/2792508210 >> v1:172.21.15.184:6789/0 conn(0x7f03d0103e10 legacy=0x7f03d0104230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:48.857 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.836+0000 7f03d6132700 1 -- 172.21.15.184:0/2792508210 shutdown_connections 2024-02-05T07:12:48.857 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.836+0000 7f03d6132700 1 -- 172.21.15.184:0/2792508210 >> 172.21.15.184:0/2792508210 conn(0x7f03d00ff6f0 msgr2=0x7f03d0101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:48.857 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.836+0000 7f03d6132700 1 -- 172.21.15.184:0/2792508210 shutdown_connections 2024-02-05T07:12:48.857 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.836+0000 7f03d6132700 1 -- 172.21.15.184:0/2792508210 wait complete. 2024-02-05T07:12:48.857 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.837+0000 7f03d6132700 1 Processor -- start 2024-02-05T07:12:48.857 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.837+0000 7f03d6132700 1 -- start start 2024-02-05T07:12:48.857 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.837+0000 7f03d6132700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f03d0199ca0 con 0x7f03d0103e10 2024-02-05T07:12:48.857 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.837+0000 7f03cf7fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f03d0103e10 0x7f03d0199590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43236/0 (socket says 172.21.15.184:43236) 2024-02-05T07:12:48.857 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.837+0000 7f03cf7fe700 1 -- 172.21.15.184:0/3223358240 learned_addr learned my addr 172.21.15.184:0/3223358240 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:48.857 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.837+0000 7f03ccff9700 1 -- 172.21.15.184:0/3223358240 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1907444007 0 0) 0x7f03d0199ca0 con 0x7f03d0103e10 2024-02-05T07:12:48.857 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.837+0000 7f03ccff9700 1 -- 172.21.15.184:0/3223358240 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03b80054f0 con 0x7f03d0103e10 2024-02-05T07:12:48.857 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.837+0000 7f03ccff9700 1 -- 172.21.15.184:0/3223358240 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2443538982 0 0) 0x7f03b80054f0 con 0x7f03d0103e10 2024-02-05T07:12:48.858 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.838+0000 7f03ccff9700 1 -- 172.21.15.184:0/3223358240 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f03d0199ca0 con 0x7f03d0103e10 2024-02-05T07:12:48.858 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.838+0000 7f03ccff9700 1 -- 172.21.15.184:0/3223358240 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f03c0001080 con 0x7f03d0103e10 2024-02-05T07:12:48.858 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.838+0000 7f03ccff9700 1 -- 172.21.15.184:0/3223358240 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1605961362 0 0) 0x7f03d0199ca0 con 0x7f03d0103e10 2024-02-05T07:12:48.858 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.838+0000 7f03ccff9700 1 -- 172.21.15.184:0/3223358240 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d0199e30 con 0x7f03d0103e10 2024-02-05T07:12:48.858 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.838+0000 7f03d6132700 1 -- 172.21.15.184:0/3223358240 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d019a0e0 con 0x7f03d0103e10 2024-02-05T07:12:48.858 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.838+0000 7f03d6132700 1 -- 172.21.15.184:0/3223358240 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d019dc30 con 0x7f03d0103e10 2024-02-05T07:12:48.858 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.838+0000 7f03ccff9700 1 -- 172.21.15.184:0/3223358240 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f03c0001870 con 0x7f03d0103e10 2024-02-05T07:12:48.858 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.838+0000 7f03ccff9700 1 -- 172.21.15.184:0/3223358240 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f03c00061c0 con 0x7f03d0103e10 2024-02-05T07:12:48.858 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.838+0000 7f03ccff9700 1 -- 172.21.15.184:0/3223358240 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 12) v1 ==== 45910+0+0 (unknown 511031964 0 0) 0x7f03c00116a0 con 0x7f03d0103e10 2024-02-05T07:12:48.858 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.839+0000 7f03d6132700 1 -- 172.21.15.184:0/3223358240 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03bc005150 con 0x7f03d0103e10 2024-02-05T07:12:48.858 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.839+0000 7f03ccff9700 1 -- 172.21.15.184:0/3223358240 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2686923126 0 0) 0x7f03c00482b0 con 0x7f03d0103e10 2024-02-05T07:12:48.858 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:47.843+0000 7f03ccff9700 1 -- 172.21.15.184:0/3223358240 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f03c0012f50 con 0x7f03d0103e10 2024-02-05T07:12:48.858 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:48.065+0000 7f03d6132700 1 -- 172.21.15.184:0/3223358240 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f03bc002430 con 0x7f03b803a170 2024-02-05T07:12:48.858 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:48.290+0000 7f03ccff9700 1 -- 172.21.15.184:0/3223358240 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (unknown 0 0 4006969777) 0x7f03bc002430 con 0x7f03b803a170 2024-02-05T07:12:48.859 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:48.292+0000 7f03d6132700 1 -- 172.21.15.184:0/3223358240 >> v1:172.21.15.184:6800/2865218501 conn(0x7f03b803a170 legacy=0x7f03b803c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:48.859 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:48.292+0000 7f03d6132700 1 -- 172.21.15.184:0/3223358240 >> v1:172.21.15.184:6789/0 conn(0x7f03d0103e10 legacy=0x7f03d0199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:48.859 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:48.292+0000 7f03d6132700 1 -- 172.21.15.184:0/3223358240 shutdown_connections 2024-02-05T07:12:48.859 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:48.292+0000 7f03d6132700 1 -- 172.21.15.184:0/3223358240 >> 172.21.15.184:0/3223358240 conn(0x7f03d00ff6f0 msgr2=0x7f03d01903b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:48.859 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:48.292+0000 7f03d6132700 1 -- 172.21.15.184:0/3223358240 shutdown_connections 2024-02-05T07:12:48.859 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:48.293+0000 7f03d6132700 1 -- 172.21.15.184:0/3223358240 wait complete. 2024-02-05T07:12:48.859 INFO:teuthology.orchestra.run.smithi184.stdout:Fetching dashboard port number... 2024-02-05T07:12:49.380 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:49 smithi184 ceph-mon[29861]: from='client.14164 v1:172.21.15.184:0/3223358240' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:12:49.380 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:49 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:12:50.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3783349273' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-05T07:12:50.862 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stdout 8443 2024-02-05T07:12:50.862 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.915+0000 7f75a4024700 1 Processor -- start 2024-02-05T07:12:50.863 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.915+0000 7f75a4024700 1 -- start start 2024-02-05T07:12:50.863 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.915+0000 7f75a4024700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f759c079700 con 0x7f759c1043c0 2024-02-05T07:12:50.863 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.915+0000 7f75a1dc0700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f759c1043c0 0x7f759c1047e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43238/0 (socket says 172.21.15.184:43238) 2024-02-05T07:12:50.863 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.915+0000 7f75a1dc0700 1 -- 172.21.15.184:0/3912748415 learned_addr learned my addr 172.21.15.184:0/3912748415 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:50.863 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.916+0000 7f75a0dbe700 1 -- 172.21.15.184:0/3912748415 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569585977 0 0) 0x7f759c079700 con 0x7f759c1043c0 2024-02-05T07:12:50.863 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.916+0000 7f75a0dbe700 1 -- 172.21.15.184:0/3912748415 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75880035b0 con 0x7f759c1043c0 2024-02-05T07:12:50.863 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.916+0000 7f75a0dbe700 1 -- 172.21.15.184:0/3912748415 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3995694389 0 0) 0x7f75880035b0 con 0x7f759c1043c0 2024-02-05T07:12:50.863 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.916+0000 7f75a0dbe700 1 -- 172.21.15.184:0/3912748415 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c105f00 con 0x7f759c1043c0 2024-02-05T07:12:50.863 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.916+0000 7f75a0dbe700 1 -- 172.21.15.184:0/3912748415 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f7598001580 con 0x7f759c1043c0 2024-02-05T07:12:50.863 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.916+0000 7f75a0dbe700 1 -- 172.21.15.184:0/3912748415 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f7598001d00 con 0x7f759c1043c0 2024-02-05T07:12:50.863 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.916+0000 7f75a0dbe700 1 -- 172.21.15.184:0/3912748415 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f7598005960 con 0x7f759c1043c0 2024-02-05T07:12:50.863 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.917+0000 7f75a4024700 1 -- 172.21.15.184:0/3912748415 >> v1:172.21.15.184:6789/0 conn(0x7f759c1043c0 legacy=0x7f759c1047e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:50.863 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.917+0000 7f75a4024700 1 -- 172.21.15.184:0/3912748415 shutdown_connections 2024-02-05T07:12:50.863 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.917+0000 7f75a4024700 1 -- 172.21.15.184:0/3912748415 >> 172.21.15.184:0/3912748415 conn(0x7f759c0fffe0 msgr2=0x7f759c102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:50.864 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.917+0000 7f75a4024700 1 -- 172.21.15.184:0/3912748415 shutdown_connections 2024-02-05T07:12:50.864 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.917+0000 7f75a4024700 1 -- 172.21.15.184:0/3912748415 wait complete. 2024-02-05T07:12:50.864 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.917+0000 7f75a4024700 1 Processor -- start 2024-02-05T07:12:50.864 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.917+0000 7f75a4024700 1 -- start start 2024-02-05T07:12:50.864 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.917+0000 7f75a4024700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f759c19bed0 con 0x7f759c1043c0 2024-02-05T07:12:50.864 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.918+0000 7f75a1dc0700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f759c1043c0 0x7f759c19b7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43242/0 (socket says 172.21.15.184:43242) 2024-02-05T07:12:50.864 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.918+0000 7f75a1dc0700 1 -- 172.21.15.184:0/3783349273 learned_addr learned my addr 172.21.15.184:0/3783349273 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:50.864 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.918+0000 7f7592ffd700 1 -- 172.21.15.184:0/3783349273 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041868655 0 0) 0x7f759c19bed0 con 0x7f759c1043c0 2024-02-05T07:12:50.864 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.918+0000 7f7592ffd700 1 -- 172.21.15.184:0/3783349273 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75880054f0 con 0x7f759c1043c0 2024-02-05T07:12:50.864 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.918+0000 7f7592ffd700 1 -- 172.21.15.184:0/3783349273 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3459467130 0 0) 0x7f75880054f0 con 0x7f759c1043c0 2024-02-05T07:12:50.864 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.918+0000 7f7592ffd700 1 -- 172.21.15.184:0/3783349273 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f759c19bed0 con 0x7f759c1043c0 2024-02-05T07:12:50.864 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.918+0000 7f7592ffd700 1 -- 172.21.15.184:0/3783349273 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f7598001080 con 0x7f759c1043c0 2024-02-05T07:12:50.864 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.918+0000 7f7592ffd700 1 -- 172.21.15.184:0/3783349273 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2694272891 0 0) 0x7f759c19bed0 con 0x7f759c1043c0 2024-02-05T07:12:50.864 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.918+0000 7f7592ffd700 1 -- 172.21.15.184:0/3783349273 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c19c060 con 0x7f759c1043c0 2024-02-05T07:12:50.865 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.918+0000 7f75a4024700 1 -- 172.21.15.184:0/3783349273 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f759c19c310 con 0x7f759c1043c0 2024-02-05T07:12:50.865 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.918+0000 7f75a4024700 1 -- 172.21.15.184:0/3783349273 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f759c19fe10 con 0x7f759c1043c0 2024-02-05T07:12:50.865 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.918+0000 7f7592ffd700 1 -- 172.21.15.184:0/3783349273 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f7598004a60 con 0x7f759c1043c0 2024-02-05T07:12:50.865 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.918+0000 7f7592ffd700 1 -- 172.21.15.184:0/3783349273 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f7598006140 con 0x7f759c1043c0 2024-02-05T07:12:50.865 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.919+0000 7f7592ffd700 1 -- 172.21.15.184:0/3783349273 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 12) v1 ==== 45910+0+0 (unknown 511031964 0 0) 0x7f75980063b0 con 0x7f759c1043c0 2024-02-05T07:12:50.865 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.919+0000 7f75a4024700 1 -- 172.21.15.184:0/3783349273 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7580005150 con 0x7f759c1043c0 2024-02-05T07:12:50.865 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.920+0000 7f7592ffd700 1 -- 172.21.15.184:0/3783349273 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2686923126 0 0) 0x7f75980473b0 con 0x7f759c1043c0 2024-02-05T07:12:50.865 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:49.924+0000 7f7592ffd700 1 -- 172.21.15.184:0/3783349273 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f7598006c20 con 0x7f759c1043c0 2024-02-05T07:12:50.865 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:50.119+0000 7f75a4024700 1 -- 172.21.15.184:0/3783349273 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f7580005980 con 0x7f759c1043c0 2024-02-05T07:12:50.865 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:50.119+0000 7f7592ffd700 1 -- 172.21.15.184:0/3783349273 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (unknown 3713421687 0 83753974) 0x7f7598016850 con 0x7f759c1043c0 2024-02-05T07:12:50.865 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:50.121+0000 7f75a4024700 1 -- 172.21.15.184:0/3783349273 >> v1:172.21.15.184:6800/2865218501 conn(0x7f758803a170 legacy=0x7f758803c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:50.865 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:50.121+0000 7f75a4024700 1 -- 172.21.15.184:0/3783349273 >> v1:172.21.15.184:6789/0 conn(0x7f759c1043c0 legacy=0x7f759c19b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:50.865 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:50.121+0000 7f75a4024700 1 -- 172.21.15.184:0/3783349273 shutdown_connections 2024-02-05T07:12:50.865 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:50.121+0000 7f75a4024700 1 -- 172.21.15.184:0/3783349273 >> 172.21.15.184:0/3783349273 conn(0x7f759c0fffe0 msgr2=0x7f759c192540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:50.865 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:50.122+0000 7f75a4024700 1 -- 172.21.15.184:0/3783349273 shutdown_connections 2024-02-05T07:12:50.866 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:50.122+0000 7f75a4024700 1 -- 172.21.15.184:0/3783349273 wait complete. 2024-02-05T07:12:50.869 INFO:teuthology.orchestra.run.smithi184.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-05T07:12:50.869 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stdout disabled 2024-02-05T07:12:50.876 INFO:teuthology.orchestra.run.smithi184.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-05T07:12:50.876 INFO:teuthology.orchestra.run.smithi184.stdout:systemctl: stdout inactive 2024-02-05T07:12:50.876 INFO:teuthology.orchestra.run.smithi184.stdout:firewalld.service is not enabled 2024-02-05T07:12:50.876 INFO:teuthology.orchestra.run.smithi184.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-05T07:12:50.878 INFO:teuthology.orchestra.run.smithi184.stdout:Ceph Dashboard is now available at: 2024-02-05T07:12:50.878 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:12:50.878 INFO:teuthology.orchestra.run.smithi184.stdout: URL: https://smithi184.front.sepia.ceph.com:8443/ 2024-02-05T07:12:50.878 INFO:teuthology.orchestra.run.smithi184.stdout: User: admin 2024-02-05T07:12:50.878 INFO:teuthology.orchestra.run.smithi184.stdout: Password: 814kx59f2r 2024-02-05T07:12:50.878 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:12:50.879 INFO:teuthology.orchestra.run.smithi184.stdout:Saving cluster configuration to /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config directory 2024-02-05T07:12:50.879 INFO:teuthology.orchestra.run.smithi184.stdout:Enabling autotune for osd_memory_target 2024-02-05T07:12:52.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.350+0000 7f9760de8700 1 Processor -- start 2024-02-05T07:12:52.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.350+0000 7f9760de8700 1 -- start start 2024-02-05T07:12:52.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.350+0000 7f9760de8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f975c108ee0 con 0x7f975c106100 2024-02-05T07:12:52.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.351+0000 7f975a59c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f975c106100 0x7f975c106520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43244/0 (socket says 172.21.15.184:43244) 2024-02-05T07:12:52.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.351+0000 7f975a59c700 1 -- 172.21.15.184:0/122887341 learned_addr learned my addr 172.21.15.184:0/122887341 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:52.093 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.351+0000 7f975959a700 1 -- 172.21.15.184:0/122887341 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 288290927 0 0) 0x7f975c108ee0 con 0x7f975c106100 2024-02-05T07:12:52.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.351+0000 7f975959a700 1 -- 172.21.15.184:0/122887341 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97480035b0 con 0x7f975c106100 2024-02-05T07:12:52.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.351+0000 7f975959a700 1 -- 172.21.15.184:0/122887341 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4237433594 0 0) 0x7f97480035b0 con 0x7f975c106100 2024-02-05T07:12:52.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.351+0000 7f975959a700 1 -- 172.21.15.184:0/122887341 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c10a080 con 0x7f975c106100 2024-02-05T07:12:52.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.351+0000 7f975959a700 1 -- 172.21.15.184:0/122887341 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9754001900 con 0x7f975c106100 2024-02-05T07:12:52.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.351+0000 7f975959a700 1 -- 172.21.15.184:0/122887341 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f9754002080 con 0x7f975c106100 2024-02-05T07:12:52.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.351+0000 7f975959a700 1 -- 172.21.15.184:0/122887341 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9754005ce0 con 0x7f975c106100 2024-02-05T07:12:52.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.352+0000 7f9760de8700 1 -- 172.21.15.184:0/122887341 >> v1:172.21.15.184:6789/0 conn(0x7f975c106100 legacy=0x7f975c106520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:52.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.352+0000 7f9760de8700 1 -- 172.21.15.184:0/122887341 shutdown_connections 2024-02-05T07:12:52.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.352+0000 7f9760de8700 1 -- 172.21.15.184:0/122887341 >> 172.21.15.184:0/122887341 conn(0x7f975c0fffe0 msgr2=0x7f975c102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:52.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.352+0000 7f9760de8700 1 -- 172.21.15.184:0/122887341 shutdown_connections 2024-02-05T07:12:52.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.352+0000 7f9760de8700 1 -- 172.21.15.184:0/122887341 wait complete. 2024-02-05T07:12:52.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.353+0000 7f9760de8700 1 Processor -- start 2024-02-05T07:12:52.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.353+0000 7f9760de8700 1 -- start start 2024-02-05T07:12:52.094 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.353+0000 7f9760de8700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f975c079300 con 0x7f975c106100 2024-02-05T07:12:52.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.353+0000 7f975a59c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f975c106100 0x7f975c19c3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43260/0 (socket says 172.21.15.184:43260) 2024-02-05T07:12:52.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.353+0000 7f975a59c700 1 -- 172.21.15.184:0/2912769481 learned_addr learned my addr 172.21.15.184:0/2912769481 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:52.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.353+0000 7f97537fe700 1 -- 172.21.15.184:0/2912769481 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314866490 0 0) 0x7f975c079300 con 0x7f975c106100 2024-02-05T07:12:52.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.353+0000 7f97537fe700 1 -- 172.21.15.184:0/2912769481 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97480054f0 con 0x7f975c106100 2024-02-05T07:12:52.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.353+0000 7f97537fe700 1 -- 172.21.15.184:0/2912769481 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2066882583 0 0) 0x7f97480054f0 con 0x7f975c106100 2024-02-05T07:12:52.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.353+0000 7f97537fe700 1 -- 172.21.15.184:0/2912769481 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f975c079300 con 0x7f975c106100 2024-02-05T07:12:52.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.353+0000 7f97537fe700 1 -- 172.21.15.184:0/2912769481 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9754001400 con 0x7f975c106100 2024-02-05T07:12:52.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.354+0000 7f97537fe700 1 -- 172.21.15.184:0/2912769481 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2014235399 0 0) 0x7f975c079300 con 0x7f975c106100 2024-02-05T07:12:52.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.354+0000 7f97537fe700 1 -- 172.21.15.184:0/2912769481 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c079490 con 0x7f975c106100 2024-02-05T07:12:52.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.354+0000 7f9760de8700 1 -- 172.21.15.184:0/2912769481 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975c079740 con 0x7f975c106100 2024-02-05T07:12:52.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.354+0000 7f9760de8700 1 -- 172.21.15.184:0/2912769481 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c19dd50 con 0x7f975c106100 2024-02-05T07:12:52.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.354+0000 7f97537fe700 1 -- 172.21.15.184:0/2912769481 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f9754004de0 con 0x7f975c106100 2024-02-05T07:12:52.095 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.354+0000 7f97537fe700 1 -- 172.21.15.184:0/2912769481 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f9754006570 con 0x7f975c106100 2024-02-05T07:12:52.096 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.354+0000 7f97537fe700 1 -- 172.21.15.184:0/2912769481 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 13) v1 ==== 45954+0+0 (unknown 3144929400 0 0) 0x7f9754011b20 con 0x7f975c106100 2024-02-05T07:12:52.096 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.355+0000 7f9760de8700 1 -- 172.21.15.184:0/2912769481 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973c005150 con 0x7f975c106100 2024-02-05T07:12:52.096 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.355+0000 7f97537fe700 1 -- 172.21.15.184:0/2912769481 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2686923126 0 0) 0x7f9754047a00 con 0x7f975c106100 2024-02-05T07:12:52.096 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.359+0000 7f97537fe700 1 -- 172.21.15.184:0/2912769481 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f97540134e0 con 0x7f975c106100 2024-02-05T07:12:52.096 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.552+0000 7f9760de8700 1 -- 172.21.15.184:0/2912769481 --> v1:172.21.15.184:6789/0 -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f973c005980 con 0x7f975c106100 2024-02-05T07:12:52.096 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.553+0000 7f97537fe700 1 -- 172.21.15.184:0/2912769481 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (unknown 689008156 0 0) 0x7f97540155c0 con 0x7f975c106100 2024-02-05T07:12:52.096 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.555+0000 7f9760de8700 1 -- 172.21.15.184:0/2912769481 >> v1:172.21.15.184:6800/2865218501 conn(0x7f974803a1c0 legacy=0x7f974803c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:52.096 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.555+0000 7f9760de8700 1 -- 172.21.15.184:0/2912769481 >> v1:172.21.15.184:6789/0 conn(0x7f975c106100 legacy=0x7f975c19c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:52.096 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.555+0000 7f9760de8700 1 -- 172.21.15.184:0/2912769481 shutdown_connections 2024-02-05T07:12:52.096 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.555+0000 7f9760de8700 1 -- 172.21.15.184:0/2912769481 >> 172.21.15.184:0/2912769481 conn(0x7f975c0fffe0 msgr2=0x7f975c18f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:52.096 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.555+0000 7f9760de8700 1 -- 172.21.15.184:0/2912769481 shutdown_connections 2024-02-05T07:12:52.096 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:51.555+0000 7f9760de8700 1 -- 172.21.15.184:0/2912769481 wait complete. 2024-02-05T07:12:52.447 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:52 smithi184 ceph-mon[29861]: mgrmap e13: y(active, since 7s) 2024-02-05T07:12:53.449 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.548+0000 7f2e93de7700 1 Processor -- start 2024-02-05T07:12:53.449 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.548+0000 7f2e93de7700 1 -- start start 2024-02-05T07:12:53.449 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.548+0000 7f2e93de7700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2e8c079700 con 0x7f2e8c1065e0 2024-02-05T07:12:53.450 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.548+0000 7f2e91b83700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2e8c1065e0 0x7f2e8c1089d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43272/0 (socket says 172.21.15.184:43272) 2024-02-05T07:12:53.450 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.549+0000 7f2e91b83700 1 -- 172.21.15.184:0/2250422035 learned_addr learned my addr 172.21.15.184:0/2250422035 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:53.450 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.549+0000 7f2e90b81700 1 -- 172.21.15.184:0/2250422035 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723761237 0 0) 0x7f2e8c079700 con 0x7f2e8c1065e0 2024-02-05T07:12:53.450 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.549+0000 7f2e90b81700 1 -- 172.21.15.184:0/2250422035 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e780035b0 con 0x7f2e8c1065e0 2024-02-05T07:12:53.450 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.549+0000 7f2e90b81700 1 -- 172.21.15.184:0/2250422035 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 688132988 0 0) 0x7f2e780035b0 con 0x7f2e8c1065e0 2024-02-05T07:12:53.450 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.549+0000 7f2e90b81700 1 -- 172.21.15.184:0/2250422035 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c10b100 con 0x7f2e8c1065e0 2024-02-05T07:12:53.450 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.549+0000 7f2e90b81700 1 -- 172.21.15.184:0/2250422035 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f2e88001900 con 0x7f2e8c1065e0 2024-02-05T07:12:53.450 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.549+0000 7f2e90b81700 1 -- 172.21.15.184:0/2250422035 <== mon.0 v1:172.21.15.184:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f2e88002080 con 0x7f2e8c1065e0 2024-02-05T07:12:53.450 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.549+0000 7f2e90b81700 1 -- 172.21.15.184:0/2250422035 <== mon.0 v1:172.21.15.184:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f2e88005ce0 con 0x7f2e8c1065e0 2024-02-05T07:12:53.450 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.550+0000 7f2e93de7700 1 -- 172.21.15.184:0/2250422035 >> v1:172.21.15.184:6789/0 conn(0x7f2e8c1065e0 legacy=0x7f2e8c1089d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:53.450 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.550+0000 7f2e93de7700 1 -- 172.21.15.184:0/2250422035 shutdown_connections 2024-02-05T07:12:53.450 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.550+0000 7f2e93de7700 1 -- 172.21.15.184:0/2250422035 >> 172.21.15.184:0/2250422035 conn(0x7f2e8c0fffd0 msgr2=0x7f2e8c1023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:53.450 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.550+0000 7f2e93de7700 1 -- 172.21.15.184:0/2250422035 shutdown_connections 2024-02-05T07:12:53.450 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.550+0000 7f2e93de7700 1 -- 172.21.15.184:0/2250422035 wait complete. 2024-02-05T07:12:53.451 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.550+0000 7f2e93de7700 1 Processor -- start 2024-02-05T07:12:53.451 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.550+0000 7f2e93de7700 1 -- start start 2024-02-05T07:12:53.451 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.550+0000 7f2e93de7700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2e8c199ce0 con 0x7f2e8c1065e0 2024-02-05T07:12:53.451 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.551+0000 7f2e91b83700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2e8c1065e0 0x7f2e8c1995d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43280/0 (socket says 172.21.15.184:43280) 2024-02-05T07:12:53.451 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.551+0000 7f2e91b83700 1 -- 172.21.15.184:0/2786028057 learned_addr learned my addr 172.21.15.184:0/2786028057 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:53.451 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.551+0000 7f2e82ffd700 1 -- 172.21.15.184:0/2786028057 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408884777 0 0) 0x7f2e8c199ce0 con 0x7f2e8c1065e0 2024-02-05T07:12:53.451 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.551+0000 7f2e82ffd700 1 -- 172.21.15.184:0/2786028057 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e780054f0 con 0x7f2e8c1065e0 2024-02-05T07:12:53.451 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.551+0000 7f2e82ffd700 1 -- 172.21.15.184:0/2786028057 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2557831175 0 0) 0x7f2e780054f0 con 0x7f2e8c1065e0 2024-02-05T07:12:53.451 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.551+0000 7f2e82ffd700 1 -- 172.21.15.184:0/2786028057 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2e8c199ce0 con 0x7f2e8c1065e0 2024-02-05T07:12:53.451 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.551+0000 7f2e82ffd700 1 -- 172.21.15.184:0/2786028057 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f2e88001400 con 0x7f2e8c1065e0 2024-02-05T07:12:53.451 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.551+0000 7f2e82ffd700 1 -- 172.21.15.184:0/2786028057 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 415251384 0 0) 0x7f2e8c199ce0 con 0x7f2e8c1065e0 2024-02-05T07:12:53.451 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.551+0000 7f2e82ffd700 1 -- 172.21.15.184:0/2786028057 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c199e70 con 0x7f2e8c1065e0 2024-02-05T07:12:53.451 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.551+0000 7f2e93de7700 1 -- 172.21.15.184:0/2786028057 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c19a120 con 0x7f2e8c1065e0 2024-02-05T07:12:53.451 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.551+0000 7f2e93de7700 1 -- 172.21.15.184:0/2786028057 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c19dc70 con 0x7f2e8c1065e0 2024-02-05T07:12:53.451 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.551+0000 7f2e82ffd700 1 -- 172.21.15.184:0/2786028057 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f2e88001bf0 con 0x7f2e8c1065e0 2024-02-05T07:12:53.452 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.551+0000 7f2e82ffd700 1 -- 172.21.15.184:0/2786028057 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f2e88006540 con 0x7f2e8c1065e0 2024-02-05T07:12:53.452 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.552+0000 7f2e82ffd700 1 -- 172.21.15.184:0/2786028057 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 13) v1 ==== 45954+0+0 (unknown 3144929400 0 0) 0x7f2e88006810 con 0x7f2e8c1065e0 2024-02-05T07:12:53.452 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.552+0000 7f2e93de7700 1 -- 172.21.15.184:0/2786028057 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e70005120 con 0x7f2e8c1065e0 2024-02-05T07:12:53.452 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.552+0000 7f2e82ffd700 1 -- 172.21.15.184:0/2786028057 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2686923126 0 0) 0x7f2e880478d0 con 0x7f2e8c1065e0 2024-02-05T07:12:53.452 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.557+0000 7f2e82ffd700 1 -- 172.21.15.184:0/2786028057 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f2e88007120 con 0x7f2e8c1065e0 2024-02-05T07:12:53.452 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.858+0000 7f2e93de7700 1 -- 172.21.15.184:0/2786028057 --> v1:172.21.15.184:6789/0 -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f2e70005950 con 0x7f2e8c1065e0 2024-02-05T07:12:53.452 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.860+0000 7f2e82ffd700 1 -- 172.21.15.184:0/2786028057 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (unknown 1169358022 0 0) 0x7f2e88016d80 con 0x7f2e8c1065e0 2024-02-05T07:12:53.452 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.862+0000 7f2e93de7700 1 -- 172.21.15.184:0/2786028057 >> v1:172.21.15.184:6800/2865218501 conn(0x7f2e7803a1c0 legacy=0x7f2e7803c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:53.452 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.862+0000 7f2e93de7700 1 -- 172.21.15.184:0/2786028057 >> v1:172.21.15.184:6789/0 conn(0x7f2e8c1065e0 legacy=0x7f2e8c1995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:53.452 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.862+0000 7f2e93de7700 1 -- 172.21.15.184:0/2786028057 shutdown_connections 2024-02-05T07:12:53.452 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.862+0000 7f2e93de7700 1 -- 172.21.15.184:0/2786028057 >> 172.21.15.184:0/2786028057 conn(0x7f2e8c0fffd0 msgr2=0x7f2e8c190360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:53.452 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.862+0000 7f2e93de7700 1 -- 172.21.15.184:0/2786028057 shutdown_connections 2024-02-05T07:12:53.452 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr 2024-02-05T07:12:52.862+0000 7f2e93de7700 1 -- 172.21.15.184:0/2786028057 wait complete. 2024-02-05T07:12:53.453 INFO:teuthology.orchestra.run.smithi184.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-02-05T07:12:53.453 INFO:teuthology.orchestra.run.smithi184.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-05T07:12:53.453 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:12:53.453 INFO:teuthology.orchestra.run.smithi184.stdout: sudo /sbin/cephadm shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-05T07:12:53.453 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:12:53.453 INFO:teuthology.orchestra.run.smithi184.stdout:Or, if you are only running a single cluster on this host: 2024-02-05T07:12:53.453 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:12:53.453 INFO:teuthology.orchestra.run.smithi184.stdout: sudo /sbin/cephadm shell 2024-02-05T07:12:53.453 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:12:53.453 INFO:teuthology.orchestra.run.smithi184.stdout:Please consider enabling telemetry to help improve Ceph: 2024-02-05T07:12:53.453 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:12:53.453 INFO:teuthology.orchestra.run.smithi184.stdout: ceph telemetry on 2024-02-05T07:12:53.453 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:12:53.453 INFO:teuthology.orchestra.run.smithi184.stdout:For more information see: 2024-02-05T07:12:53.453 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:12:53.454 INFO:teuthology.orchestra.run.smithi184.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-02-05T07:12:53.454 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:12:53.454 INFO:teuthology.orchestra.run.smithi184.stdout:Bootstrap complete. 2024-02-05T07:12:53.488 INFO:tasks.cephadm:Fetching config... 2024-02-05T07:12:53.488 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:12:53.488 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-05T07:12:53.504 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-05T07:12:53.504 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:12:53.504 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-05T07:12:53.559 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-05T07:12:53.560 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:12:53.560 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/keyring of=/dev/stdout 2024-02-05T07:12:53.627 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-05T07:12:53.627 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:12:53.628 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-05T07:12:53.683 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-05T07:12:53.683 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGN+uXjJUZxwv5nvDs6DUaXYkduKGlUgIK35aT0pbh3kiGhZJqqnOoxfTiXID/Agdml4K15BCa1hWk07WYBRLCk8MsvQ3FWsV89oG632XqJr8tRZqykxzMCL6dijLx+Oe5ktxuMreLperIaJjcMzR6QCdCQpkDxjwFirxzuIHC4lczkGVP2LZc3FWEH6uceyehk4BxgX5lYLdA4Hu784VdizXjlQcUycThpYEBDRJV3pGPq/kHGHFgSFFyhITpri8wVs1E4HMQOjTiiIMpr2vdRbH+xvTu4E7vAc5xvqGdcC7CAnB67FIlaws6HIqYD4oSRpr8jLcODwxo+UNHC5Bv3Wy2nOkrL+r7KQlxDrDznhmebuZBkn231XgCwL0BwzQn7y+7Zks/yYpEQSAv0qY6efuCk/0k3wh8O/L20JmhU02PaTdFVwCJjxjOtNzqQviiwZBT0kjMPZBdbJJ/EbM0euH1/laiGO1lgNErYOpf9ri9xYlS156igoxxX4wgt4E= ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-05T07:12:53.764 INFO:teuthology.orchestra.run.smithi184.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGN+uXjJUZxwv5nvDs6DUaXYkduKGlUgIK35aT0pbh3kiGhZJqqnOoxfTiXID/Agdml4K15BCa1hWk07WYBRLCk8MsvQ3FWsV89oG632XqJr8tRZqykxzMCL6dijLx+Oe5ktxuMreLperIaJjcMzR6QCdCQpkDxjwFirxzuIHC4lczkGVP2LZc3FWEH6uceyehk4BxgX5lYLdA4Hu784VdizXjlQcUycThpYEBDRJV3pGPq/kHGHFgSFFyhITpri8wVs1E4HMQOjTiiIMpr2vdRbH+xvTu4E7vAc5xvqGdcC7CAnB67FIlaws6HIqYD4oSRpr8jLcODwxo+UNHC5Bv3Wy2nOkrL+r7KQlxDrDznhmebuZBkn231XgCwL0BwzQn7y+7Zks/yYpEQSAv0qY6efuCk/0k3wh8O/L20JmhU02PaTdFVwCJjxjOtNzqQviiwZBT0kjMPZBdbJJ/EbM0euH1/laiGO1lgNErYOpf9ri9xYlS156igoxxX4wgt4E= ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:12:53.780 DEBUG:teuthology.orchestra.run.smithi188:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGN+uXjJUZxwv5nvDs6DUaXYkduKGlUgIK35aT0pbh3kiGhZJqqnOoxfTiXID/Agdml4K15BCa1hWk07WYBRLCk8MsvQ3FWsV89oG632XqJr8tRZqykxzMCL6dijLx+Oe5ktxuMreLperIaJjcMzR6QCdCQpkDxjwFirxzuIHC4lczkGVP2LZc3FWEH6uceyehk4BxgX5lYLdA4Hu784VdizXjlQcUycThpYEBDRJV3pGPq/kHGHFgSFFyhITpri8wVs1E4HMQOjTiiIMpr2vdRbH+xvTu4E7vAc5xvqGdcC7CAnB67FIlaws6HIqYD4oSRpr8jLcODwxo+UNHC5Bv3Wy2nOkrL+r7KQlxDrDznhmebuZBkn231XgCwL0BwzQn7y+7Zks/yYpEQSAv0qY6efuCk/0k3wh8O/L20JmhU02PaTdFVwCJjxjOtNzqQviiwZBT0kjMPZBdbJJ/EbM0euH1/laiGO1lgNErYOpf9ri9xYlS156igoxxX4wgt4E= ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-05T07:12:53.826 INFO:teuthology.orchestra.run.smithi188.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGN+uXjJUZxwv5nvDs6DUaXYkduKGlUgIK35aT0pbh3kiGhZJqqnOoxfTiXID/Agdml4K15BCa1hWk07WYBRLCk8MsvQ3FWsV89oG632XqJr8tRZqykxzMCL6dijLx+Oe5ktxuMreLperIaJjcMzR6QCdCQpkDxjwFirxzuIHC4lczkGVP2LZc3FWEH6uceyehk4BxgX5lYLdA4Hu784VdizXjlQcUycThpYEBDRJV3pGPq/kHGHFgSFFyhITpri8wVs1E4HMQOjTiiIMpr2vdRbH+xvTu4E7vAc5xvqGdcC7CAnB67FIlaws6HIqYD4oSRpr8jLcODwxo+UNHC5Bv3Wy2nOkrL+r7KQlxDrDznhmebuZBkn231XgCwL0BwzQn7y+7Zks/yYpEQSAv0qY6efuCk/0k3wh8O/L20JmhU02PaTdFVwCJjxjOtNzqQviiwZBT0kjMPZBdbJJ/EbM0euH1/laiGO1lgNErYOpf9ri9xYlS156igoxxX4wgt4E= ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:12:53.840 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-05T07:12:54.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2786028057' entity='client.admin' 2024-02-05T07:12:54.079 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:12:56.602 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.599+0000 7fde0d714700 1 -- 172.21.15.184:0/264690387 >> v1:172.21.15.184:6789/0 conn(0x7fde08101680 legacy=0x7fde08101aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:56.602 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.599+0000 7fde0d714700 1 -- 172.21.15.184:0/264690387 shutdown_connections 2024-02-05T07:12:56.602 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.599+0000 7fde0d714700 1 -- 172.21.15.184:0/264690387 >> 172.21.15.184:0/264690387 conn(0x7fde080fcc20 msgr2=0x7fde080ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:56.602 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.599+0000 7fde0d714700 1 -- 172.21.15.184:0/264690387 shutdown_connections 2024-02-05T07:12:56.602 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.599+0000 7fde0d714700 1 -- 172.21.15.184:0/264690387 wait complete. 2024-02-05T07:12:56.602 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.599+0000 7fde0d714700 1 Processor -- start 2024-02-05T07:12:56.602 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.599+0000 7fde0d714700 1 -- start start 2024-02-05T07:12:56.602 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.600+0000 7fde0d714700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fde08196620 con 0x7fde08101680 2024-02-05T07:12:56.602 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.600+0000 7fde06ffd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fde08101680 0x7fde08195f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:43300/0 (socket says 172.21.15.184:43300) 2024-02-05T07:12:56.602 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.600+0000 7fde06ffd700 1 -- 172.21.15.184:0/3521556195 learned_addr learned my addr 172.21.15.184:0/3521556195 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:56.604 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.600+0000 7fddeffff700 1 -- 172.21.15.184:0/3521556195 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082620140 0 0) 0x7fde08196620 con 0x7fde08101680 2024-02-05T07:12:56.604 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.600+0000 7fddeffff700 1 -- 172.21.15.184:0/3521556195 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf0005540 con 0x7fde08101680 2024-02-05T07:12:56.604 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.600+0000 7fddeffff700 1 -- 172.21.15.184:0/3521556195 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3860674797 0 0) 0x7fddf0005540 con 0x7fde08101680 2024-02-05T07:12:56.604 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.600+0000 7fddeffff700 1 -- 172.21.15.184:0/3521556195 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fde08196620 con 0x7fde08101680 2024-02-05T07:12:56.604 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.600+0000 7fddeffff700 1 -- 172.21.15.184:0/3521556195 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fddf8003790 con 0x7fde08101680 2024-02-05T07:12:56.604 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.600+0000 7fddeffff700 1 -- 172.21.15.184:0/3521556195 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1661504244 0 0) 0x7fde08196620 con 0x7fde08101680 2024-02-05T07:12:56.604 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.600+0000 7fddeffff700 1 -- 172.21.15.184:0/3521556195 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde081967b0 con 0x7fde08101680 2024-02-05T07:12:56.604 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.600+0000 7fde0d714700 1 -- 172.21.15.184:0/3521556195 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde08196a60 con 0x7fde08101680 2024-02-05T07:12:56.604 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.600+0000 7fde0d714700 1 -- 172.21.15.184:0/3521556195 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0819a5b0 con 0x7fde08101680 2024-02-05T07:12:56.604 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.601+0000 7fddeffff700 1 -- 172.21.15.184:0/3521556195 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fddf8001230 con 0x7fde08101680 2024-02-05T07:12:56.604 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.601+0000 7fddeffff700 1 -- 172.21.15.184:0/3521556195 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fddf8004dc0 con 0x7fde08101680 2024-02-05T07:12:56.604 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.601+0000 7fde0d714700 1 -- 172.21.15.184:0/3521556195 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf4005150 con 0x7fde08101680 2024-02-05T07:12:56.605 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.601+0000 7fddeffff700 1 -- 172.21.15.184:0/3521556195 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 13) v1 ==== 45954+0+0 (unknown 3144929400 0 0) 0x7fddf8004fe0 con 0x7fde08101680 2024-02-05T07:12:56.605 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.602+0000 7fddeffff700 1 -- 172.21.15.184:0/3521556195 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2686923126 0 0) 0x7fddf8047380 con 0x7fde08101680 2024-02-05T07:12:56.608 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.606+0000 7fddeffff700 1 -- 172.21.15.184:0/3521556195 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fddf8012e70 con 0x7fde08101680 2024-02-05T07:12:56.813 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.810+0000 7fde0d714700 1 -- 172.21.15.184:0/3521556195 --> v1:172.21.15.184:6789/0 -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fddf4005980 con 0x7fde08101680 2024-02-05T07:12:56.815 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.813+0000 7fddeffff700 1 -- 172.21.15.184:0/3521556195 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (unknown 3028693289 0 0) 0x7fddf8014f10 con 0x7fde08101680 2024-02-05T07:12:56.818 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.816+0000 7fde0d714700 1 -- 172.21.15.184:0/3521556195 >> v1:172.21.15.184:6800/2865218501 conn(0x7fddf003a230 legacy=0x7fddf003c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:56.818 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.816+0000 7fde0d714700 1 -- 172.21.15.184:0/3521556195 >> v1:172.21.15.184:6789/0 conn(0x7fde08101680 legacy=0x7fde08195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:56.818 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.816+0000 7fde0d714700 1 -- 172.21.15.184:0/3521556195 shutdown_connections 2024-02-05T07:12:56.818 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.816+0000 7fde0d714700 1 -- 172.21.15.184:0/3521556195 >> 172.21.15.184:0/3521556195 conn(0x7fde080fcc20 msgr2=0x7fde080ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:56.819 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.816+0000 7fde0d714700 1 -- 172.21.15.184:0/3521556195 shutdown_connections 2024-02-05T07:12:56.819 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:56.816+0000 7fde0d714700 1 -- 172.21.15.184:0/3521556195 wait complete. 2024-02-05T07:12:57.519 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-05T07:12:57.519 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-05T07:12:57.753 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:12:58.071 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3521556195' entity='client.admin' 2024-02-05T07:12:59.185 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:59 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:12:59.186 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:59 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:12:59.186 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:59 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi184", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:12:59.186 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:59 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:12:59.186 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:59 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:12:59.186 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:12:59 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:12:59.691 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.688+0000 7fee8bb46700 1 -- 172.21.15.184:0/3414865082 >> v1:172.21.15.184:6789/0 conn(0x7fee84100580 legacy=0x7fee841009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:59.691 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.688+0000 7fee8bb46700 1 -- 172.21.15.184:0/3414865082 shutdown_connections 2024-02-05T07:12:59.691 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.688+0000 7fee8bb46700 1 -- 172.21.15.184:0/3414865082 >> 172.21.15.184:0/3414865082 conn(0x7fee840fbb20 msgr2=0x7fee840fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:59.691 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.688+0000 7fee8bb46700 1 -- 172.21.15.184:0/3414865082 shutdown_connections 2024-02-05T07:12:59.691 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.688+0000 7fee8bb46700 1 -- 172.21.15.184:0/3414865082 wait complete. 2024-02-05T07:12:59.691 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.689+0000 7fee8bb46700 1 Processor -- start 2024-02-05T07:12:59.691 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.689+0000 7fee8bb46700 1 -- start start 2024-02-05T07:12:59.691 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.689+0000 7fee8bb46700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fee841965d0 con 0x7fee84100580 2024-02-05T07:12:59.692 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.689+0000 7fee898e2700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fee84100580 0x7fee84195ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:39004/0 (socket says 172.21.15.184:39004) 2024-02-05T07:12:59.692 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.689+0000 7fee898e2700 1 -- 172.21.15.184:0/960984782 learned_addr learned my addr 172.21.15.184:0/960984782 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:12:59.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.689+0000 7fee7affd700 1 -- 172.21.15.184:0/960984782 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323983745 0 0) 0x7fee841965d0 con 0x7fee84100580 2024-02-05T07:12:59.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.689+0000 7fee7affd700 1 -- 172.21.15.184:0/960984782 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee700054f0 con 0x7fee84100580 2024-02-05T07:12:59.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.689+0000 7fee7affd700 1 -- 172.21.15.184:0/960984782 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1590750165 0 0) 0x7fee700054f0 con 0x7fee84100580 2024-02-05T07:12:59.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.689+0000 7fee7affd700 1 -- 172.21.15.184:0/960984782 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fee841965d0 con 0x7fee84100580 2024-02-05T07:12:59.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.689+0000 7fee7affd700 1 -- 172.21.15.184:0/960984782 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fee80004440 con 0x7fee84100580 2024-02-05T07:12:59.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.690+0000 7fee7affd700 1 -- 172.21.15.184:0/960984782 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3448957616 0 0) 0x7fee841965d0 con 0x7fee84100580 2024-02-05T07:12:59.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.690+0000 7fee7affd700 1 -- 172.21.15.184:0/960984782 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee84196760 con 0x7fee84100580 2024-02-05T07:12:59.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.690+0000 7fee8bb46700 1 -- 172.21.15.184:0/960984782 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee84196a10 con 0x7fee84100580 2024-02-05T07:12:59.693 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.690+0000 7fee8bb46700 1 -- 172.21.15.184:0/960984782 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fee8419a560 con 0x7fee84100580 2024-02-05T07:12:59.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.690+0000 7fee7affd700 1 -- 172.21.15.184:0/960984782 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fee80001190 con 0x7fee84100580 2024-02-05T07:12:59.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.690+0000 7fee7affd700 1 -- 172.21.15.184:0/960984782 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fee80004dc0 con 0x7fee84100580 2024-02-05T07:12:59.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.690+0000 7fee7affd700 1 -- 172.21.15.184:0/960984782 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 13) v1 ==== 45954+0+0 (unknown 3144929400 0 0) 0x7fee80004f40 con 0x7fee84100580 2024-02-05T07:12:59.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.690+0000 7fee8bb46700 1 -- 172.21.15.184:0/960984782 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee68005150 con 0x7fee84100580 2024-02-05T07:12:59.694 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.691+0000 7fee7affd700 1 -- 172.21.15.184:0/960984782 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2686923126 0 0) 0x7fee80047320 con 0x7fee84100580 2024-02-05T07:12:59.698 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.695+0000 7fee7affd700 1 -- 172.21.15.184:0/960984782 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fee80005330 con 0x7fee84100580 2024-02-05T07:12:59.895 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.893+0000 7fee8bb46700 1 -- 172.21.15.184:0/960984782 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fee68000bc0 con 0x7fee7003a290 2024-02-05T07:12:59.898 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.896+0000 7fee7affd700 1 -- 172.21.15.184:0/960984782 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (unknown 0 0 0) 0x7fee68000bc0 con 0x7fee7003a290 2024-02-05T07:12:59.901 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.898+0000 7fee8bb46700 1 -- 172.21.15.184:0/960984782 >> v1:172.21.15.184:6800/2865218501 conn(0x7fee7003a290 legacy=0x7fee7003c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:59.901 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.898+0000 7fee8bb46700 1 -- 172.21.15.184:0/960984782 >> v1:172.21.15.184:6789/0 conn(0x7fee84100580 legacy=0x7fee84195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:12:59.901 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.898+0000 7fee8bb46700 1 -- 172.21.15.184:0/960984782 shutdown_connections 2024-02-05T07:12:59.901 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.898+0000 7fee8bb46700 1 -- 172.21.15.184:0/960984782 >> 172.21.15.184:0/960984782 conn(0x7fee840fbb20 msgr2=0x7fee84102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:12:59.901 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.898+0000 7fee8bb46700 1 -- 172.21.15.184:0/960984782 shutdown_connections 2024-02-05T07:12:59.901 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:12:59.899+0000 7fee8bb46700 1 -- 172.21.15.184:0/960984782 wait complete. 2024-02-05T07:13:00.564 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi188 2024-02-05T07:13:00.564 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-05T07:13:00.565 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/etc/ceph/ceph.conf 2024-02-05T07:13:00.584 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-05T07:13:00.584 DEBUG:teuthology.orchestra.run.smithi188:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-05T07:13:00.641 INFO:tasks.cephadm:Adding host smithi188 to orchestrator... 2024-02-05T07:13:00.641 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch host add smithi188 2024-02-05T07:13:00.883 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:13:01.248 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:00 smithi184 ceph-mon[29861]: from='client.14174 v1:172.21.15.184:0/960984782' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:13:01.248 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:01.249 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:01.249 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:01.249 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:01.249 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:00 smithi184 ceph-mon[29861]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-05T07:13:01.249 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:00 smithi184 ceph-mon[29861]: Updating smithi184:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:13:01.249 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:01.249 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:01.249 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:02.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:01 smithi184 ceph-mon[29861]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-02-05T07:13:02.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:01 smithi184 ceph-mon[29861]: Updating smithi184:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-05T07:13:02.422 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.389+0000 7f35816b5700 1 -- 172.21.15.184:0/3496758519 >> v1:172.21.15.184:6789/0 conn(0x7f357c1003d0 legacy=0x7f357c1007b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:02.422 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.389+0000 7f35816b5700 1 -- 172.21.15.184:0/3496758519 shutdown_connections 2024-02-05T07:13:02.422 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.389+0000 7f35816b5700 1 -- 172.21.15.184:0/3496758519 >> 172.21.15.184:0/3496758519 conn(0x7f357c0fc010 msgr2=0x7f357c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:02.422 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.389+0000 7f35816b5700 1 -- 172.21.15.184:0/3496758519 shutdown_connections 2024-02-05T07:13:02.422 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.389+0000 7f35816b5700 1 -- 172.21.15.184:0/3496758519 wait complete. 2024-02-05T07:13:02.423 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.390+0000 7f35816b5700 1 Processor -- start 2024-02-05T07:13:02.423 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.390+0000 7f35816b5700 1 -- start start 2024-02-05T07:13:02.423 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.390+0000 7f35816b5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f357c198bf0 con 0x7f357c1003d0 2024-02-05T07:13:02.423 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.390+0000 7f357affd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f357c1003d0 0x7f357c1984e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:39026/0 (socket says 172.21.15.184:39026) 2024-02-05T07:13:02.423 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.390+0000 7f357affd700 1 -- 172.21.15.184:0/2261606054 learned_addr learned my addr 172.21.15.184:0/2261606054 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:13:02.423 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.391+0000 7f3563fff700 1 -- 172.21.15.184:0/2261606054 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674677973 0 0) 0x7f357c198bf0 con 0x7f357c1003d0 2024-02-05T07:13:02.423 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.391+0000 7f3563fff700 1 -- 172.21.15.184:0/2261606054 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35640054f0 con 0x7f357c1003d0 2024-02-05T07:13:02.423 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.391+0000 7f3563fff700 1 -- 172.21.15.184:0/2261606054 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1484359759 0 0) 0x7f35640054f0 con 0x7f357c1003d0 2024-02-05T07:13:02.423 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.391+0000 7f3563fff700 1 -- 172.21.15.184:0/2261606054 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f357c198bf0 con 0x7f357c1003d0 2024-02-05T07:13:02.423 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.391+0000 7f3563fff700 1 -- 172.21.15.184:0/2261606054 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f356c0044b0 con 0x7f357c1003d0 2024-02-05T07:13:02.423 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.391+0000 7f3563fff700 1 -- 172.21.15.184:0/2261606054 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2286651117 0 0) 0x7f357c198bf0 con 0x7f357c1003d0 2024-02-05T07:13:02.424 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.391+0000 7f3563fff700 1 -- 172.21.15.184:0/2261606054 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c198d80 con 0x7f357c1003d0 2024-02-05T07:13:02.424 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.391+0000 7f35816b5700 1 -- 172.21.15.184:0/2261606054 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357c199030 con 0x7f357c1003d0 2024-02-05T07:13:02.424 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.391+0000 7f35816b5700 1 -- 172.21.15.184:0/2261606054 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c1a1210 con 0x7f357c1003d0 2024-02-05T07:13:02.424 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.391+0000 7f3563fff700 1 -- 172.21.15.184:0/2261606054 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f356c001620 con 0x7f357c1003d0 2024-02-05T07:13:02.424 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.391+0000 7f3563fff700 1 -- 172.21.15.184:0/2261606054 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f356c004ea0 con 0x7f357c1003d0 2024-02-05T07:13:02.424 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.392+0000 7f3563fff700 1 -- 172.21.15.184:0/2261606054 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 13) v1 ==== 45954+0+0 (unknown 3144929400 0 0) 0x7f356c0050c0 con 0x7f357c1003d0 2024-02-05T07:13:02.424 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.392+0000 7f35816b5700 1 -- 172.21.15.184:0/2261606054 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3568005120 con 0x7f357c1003d0 2024-02-05T07:13:02.425 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.392+0000 7f3563fff700 1 -- 172.21.15.184:0/2261606054 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2686923126 0 0) 0x7f356c047220 con 0x7f357c1003d0 2024-02-05T07:13:02.425 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.397+0000 7f3563fff700 1 -- 172.21.15.184:0/2261606054 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f356c016880 con 0x7f357c1003d0 2024-02-05T07:13:02.598 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:02.595+0000 7f35816b5700 1 -- 172.21.15.184:0/2261606054 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi188", "target": ["mon-mgr", ""]}) v1 -- 0x7f3568000b90 con 0x7f356403a290 2024-02-05T07:13:03.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:03 smithi184 ceph-mon[29861]: from='client.14176 v1:172.21.15.184:0/2261606054' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi188", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:13:05.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:05 smithi184 ceph-mon[29861]: Deploying cephadm binary to smithi188 2024-02-05T07:13:05.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:05 smithi184 ceph-mon[29861]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:06.844 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:06.842+0000 7f3563fff700 1 -- 172.21.15.184:0/2261606054 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (unknown 0 0 1104893135) 0x7f3568000b90 con 0x7f356403a290 2024-02-05T07:13:06.845 INFO:teuthology.orchestra.run.smithi184.stdout:Added host 'smithi188' with addr '172.21.15.188' 2024-02-05T07:13:06.847 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:06.845+0000 7f35816b5700 1 -- 172.21.15.184:0/2261606054 >> v1:172.21.15.184:6800/2865218501 conn(0x7f356403a290 legacy=0x7f356403c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:06.847 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:06.845+0000 7f35816b5700 1 -- 172.21.15.184:0/2261606054 >> v1:172.21.15.184:6789/0 conn(0x7f357c1003d0 legacy=0x7f357c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:06.847 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:06.845+0000 7f35816b5700 1 -- 172.21.15.184:0/2261606054 shutdown_connections 2024-02-05T07:13:06.847 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:06.845+0000 7f35816b5700 1 -- 172.21.15.184:0/2261606054 >> 172.21.15.184:0/2261606054 conn(0x7f357c0fc010 msgr2=0x7f357c0fc580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:06.847 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:06.845+0000 7f35816b5700 1 -- 172.21.15.184:0/2261606054 shutdown_connections 2024-02-05T07:13:06.847 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:06.845+0000 7f35816b5700 1 -- 172.21.15.184:0/2261606054 wait complete. 2024-02-05T07:13:07.469 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:07 smithi184 ceph-mon[29861]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:07.470 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:07 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:07.470 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:07 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:07.499 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch host ls --format=json 2024-02-05T07:13:07.733 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:13:08.456 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:08 smithi184 ceph-mon[29861]: Added host smithi188 2024-02-05T07:13:08.456 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:08 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:08.456 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:08 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:09.299 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.296+0000 7f0770239700 1 -- 172.21.15.184:0/4273243856 >> v1:172.21.15.184:6789/0 conn(0x7f0768106620 legacy=0x7f0768106a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:09.300 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.297+0000 7f0770239700 1 -- 172.21.15.184:0/4273243856 shutdown_connections 2024-02-05T07:13:09.300 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.297+0000 7f0770239700 1 -- 172.21.15.184:0/4273243856 >> 172.21.15.184:0/4273243856 conn(0x7f07680fc060 msgr2=0x7f07680fe480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:09.300 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.297+0000 7f0770239700 1 -- 172.21.15.184:0/4273243856 shutdown_connections 2024-02-05T07:13:09.300 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.297+0000 7f0770239700 1 -- 172.21.15.184:0/4273243856 wait complete. 2024-02-05T07:13:09.300 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.297+0000 7f0770239700 1 Processor -- start 2024-02-05T07:13:09.300 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.297+0000 7f0770239700 1 -- start start 2024-02-05T07:13:09.300 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.297+0000 7f0770239700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0768195830 con 0x7f0768106620 2024-02-05T07:13:09.300 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.297+0000 7f076dfd5700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f0768106620 0x7f0768195120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:58454/0 (socket says 172.21.15.184:58454) 2024-02-05T07:13:09.300 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.298+0000 7f076dfd5700 1 -- 172.21.15.184:0/1210240845 learned_addr learned my addr 172.21.15.184:0/1210240845 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:13:09.300 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.298+0000 7f075effd700 1 -- 172.21.15.184:0/1210240845 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950048343 0 0) 0x7f0768195830 con 0x7f0768106620 2024-02-05T07:13:09.300 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.298+0000 7f075effd700 1 -- 172.21.15.184:0/1210240845 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07540054f0 con 0x7f0768106620 2024-02-05T07:13:09.301 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.298+0000 7f075effd700 1 -- 172.21.15.184:0/1210240845 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1685269356 0 0) 0x7f07540054f0 con 0x7f0768106620 2024-02-05T07:13:09.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.298+0000 7f075effd700 1 -- 172.21.15.184:0/1210240845 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0768195830 con 0x7f0768106620 2024-02-05T07:13:09.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.298+0000 7f075effd700 1 -- 172.21.15.184:0/1210240845 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f0764001980 con 0x7f0768106620 2024-02-05T07:13:09.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.298+0000 7f075effd700 1 -- 172.21.15.184:0/1210240845 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4001055480 0 0) 0x7f0768195830 con 0x7f0768106620 2024-02-05T07:13:09.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.298+0000 7f075effd700 1 -- 172.21.15.184:0/1210240845 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07681959c0 con 0x7f0768106620 2024-02-05T07:13:09.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.298+0000 7f0770239700 1 -- 172.21.15.184:0/1210240845 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0768195c70 con 0x7f0768106620 2024-02-05T07:13:09.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.298+0000 7f0770239700 1 -- 172.21.15.184:0/1210240845 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f076819ded0 con 0x7f0768106620 2024-02-05T07:13:09.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.298+0000 7f075effd700 1 -- 172.21.15.184:0/1210240845 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f0764001200 con 0x7f0768106620 2024-02-05T07:13:09.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.298+0000 7f075effd700 1 -- 172.21.15.184:0/1210240845 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f0764004e90 con 0x7f0768106620 2024-02-05T07:13:09.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.299+0000 7f075effd700 1 -- 172.21.15.184:0/1210240845 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 13) v1 ==== 45954+0+0 (unknown 3144929400 0 0) 0x7f0764005010 con 0x7f0768106620 2024-02-05T07:13:09.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.299+0000 7f0770239700 1 -- 172.21.15.184:0/1210240845 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f074c005120 con 0x7f0768106620 2024-02-05T07:13:09.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.299+0000 7f075effd700 1 -- 172.21.15.184:0/1210240845 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2686923126 0 0) 0x7f0764047430 con 0x7f0768106620 2024-02-05T07:13:09.306 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.304+0000 7f075effd700 1 -- 172.21.15.184:0/1210240845 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f0764005400 con 0x7f0768106620 2024-02-05T07:13:09.507 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.505+0000 7f0770239700 1 -- 172.21.15.184:0/1210240845 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f074c000b90 con 0x7f075403a240 2024-02-05T07:13:09.507 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:09 smithi184 ceph-mon[29861]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:09.508 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.506+0000 7f075effd700 1 -- 172.21.15.184:0/1210240845 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (unknown 0 0 1741884421) 0x7f074c000b90 con 0x7f075403a240 2024-02-05T07:13:09.508 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:13:09.508 INFO:teuthology.orchestra.run.smithi184.stdout:[{"addr": "172.21.15.184", "hostname": "smithi184", "labels": [], "status": ""}, {"addr": "172.21.15.188", "hostname": "smithi188", "labels": [], "status": ""}] 2024-02-05T07:13:09.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.508+0000 7f0770239700 1 -- 172.21.15.184:0/1210240845 >> v1:172.21.15.184:6800/2865218501 conn(0x7f075403a240 legacy=0x7f075403c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:09.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.508+0000 7f0770239700 1 -- 172.21.15.184:0/1210240845 >> v1:172.21.15.184:6789/0 conn(0x7f0768106620 legacy=0x7f0768195120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:09.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.508+0000 7f0770239700 1 -- 172.21.15.184:0/1210240845 shutdown_connections 2024-02-05T07:13:09.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.508+0000 7f0770239700 1 -- 172.21.15.184:0/1210240845 >> 172.21.15.184:0/1210240845 conn(0x7f07680fc060 msgr2=0x7f0768107510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:09.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.509+0000 7f0770239700 1 -- 172.21.15.184:0/1210240845 shutdown_connections 2024-02-05T07:13:09.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:09.509+0000 7f0770239700 1 -- 172.21.15.184:0/1210240845 wait complete. 2024-02-05T07:13:10.073 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-05T07:13:10.073 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph osd crush tunables default 2024-02-05T07:13:10.307 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:13:10.750 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:10 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:10.750 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:10 smithi184 ceph-mon[29861]: from='client.14178 v1:172.21.15.184:0/1210240845' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-05T07:13:10.750 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:10 smithi184 ceph-mon[29861]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:11.873 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.869+0000 7ffaf3f6a700 1 -- 172.21.15.184:0/1465035880 >> v1:172.21.15.184:6789/0 conn(0x7ffaec1076a0 legacy=0x7ffaec107a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:11.873 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.869+0000 7ffaf3f6a700 1 -- 172.21.15.184:0/1465035880 shutdown_connections 2024-02-05T07:13:11.873 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.869+0000 7ffaf3f6a700 1 -- 172.21.15.184:0/1465035880 >> 172.21.15.184:0/1465035880 conn(0x7ffaec0fd160 msgr2=0x7ffaec0ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:11.874 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.869+0000 7ffaf3f6a700 1 -- 172.21.15.184:0/1465035880 shutdown_connections 2024-02-05T07:13:11.874 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.869+0000 7ffaf3f6a700 1 -- 172.21.15.184:0/1465035880 wait complete. 2024-02-05T07:13:11.874 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.870+0000 7ffaf3f6a700 1 Processor -- start 2024-02-05T07:13:11.874 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.870+0000 7ffaf3f6a700 1 -- start start 2024-02-05T07:13:11.874 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.870+0000 7ffaf3f6a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ffaec1969b0 con 0x7ffaec1076a0 2024-02-05T07:13:11.874 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.870+0000 7ffaf1d06700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7ffaec1076a0 0x7ffaec1962a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:58466/0 (socket says 172.21.15.184:58466) 2024-02-05T07:13:11.874 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.870+0000 7ffaf1d06700 1 -- 172.21.15.184:0/4011216135 learned_addr learned my addr 172.21.15.184:0/4011216135 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:13:11.874 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.870+0000 7ffae2ffd700 1 -- 172.21.15.184:0/4011216135 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4074038623 0 0) 0x7ffaec1969b0 con 0x7ffaec1076a0 2024-02-05T07:13:11.874 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.870+0000 7ffae2ffd700 1 -- 172.21.15.184:0/4011216135 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffad80054f0 con 0x7ffaec1076a0 2024-02-05T07:13:11.874 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.870+0000 7ffae2ffd700 1 -- 172.21.15.184:0/4011216135 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2334549069 0 0) 0x7ffad80054f0 con 0x7ffaec1076a0 2024-02-05T07:13:11.874 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.871+0000 7ffae2ffd700 1 -- 172.21.15.184:0/4011216135 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffaec1969b0 con 0x7ffaec1076a0 2024-02-05T07:13:11.874 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.871+0000 7ffae2ffd700 1 -- 172.21.15.184:0/4011216135 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7ffadc001980 con 0x7ffaec1076a0 2024-02-05T07:13:11.874 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.871+0000 7ffae2ffd700 1 -- 172.21.15.184:0/4011216135 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1351533267 0 0) 0x7ffaec1969b0 con 0x7ffaec1076a0 2024-02-05T07:13:11.874 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.871+0000 7ffae2ffd700 1 -- 172.21.15.184:0/4011216135 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec196b40 con 0x7ffaec1076a0 2024-02-05T07:13:11.875 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.871+0000 7ffaf3f6a700 1 -- 172.21.15.184:0/4011216135 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaec196df0 con 0x7ffaec1076a0 2024-02-05T07:13:11.875 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.871+0000 7ffaf3f6a700 1 -- 172.21.15.184:0/4011216135 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaec19efd0 con 0x7ffaec1076a0 2024-02-05T07:13:11.875 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.871+0000 7ffae2ffd700 1 -- 172.21.15.184:0/4011216135 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7ffadc001620 con 0x7ffaec1076a0 2024-02-05T07:13:11.875 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.871+0000 7ffae2ffd700 1 -- 172.21.15.184:0/4011216135 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7ffadc004d90 con 0x7ffaec1076a0 2024-02-05T07:13:11.875 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.871+0000 7ffae2ffd700 1 -- 172.21.15.184:0/4011216135 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 13) v1 ==== 45954+0+0 (unknown 3144929400 0 0) 0x7ffadc004f10 con 0x7ffaec1076a0 2024-02-05T07:13:11.875 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.872+0000 7ffaf3f6a700 1 -- 172.21.15.184:0/4011216135 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad0005120 con 0x7ffaec1076a0 2024-02-05T07:13:11.876 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.872+0000 7ffae2ffd700 1 -- 172.21.15.184:0/4011216135 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2686923126 0 0) 0x7ffadc0472f0 con 0x7ffaec1076a0 2024-02-05T07:13:11.878 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:11.876+0000 7ffae2ffd700 1 -- 172.21.15.184:0/4011216135 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7ffadc005300 con 0x7ffaec1076a0 2024-02-05T07:13:12.077 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:12.075+0000 7ffaf3f6a700 1 -- 172.21.15.184:0/4011216135 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ffad00053d0 con 0x7ffaec1076a0 2024-02-05T07:13:12.129 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:12.126+0000 7ffae2ffd700 1 -- 172.21.15.184:0/4011216135 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (unknown 3126668360 0 0) 0x7ffadc01f2f0 con 0x7ffaec1076a0 2024-02-05T07:13:12.131 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:12.129+0000 7ffaf3f6a700 1 -- 172.21.15.184:0/4011216135 >> v1:172.21.15.184:6800/2865218501 conn(0x7ffad803a2d0 legacy=0x7ffad803c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:12.131 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:12.129+0000 7ffaf3f6a700 1 -- 172.21.15.184:0/4011216135 >> v1:172.21.15.184:6789/0 conn(0x7ffaec1076a0 legacy=0x7ffaec1962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:12.131 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:12.129+0000 7ffaf3f6a700 1 -- 172.21.15.184:0/4011216135 shutdown_connections 2024-02-05T07:13:12.131 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:12.129+0000 7ffaf3f6a700 1 -- 172.21.15.184:0/4011216135 >> 172.21.15.184:0/4011216135 conn(0x7ffaec0fd160 msgr2=0x7ffaec1084b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:12.131 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:12.129+0000 7ffaf3f6a700 1 -- 172.21.15.184:0/4011216135 shutdown_connections 2024-02-05T07:13:12.131 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:12.129+0000 7ffaf3f6a700 1 -- 172.21.15.184:0/4011216135 wait complete. 2024-02-05T07:13:12.132 INFO:teuthology.orchestra.run.smithi184.stderr:adjusted tunables profile to default 2024-02-05T07:13:12.434 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4011216135' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-05T07:13:12.755 INFO:tasks.cephadm:Adding mon.a on smithi184 2024-02-05T07:13:12.755 INFO:tasks.cephadm:Adding mon.c on smithi184 2024-02-05T07:13:12.755 INFO:tasks.cephadm:Adding mon.b on smithi188 2024-02-05T07:13:12.755 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch apply mon '3;smithi184:[v1:172.21.15.184:6789]=a;smithi184:[v1:172.21.15.184:6790]=c;smithi188:[v1:172.21.15.188:6789]=b' 2024-02-05T07:13:12.992 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-05T07:13:13.039 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-05T07:13:13.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4011216135' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-05T07:13:13.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:13 smithi184 ceph-mon[29861]: osdmap e4: 0 total, 0 up, 0 in 2024-02-05T07:13:13.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:13 smithi184 ceph-mon[29861]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:13.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:13 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:13.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:13 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:13.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:13 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:13.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:13 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:13.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:13 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi188", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:13:13.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:13 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:13.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:13 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:14.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:14 smithi184 ceph-mon[29861]: Updating smithi188:/etc/ceph/ceph.conf 2024-02-05T07:13:14.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:14 smithi184 ceph-mon[29861]: Updating smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:13:14.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:14 smithi184 ceph-mon[29861]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-02-05T07:13:14.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:14 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:14.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:14 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:14.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:14 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:14.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.634+0000 7f165feed700 1 -- 172.21.15.188:0/255557531 >> v1:172.21.15.184:6789/0 conn(0x7f16580fff20 legacy=0x7f1658100300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:14.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.634+0000 7f165feed700 1 -- 172.21.15.188:0/255557531 shutdown_connections 2024-02-05T07:13:14.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.634+0000 7f165feed700 1 -- 172.21.15.188:0/255557531 >> 172.21.15.188:0/255557531 conn(0x7f16580fb7b0 msgr2=0x7f16580fdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:14.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.634+0000 7f165feed700 1 -- 172.21.15.188:0/255557531 shutdown_connections 2024-02-05T07:13:14.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.634+0000 7f165feed700 1 -- 172.21.15.188:0/255557531 wait complete. 2024-02-05T07:13:14.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.635+0000 7f165feed700 1 Processor -- start 2024-02-05T07:13:14.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.635+0000 7f165feed700 1 -- start start 2024-02-05T07:13:14.637 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.635+0000 7f165feed700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f1658196a60 con 0x7f16580fff20 2024-02-05T07:13:14.638 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.635+0000 7f165dc89700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f16580fff20 0x7f1658196350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.188:43944/0 (socket says 172.21.15.188:43944) 2024-02-05T07:13:14.639 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.635+0000 7f165dc89700 1 -- 172.21.15.188:0/1065518000 learned_addr learned my addr 172.21.15.188:0/1065518000 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:13:14.639 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.635+0000 7f164effd700 1 -- 172.21.15.188:0/1065518000 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044032877 0 0) 0x7f1658196a60 con 0x7f16580fff20 2024-02-05T07:13:14.639 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.635+0000 7f164effd700 1 -- 172.21.15.188:0/1065518000 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16440054f0 con 0x7f16580fff20 2024-02-05T07:13:14.639 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.636+0000 7f164effd700 1 -- 172.21.15.188:0/1065518000 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1490946140 0 0) 0x7f16440054f0 con 0x7f16580fff20 2024-02-05T07:13:14.639 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.636+0000 7f164effd700 1 -- 172.21.15.188:0/1065518000 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1658196a60 con 0x7f16580fff20 2024-02-05T07:13:14.639 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.636+0000 7f164effd700 1 -- 172.21.15.188:0/1065518000 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f1650004a10 con 0x7f16580fff20 2024-02-05T07:13:14.639 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.636+0000 7f164effd700 1 -- 172.21.15.188:0/1065518000 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 118676782 0 0) 0x7f1658196a60 con 0x7f16580fff20 2024-02-05T07:13:14.639 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.636+0000 7f164effd700 1 -- 172.21.15.188:0/1065518000 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1658196bf0 con 0x7f16580fff20 2024-02-05T07:13:14.639 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.636+0000 7f165feed700 1 -- 172.21.15.188:0/1065518000 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1658196ea0 con 0x7f16580fff20 2024-02-05T07:13:14.639 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.636+0000 7f165feed700 1 -- 172.21.15.188:0/1065518000 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f165819efe0 con 0x7f16580fff20 2024-02-05T07:13:14.639 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.636+0000 7f164effd700 1 -- 172.21.15.188:0/1065518000 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f1650001550 con 0x7f16580fff20 2024-02-05T07:13:14.639 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.636+0000 7f164effd700 1 -- 172.21.15.188:0/1065518000 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7f16500051c0 con 0x7f16580fff20 2024-02-05T07:13:14.640 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.637+0000 7f165feed700 1 -- 172.21.15.188:0/1065518000 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163c005120 con 0x7f16580fff20 2024-02-05T07:13:14.640 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.637+0000 7f164effd700 1 -- 172.21.15.188:0/1065518000 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 13) v1 ==== 45954+0+0 (unknown 3144929400 0 0) 0x7f16500053c0 con 0x7f16580fff20 2024-02-05T07:13:14.640 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.637+0000 7f164effd700 1 -- 172.21.15.188:0/1065518000 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 2979786674 0 0) 0x7f16500477c0 con 0x7f16580fff20 2024-02-05T07:13:14.644 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.642+0000 7f164effd700 1 -- 172.21.15.188:0/1065518000 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f1650016930 con 0x7f16580fff20 2024-02-05T07:13:14.851 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.849+0000 7f165feed700 1 -- 172.21.15.188:0/1065518000 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi184:[v1:172.21.15.184:6789]=a;smithi184:[v1:172.21.15.184:6790]=c;smithi188:[v1:172.21.15.188:6789]=b", "target": ["mon-mgr", ""]}) v1 -- 0x7f163c000c70 con 0x7f164403a1f0 2024-02-05T07:13:14.858 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.856+0000 7f164effd700 1 -- 172.21.15.188:0/1065518000 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (unknown 0 0 3265049985) 0x7f163c000c70 con 0x7f164403a1f0 2024-02-05T07:13:14.858 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled mon update... 2024-02-05T07:13:14.860 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.857+0000 7f165feed700 1 -- 172.21.15.188:0/1065518000 >> v1:172.21.15.184:6800/2865218501 conn(0x7f164403a1f0 legacy=0x7f164403c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:14.860 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.857+0000 7f165feed700 1 -- 172.21.15.188:0/1065518000 >> v1:172.21.15.184:6789/0 conn(0x7f16580fff20 legacy=0x7f1658196350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:14.860 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.857+0000 7f165feed700 1 -- 172.21.15.188:0/1065518000 shutdown_connections 2024-02-05T07:13:14.860 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.857+0000 7f165feed700 1 -- 172.21.15.188:0/1065518000 >> 172.21.15.188:0/1065518000 conn(0x7f16580fb7b0 msgr2=0x7f1658108420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:14.860 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.858+0000 7f165feed700 1 -- 172.21.15.188:0/1065518000 shutdown_connections 2024-02-05T07:13:14.860 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:14.858+0000 7f165feed700 1 -- 172.21.15.188:0/1065518000 wait complete. 2024-02-05T07:13:15.431 DEBUG:teuthology.orchestra.run.smithi184:mon.c> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mon.c.service 2024-02-05T07:13:15.434 DEBUG:teuthology.orchestra.run.smithi188:mon.b> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mon.b.service 2024-02-05T07:13:15.436 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-05T07:13:15.436 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-05T07:13:15.460 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:15 smithi184 ceph-mon[29861]: Updating smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-05T07:13:15.460 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:15 smithi184 ceph-mon[29861]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:15.460 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:15 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:15.460 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:15 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:15.460 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:15 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:15.460 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:15 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:15.461 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:15 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:15.461 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:15 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-05T07:13:15.461 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:15 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:16.134 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:13:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:16 smithi184 ceph-mon[29861]: from='client.14182 v1:172.21.15.188:0/1065518000' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi184:[v1:172.21.15.184:6789]=a;smithi184:[v1:172.21.15.184:6790]=c;smithi188:[v1:172.21.15.188:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:13:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:16 smithi184 ceph-mon[29861]: Saving service mon spec with placement smithi184:[v1:172.21.15.184:6789]=a;smithi184:[v1:172.21.15.184:6790]=c;smithi188:[v1:172.21.15.188:6789]=b;count:3 2024-02-05T07:13:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:16 smithi184 ceph-mon[29861]: Deploying daemon mon.b on smithi188 2024-02-05T07:13:17.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:17 smithi184 ceph-mon[29861]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:19.044 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.039+0000 7fbab3d94700 1 -- 172.21.15.188:0/3612254211 >> v1:172.21.15.184:6789/0 conn(0x7fbaac102890 legacy=0x7fbaac102c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:19.044 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.039+0000 7fbab3d94700 1 -- 172.21.15.188:0/3612254211 shutdown_connections 2024-02-05T07:13:19.044 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.039+0000 7fbab3d94700 1 -- 172.21.15.188:0/3612254211 >> 172.21.15.188:0/3612254211 conn(0x7fbaac0fc040 msgr2=0x7fbaac0fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:19.044 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.039+0000 7fbab3d94700 1 -- 172.21.15.188:0/3612254211 shutdown_connections 2024-02-05T07:13:19.044 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.039+0000 7fbab3d94700 1 -- 172.21.15.188:0/3612254211 wait complete. 2024-02-05T07:13:19.044 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.039+0000 7fbab3d94700 1 Processor -- start 2024-02-05T07:13:19.044 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.039+0000 7fbab3d94700 1 -- start start 2024-02-05T07:13:19.044 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.040+0000 7fbab3d94700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbaac1969e0 con 0x7fbaac102890 2024-02-05T07:13:19.044 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.040+0000 7fbab1b30700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fbaac102890 0x7fbaac1962d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.188:43958/0 (socket says 172.21.15.188:43958) 2024-02-05T07:13:19.044 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.040+0000 7fbab1b30700 1 -- 172.21.15.188:0/1473613097 learned_addr learned my addr 172.21.15.188:0/1473613097 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:13:19.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.040+0000 7fbaa2ffd700 1 -- 172.21.15.188:0/1473613097 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612298857 0 0) 0x7fbaac1969e0 con 0x7fbaac102890 2024-02-05T07:13:19.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.040+0000 7fbaa2ffd700 1 -- 172.21.15.188:0/1473613097 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba980054f0 con 0x7fbaac102890 2024-02-05T07:13:19.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.041+0000 7fbaa2ffd700 1 -- 172.21.15.188:0/1473613097 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3947806058 0 0) 0x7fba980054f0 con 0x7fbaac102890 2024-02-05T07:13:19.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.041+0000 7fbaa2ffd700 1 -- 172.21.15.188:0/1473613097 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbaac1969e0 con 0x7fbaac102890 2024-02-05T07:13:19.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.041+0000 7fbaa2ffd700 1 -- 172.21.15.188:0/1473613097 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fbaa80044b0 con 0x7fbaac102890 2024-02-05T07:13:19.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.041+0000 7fbaa2ffd700 1 -- 172.21.15.188:0/1473613097 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3545768603 0 0) 0x7fbaac1969e0 con 0x7fbaac102890 2024-02-05T07:13:19.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.041+0000 7fbaa2ffd700 1 -- 172.21.15.188:0/1473613097 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaac196b70 con 0x7fbaac102890 2024-02-05T07:13:19.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.041+0000 7fbab3d94700 1 -- 172.21.15.188:0/1473613097 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaac196e20 con 0x7fbaac102890 2024-02-05T07:13:19.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.041+0000 7fbab3d94700 1 -- 172.21.15.188:0/1473613097 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaac19f000 con 0x7fbaac102890 2024-02-05T07:13:19.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.041+0000 7fbaa2ffd700 1 -- 172.21.15.188:0/1473613097 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fbaa8001620 con 0x7fbaac102890 2024-02-05T07:13:19.045 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.041+0000 7fbaa2ffd700 1 -- 172.21.15.188:0/1473613097 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2625926556 0 0) 0x7fbaa8004e30 con 0x7fbaac102890 2024-02-05T07:13:19.046 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.042+0000 7fbaa2ffd700 1 -- 172.21.15.188:0/1473613097 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 13) v1 ==== 45954+0+0 (unknown 3144929400 0 0) 0x7fbaa8005030 con 0x7fbaac102890 2024-02-05T07:13:19.046 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.042+0000 7fbab3d94700 1 -- 172.21.15.188:0/1473613097 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba90005120 con 0x7fbaac102890 2024-02-05T07:13:19.046 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.042+0000 7fbaa2ffd700 1 -- 172.21.15.188:0/1473613097 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 2979786674 0 0) 0x7fbaa8047450 con 0x7fbaac102890 2024-02-05T07:13:19.049 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.047+0000 7fbaa2ffd700 1 -- 172.21.15.188:0/1473613097 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fbaa8016970 con 0x7fbaac102890 2024-02-05T07:13:19.346 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.344+0000 7fbab3d94700 1 -- 172.21.15.188:0/1473613097 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fba900053d0 con 0x7fbaac102890 2024-02-05T07:13:19.347 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.344+0000 7fbaa2ffd700 1 -- 172.21.15.188:0/1473613097 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+697 (unknown 2237029548 0 995307244) 0x7fbaa8014f70 con 0x7fbaac102890 2024-02-05T07:13:19.347 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:13:19.347 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":1,"fsid":"ae38c7f2-c3f5-11ee-95b6-87774f69a715","modified":"2024-02-05T07:11:41.133194Z","created":"2024-02-05T07:11:41.133194Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-05T07:13:19.349 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.346+0000 7fbab3d94700 1 -- 172.21.15.188:0/1473613097 >> v1:172.21.15.184:6800/2865218501 conn(0x7fba9803a240 legacy=0x7fba9803c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:19.349 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.346+0000 7fbab3d94700 1 -- 172.21.15.188:0/1473613097 >> v1:172.21.15.184:6789/0 conn(0x7fbaac102890 legacy=0x7fbaac1962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:19.349 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.346+0000 7fbab3d94700 1 -- 172.21.15.188:0/1473613097 shutdown_connections 2024-02-05T07:13:19.349 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.346+0000 7fbab3d94700 1 -- 172.21.15.188:0/1473613097 >> 172.21.15.188:0/1473613097 conn(0x7fbaac0fc040 msgr2=0x7fbaac107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:19.349 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.346+0000 7fbab3d94700 1 -- 172.21.15.188:0/1473613097 shutdown_connections 2024-02-05T07:13:19.349 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:19.346+0000 7fbab3d94700 1 -- 172.21.15.188:0/1473613097 wait complete. 2024-02-05T07:13:19.349 INFO:teuthology.orchestra.run.smithi188.stderr:dumped monmap epoch 1 2024-02-05T07:13:19.464 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-05T07:13:19.464 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-05T07:13:19.464 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-05T07:13:19.464 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-05T07:13:19.464 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-05T07:13:19.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:19 smithi184 ceph-mon[29861]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:19.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-05T07:13:19.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-05T07:13:19.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-05T07:13:19.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-05T07:13:19.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:19.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='client.14178 v1:172.21.15.184:0/1210240845' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-05T07:13:19.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:19.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4011216135' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-05T07:13:19.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4011216135' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-05T07:13:19.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: osdmap e4: 0 total, 0 up, 0 in 2024-02-05T07:13:19.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:19.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:19.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:19.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:19.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:19.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi188", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:13:19.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:19.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:19.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: Updating smithi188:/etc/ceph/ceph.conf 2024-02-05T07:13:19.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: Updating smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:13:19.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-02-05T07:13:19.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:19.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:19.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:19.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: Updating smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-05T07:13:19.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:19.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:19.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:19.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:19.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:19.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:19.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-05T07:13:19.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:19.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: from='client.14182 v1:172.21.15.188:0/1065518000' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi184:[v1:172.21.15.184:6789]=a;smithi184:[v1:172.21.15.184:6790]=c;smithi188:[v1:172.21.15.188:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:13:19.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: Saving service mon spec with placement smithi184:[v1:172.21.15.184:6789]=a;smithi184:[v1:172.21.15.184:6790]=c;smithi188:[v1:172.21.15.188:6789]=b;count:3 2024-02-05T07:13:19.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: Deploying daemon mon.b on smithi188 2024-02-05T07:13:19.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:19.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:19.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 ceph-mon[33283]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-02-05T07:13:20.131 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 bash[33231]: 82e6b8bfd0210874c82d7e520993ea59f0759808ac829030c516a53fea8e1b9a 2024-02-05T07:13:20.131 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:19 smithi188 systemd[1]: Started Ceph mon.b for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:13:21.158 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-05T07:13:21.159 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-05T07:13:21.408 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:13:24.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.504+0000 7fb798db7700 1 -- 172.21.15.188:0/1523881076 >> v1:172.21.15.184:6789/0 conn(0x7fb794106670 legacy=0x7fb794106a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:24.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.504+0000 7fb798db7700 1 -- 172.21.15.188:0/1523881076 shutdown_connections 2024-02-05T07:13:24.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.504+0000 7fb798db7700 1 -- 172.21.15.188:0/1523881076 >> 172.21.15.188:0/1523881076 conn(0x7fb7940fc160 msgr2=0x7fb7940fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:24.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.504+0000 7fb798db7700 1 -- 172.21.15.188:0/1523881076 shutdown_connections 2024-02-05T07:13:24.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.504+0000 7fb798db7700 1 -- 172.21.15.188:0/1523881076 wait complete. 2024-02-05T07:13:24.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.506+0000 7fb798db7700 1 Processor -- start 2024-02-05T07:13:24.508 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.506+0000 7fb798db7700 1 -- start start 2024-02-05T07:13:24.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.506+0000 7fb798db7700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb7941a1600 con 0x7fb794195a80 2024-02-05T07:13:24.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.506+0000 7fb798db7700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb7941a27a0 con 0x7fb794106670 2024-02-05T07:13:24.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.506+0000 7fb79259c700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fb794106670 0x7fb794195370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:43762/0 (socket says 172.21.15.188:43762) 2024-02-05T07:13:24.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.506+0000 7fb79259c700 1 -- 172.21.15.188:0/4094160402 learned_addr learned my addr 172.21.15.188:0/4094160402 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:13:24.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.507+0000 7fb7837fe700 1 -- 172.21.15.188:0/4094160402 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046235232 0 0) 0x7fb7941a1600 con 0x7fb794195a80 2024-02-05T07:13:24.509 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.507+0000 7fb7837fe700 1 -- 172.21.15.188:0/4094160402 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb77c0035b0 con 0x7fb794195a80 2024-02-05T07:13:24.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.509+0000 7fb7837fe700 1 -- 172.21.15.188:0/4094160402 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1076658832 0 0) 0x7fb77c0035b0 con 0x7fb794195a80 2024-02-05T07:13:24.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.509+0000 7fb7837fe700 1 -- 172.21.15.188:0/4094160402 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb7941a1600 con 0x7fb794195a80 2024-02-05T07:13:24.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.509+0000 7fb7837fe700 1 -- 172.21.15.188:0/4094160402 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 239+0+0 (unknown 2740219295 0 0) 0x7fb7840017e0 con 0x7fb794195a80 2024-02-05T07:13:24.511 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.509+0000 7fb7837fe700 1 -- 172.21.15.188:0/4094160402 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2970398821 0 0) 0x7fb7941a1600 con 0x7fb794195a80 2024-02-05T07:13:24.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.509+0000 7fb7837fe700 1 -- 172.21.15.188:0/4094160402 >> v1:172.21.15.188:6789/0 conn(0x7fb794106670 legacy=0x7fb794195370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:24.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.509+0000 7fb7837fe700 1 -- 172.21.15.188:0/4094160402 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7941a3940 con 0x7fb794195a80 2024-02-05T07:13:24.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.509+0000 7fb798db7700 1 -- 172.21.15.188:0/4094160402 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7941a1790 con 0x7fb794195a80 2024-02-05T07:13:24.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.509+0000 7fb798db7700 1 -- 172.21.15.188:0/4094160402 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7941a1c50 con 0x7fb794195a80 2024-02-05T07:13:24.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.509+0000 7fb7837fe700 1 -- 172.21.15.188:0/4094160402 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fb784003b10 con 0x7fb794195a80 2024-02-05T07:13:24.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.509+0000 7fb7837fe700 1 -- 172.21.15.188:0/4094160402 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 239+0+0 (unknown 2740219295 0 0) 0x7fb784004990 con 0x7fb794195a80 2024-02-05T07:13:24.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.510+0000 7fb7837fe700 1 -- 172.21.15.188:0/4094160402 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 13) v1 ==== 45954+0+0 (unknown 3144929400 0 0) 0x7fb78400fea0 con 0x7fb794195a80 2024-02-05T07:13:24.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.510+0000 7fb798db7700 1 -- 172.21.15.188:0/4094160402 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb774005120 con 0x7fb794195a80 2024-02-05T07:13:24.512 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.510+0000 7fb7837fe700 1 -- 172.21.15.188:0/4094160402 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 2979786674 0 0) 0x7fb784046cc0 con 0x7fb794195a80 2024-02-05T07:13:24.518 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.517+0000 7fb7837fe700 1 -- 172.21.15.188:0/4094160402 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fb784015550 con 0x7fb794195a80 2024-02-05T07:13:24.805 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.802+0000 7fb798db7700 1 -- 172.21.15.188:0/4094160402 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb7740053d0 con 0x7fb794195a80 2024-02-05T07:13:24.805 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:13:24.805 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: mon.a calling monitor election 2024-02-05T07:13:24.805 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:24.805 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:24.805 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: mon.b calling monitor election 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: monmap e2: 2 mons at {a=v1:172.21.15.184:6789/0,b=v1:172.21.15.188:6789/0} removed_ranks: {} disallowed_leaders: {} 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: fsmap 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: osdmap e4: 0 total, 0 up, 0 in 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: mgrmap e13: y(active, since 40s) 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: overall HEALTH_OK 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:24.806 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:24.807 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-05T07:13:24.807 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:24 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:24.807 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.803+0000 7fb7837fe700 1 -- 172.21.15.188:0/4094160402 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+915 (unknown 3557084514 0 626814124) 0x7fb784013920 con 0x7fb794195a80 2024-02-05T07:13:24.807 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:13:24.807 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":2,"fsid":"ae38c7f2-c3f5-11ee-95b6-87774f69a715","modified":"2024-02-05T07:13:19.467174Z","created":"2024-02-05T07:11:41.133194Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6789","nonce":0}]},"addr":"172.21.15.188:6789/0","public_addr":"172.21.15.188:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-05T07:13:24.808 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.805+0000 7fb798db7700 1 -- 172.21.15.188:0/4094160402 >> v1:172.21.15.184:6800/2865218501 conn(0x7fb77c03a3a0 legacy=0x7fb77c03c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:24.808 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.805+0000 7fb798db7700 1 -- 172.21.15.188:0/4094160402 >> v1:172.21.15.184:6789/0 conn(0x7fb794195a80 legacy=0x7fb79419fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:24.808 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.805+0000 7fb798db7700 1 -- 172.21.15.188:0/4094160402 shutdown_connections 2024-02-05T07:13:24.808 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.805+0000 7fb798db7700 1 -- 172.21.15.188:0/4094160402 >> 172.21.15.188:0/4094160402 conn(0x7fb7940fc160 msgr2=0x7fb794108570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:24.808 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.806+0000 7fb798db7700 1 -- 172.21.15.188:0/4094160402 shutdown_connections 2024-02-05T07:13:24.808 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:24.806+0000 7fb798db7700 1 -- 172.21.15.188:0/4094160402 wait complete. 2024-02-05T07:13:24.809 INFO:teuthology.orchestra.run.smithi188.stderr:dumped monmap epoch 2 2024-02-05T07:13:25.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:13:25.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: mon.a calling monitor election 2024-02-05T07:13:25.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:25.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:25.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:25.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:25.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: mon.b calling monitor election 2024-02-05T07:13:25.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:25.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:25.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:25.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:25.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:25.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-05T07:13:25.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: monmap e2: 2 mons at {a=v1:172.21.15.184:6789/0,b=v1:172.21.15.188:6789/0} removed_ranks: {} disallowed_leaders: {} 2024-02-05T07:13:25.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: fsmap 2024-02-05T07:13:25.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: osdmap e4: 0 total, 0 up, 0 in 2024-02-05T07:13:25.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: mgrmap e13: y(active, since 40s) 2024-02-05T07:13:25.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: overall HEALTH_OK 2024-02-05T07:13:25.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:25.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:25.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:25.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-05T07:13:25.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:24 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:25.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:25 smithi188 ceph-mon[33283]: Deploying daemon mon.c on smithi184 2024-02-05T07:13:25.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.188:0/4094160402' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-05T07:13:25.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:25 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:25.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:25 smithi184 ceph-mon[29861]: Deploying daemon mon.c on smithi184 2024-02-05T07:13:25.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.188:0/4094160402' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-05T07:13:25.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:25 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:26.466 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-05T07:13:26.466 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph mon dump -f json 2024-02-05T07:13:26.711 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:13:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:26 smithi188 ceph-mon[33283]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:26.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:26 smithi184 ceph-mon[29861]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:27.707 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 systemd[1]: Starting Ceph mon.c for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:13:27.967 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 podman[41572]: 2024-02-05 07:13:27.705445301 +0000 UTC m=+0.100378989 container create af1dea666a1e14d9aa23d20cbe090f1e01f6ddad7532f685a75a119338d9164b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-c, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0) 2024-02-05T07:13:27.967 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 podman[41572]: 2024-02-05 07:13:27.623131572 +0000 UTC m=+0.018065264 image pull 8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0 2024-02-05T07:13:27.968 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 podman[41572]: 2024-02-05 07:13:27.884393942 +0000 UTC m=+0.279327639 container init af1dea666a1e14d9aa23d20cbe090f1e01f6ddad7532f685a75a119338d9164b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-05T07:13:27.968 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 podman[41572]: 2024-02-05 07:13:27.889754015 +0000 UTC m=+0.284687704 container start af1dea666a1e14d9aa23d20cbe090f1e01f6ddad7532f685a75a119338d9164b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, ceph=True) 2024-02-05T07:13:27.968 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: set uid:gid to 167:167 (ceph:ceph) 2024-02-05T07:13:27.968 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: ceph version 19.0.0-1241-g164d3be4 (164d3be4a527be775f4d3c343ea591122f1b8921) squid (dev), process ceph-mon, pid 7 2024-02-05T07:13:27.968 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: pidfile_write: ignore empty --pid-file 2024-02-05T07:13:27.968 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: load: jerasure load: lrc 2024-02-05T07:13:27.968 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: RocksDB version: 7.9.2 2024-02-05T07:13:27.968 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Git sha 0 2024-02-05T07:13:27.968 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Compile date 2024-02-04 23:11:06 2024-02-05T07:13:27.968 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: DB SUMMARY 2024-02-05T07:13:27.969 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: DB Session ID: J6CJ2LBFJV95BZ5HO71S 2024-02-05T07:13:27.969 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: CURRENT file: CURRENT 2024-02-05T07:13:27.969 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: IDENTITY file: IDENTITY 2024-02-05T07:13:27.969 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-02-05T07:13:27.969 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-02-05T07:13:27.971 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 566 ; 2024-02-05T07:13:27.971 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.error_if_exists: 0 2024-02-05T07:13:27.971 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.create_if_missing: 0 2024-02-05T07:13:27.971 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.paranoid_checks: 1 2024-02-05T07:13:27.971 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-05T07:13:27.971 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-05T07:13:27.971 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-05T07:13:27.972 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.env: 0x557470676ae0 2024-02-05T07:13:27.972 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.fs: PosixFileSystem 2024-02-05T07:13:27.972 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.info_log: 0x557471c4b8e0 2024-02-05T07:13:27.972 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_file_opening_threads: 16 2024-02-05T07:13:27.972 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.statistics: (nil) 2024-02-05T07:13:27.972 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.use_fsync: 0 2024-02-05T07:13:27.972 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_log_file_size: 0 2024-02-05T07:13:27.972 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-05T07:13:27.972 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-05T07:13:27.972 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.keep_log_file_num: 1000 2024-02-05T07:13:27.972 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.recycle_log_file_num: 0 2024-02-05T07:13:27.972 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.allow_fallocate: 1 2024-02-05T07:13:27.972 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.allow_mmap_reads: 0 2024-02-05T07:13:27.973 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.allow_mmap_writes: 0 2024-02-05T07:13:27.973 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.use_direct_reads: 0 2024-02-05T07:13:27.973 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-05T07:13:27.973 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.create_missing_column_families: 0 2024-02-05T07:13:27.973 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.db_log_dir: 2024-02-05T07:13:27.973 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.wal_dir: 2024-02-05T07:13:27.973 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-05T07:13:27.973 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-05T07:13:27.973 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-05T07:13:27.973 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-05T07:13:27.973 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-05T07:13:27.973 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-05T07:13:27.973 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.advise_random_on_open: 1 2024-02-05T07:13:27.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.db_write_buffer_size: 0 2024-02-05T07:13:27.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.write_buffer_manager: 0x557471c1f400 2024-02-05T07:13:27.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-05T07:13:27.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-05T07:13:27.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-05T07:13:27.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.rate_limiter: (nil) 2024-02-05T07:13:27.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-05T07:13:27.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.wal_recovery_mode: 2 2024-02-05T07:13:27.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.enable_thread_tracking: 0 2024-02-05T07:13:27.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.enable_pipelined_write: 0 2024-02-05T07:13:27.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.unordered_write: 0 2024-02-05T07:13:27.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-05T07:13:27.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-05T07:13:27.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-05T07:13:27.974 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-05T07:13:27.975 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.row_cache: None 2024-02-05T07:13:27.975 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.wal_filter: None 2024-02-05T07:13:27.975 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-05T07:13:27.975 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.allow_ingest_behind: 0 2024-02-05T07:13:27.975 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.two_write_queues: 0 2024-02-05T07:13:27.975 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.manual_wal_flush: 0 2024-02-05T07:13:27.975 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.wal_compression: 0 2024-02-05T07:13:27.975 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.atomic_flush: 0 2024-02-05T07:13:27.975 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-05T07:13:27.975 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-05T07:13:27.975 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-05T07:13:27.975 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.log_readahead_size: 0 2024-02-05T07:13:27.975 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-05T07:13:27.976 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.best_efforts_recovery: 0 2024-02-05T07:13:27.976 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-05T07:13:27.976 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-05T07:13:27.976 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.allow_data_in_errors: 0 2024-02-05T07:13:27.976 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.db_host_id: __hostname__ 2024-02-05T07:13:27.976 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-05T07:13:27.976 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_background_jobs: 2 2024-02-05T07:13:27.976 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_background_compactions: -1 2024-02-05T07:13:27.976 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_subcompactions: 1 2024-02-05T07:13:27.976 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-05T07:13:27.976 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-05T07:13:27.976 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-05T07:13:27.976 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_total_wal_size: 0 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_open_files: -1 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.bytes_per_sync: 0 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compaction_readahead_size: 0 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_background_flushes: -1 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Compression algorithms supported: 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: kZSTD supported: 0 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: kXpressCompression supported: 0 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: kLZ4HCCompression supported: 1 2024-02-05T07:13:27.977 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: kZlibCompression supported: 1 2024-02-05T07:13:27.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: kSnappyCompression supported: 1 2024-02-05T07:13:27.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: kLZ4Compression supported: 1 2024-02-05T07:13:27.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: kBZip2Compression supported: 0 2024-02-05T07:13:27.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-05T07:13:27.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-05T07:13:27.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-02-05T07:13:27.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-05T07:13:27.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-05T07:13:27.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.merge_operator: 2024-02-05T07:13:27.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compaction_filter: None 2024-02-05T07:13:27.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compaction_filter_factory: None 2024-02-05T07:13:27.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.sst_partitioner_factory: None 2024-02-05T07:13:27.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-05T07:13:27.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-05T07:13:27.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557471c4b9e0) 2024-02-05T07:13:27.979 INFO:journalctl@ceph.mon.c.smithi184.stdout: cache_index_and_filter_blocks: 1 2024-02-05T07:13:27.979 INFO:journalctl@ceph.mon.c.smithi184.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-05T07:13:27.979 INFO:journalctl@ceph.mon.c.smithi184.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-05T07:13:27.979 INFO:journalctl@ceph.mon.c.smithi184.stdout: pin_top_level_index_and_filter: 1 2024-02-05T07:13:27.979 INFO:journalctl@ceph.mon.c.smithi184.stdout: index_type: 0 2024-02-05T07:13:27.979 INFO:journalctl@ceph.mon.c.smithi184.stdout: data_block_index_type: 0 2024-02-05T07:13:27.979 INFO:journalctl@ceph.mon.c.smithi184.stdout: index_shortening: 1 2024-02-05T07:13:27.979 INFO:journalctl@ceph.mon.c.smithi184.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-05T07:13:27.979 INFO:journalctl@ceph.mon.c.smithi184.stdout: checksum: 4 2024-02-05T07:13:27.979 INFO:journalctl@ceph.mon.c.smithi184.stdout: no_block_cache: 0 2024-02-05T07:13:27.979 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache: 0x557471c4f090 2024-02-05T07:13:27.979 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache_name: BinnedLRUCache 2024-02-05T07:13:27.979 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache_options: 2024-02-05T07:13:27.979 INFO:journalctl@ceph.mon.c.smithi184.stdout: capacity : 536870912 2024-02-05T07:13:27.979 INFO:journalctl@ceph.mon.c.smithi184.stdout: num_shard_bits : 4 2024-02-05T07:13:27.980 INFO:journalctl@ceph.mon.c.smithi184.stdout: strict_capacity_limit : 0 2024-02-05T07:13:27.980 INFO:journalctl@ceph.mon.c.smithi184.stdout: high_pri_pool_ratio: 0.000 2024-02-05T07:13:27.980 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_cache_compressed: (nil) 2024-02-05T07:13:27.980 INFO:journalctl@ceph.mon.c.smithi184.stdout: persistent_cache: (nil) 2024-02-05T07:13:27.980 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_size: 4096 2024-02-05T07:13:27.980 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_size_deviation: 10 2024-02-05T07:13:27.980 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_restart_interval: 16 2024-02-05T07:13:27.980 INFO:journalctl@ceph.mon.c.smithi184.stdout: index_block_restart_interval: 1 2024-02-05T07:13:27.980 INFO:journalctl@ceph.mon.c.smithi184.stdout: metadata_block_size: 4096 2024-02-05T07:13:27.980 INFO:journalctl@ceph.mon.c.smithi184.stdout: partition_filters: 0 2024-02-05T07:13:27.980 INFO:journalctl@ceph.mon.c.smithi184.stdout: use_delta_encoding: 1 2024-02-05T07:13:27.980 INFO:journalctl@ceph.mon.c.smithi184.stdout: filter_policy: bloomfilter 2024-02-05T07:13:27.980 INFO:journalctl@ceph.mon.c.smithi184.stdout: whole_key_filtering: 1 2024-02-05T07:13:27.980 INFO:journalctl@ceph.mon.c.smithi184.stdout: verify_compression: 0 2024-02-05T07:13:27.981 INFO:journalctl@ceph.mon.c.smithi184.stdout: read_amp_bytes_per_bit: 0 2024-02-05T07:13:27.981 INFO:journalctl@ceph.mon.c.smithi184.stdout: format_version: 5 2024-02-05T07:13:27.981 INFO:journalctl@ceph.mon.c.smithi184.stdout: enable_index_compression: 1 2024-02-05T07:13:27.981 INFO:journalctl@ceph.mon.c.smithi184.stdout: block_align: 0 2024-02-05T07:13:27.981 INFO:journalctl@ceph.mon.c.smithi184.stdout: max_auto_readahead_size: 262144 2024-02-05T07:13:27.981 INFO:journalctl@ceph.mon.c.smithi184.stdout: prepopulate_block_cache: 0 2024-02-05T07:13:27.981 INFO:journalctl@ceph.mon.c.smithi184.stdout: initial_auto_readahead_size: 8192 2024-02-05T07:13:27.981 INFO:journalctl@ceph.mon.c.smithi184.stdout: num_file_reads_for_auto_readahead: 2 2024-02-05T07:13:27.981 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.write_buffer_size: 33554432 2024-02-05T07:13:27.981 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_write_buffer_number: 2 2024-02-05T07:13:27.981 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compression: NoCompression 2024-02-05T07:13:27.981 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.bottommost_compression: Disabled 2024-02-05T07:13:27.981 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.prefix_extractor: nullptr 2024-02-05T07:13:27.981 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.num_levels: 7 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compression_opts.level: 32767 2024-02-05T07:13:27.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compression_opts.strategy: 0 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compression_opts.enabled: false 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.target_file_size_base: 67108864 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-05T07:13:27.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-05T07:13:27.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-05T07:13:27.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-05T07:13:27.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-05T07:13:27.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-05T07:13:27.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-05T07:13:27.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-05T07:13:27.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-05T07:13:27.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-05T07:13:27.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.arena_block_size: 1048576 2024-02-05T07:13:27.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-05T07:13:27.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-05T07:13:27.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.disable_auto_compactions: 0 2024-02-05T07:13:27.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-05T07:13:27.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-05T07:13:27.984 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.table_properties_collectors: 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.inplace_update_support: 0 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.bloom_locality: 0 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.max_successive_merges: 0 2024-02-05T07:13:27.985 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.paranoid_file_checks: 0 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.force_consistency_checks: 1 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.report_bg_io_stats: 0 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.ttl: 2592000 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.enable_blob_files: false 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.min_blob_size: 0 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.blob_file_size: 268435456 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-05T07:13:27.986 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.blob_file_starting_level: 0 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 81105ba1-def2-4788-88bf-e86f205a8d7c 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707117207919272, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707117207919661, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1677, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 578, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 456, "raw_average_value_size": 91, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1707117207, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "81105ba1-def2-4788-88bf-e86f205a8d7c", "db_session_id": "J6CJ2LBFJV95BZ5HO71S", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: EVENT_LOG_v1 {"time_micros": 1707117207919739, "job": 1, "event": "recovery_finished"} 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557471d40000 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: DB pointer 0x557471d2a000 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** DB Stats ** 2024-02-05T07:13:27.987 INFO:journalctl@ceph.mon.c.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-05T07:13:27.988 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-05T07:13:27.988 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-05T07:13:27.988 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-05T07:13:27.988 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-05T07:13:27.988 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-05T07:13:27.988 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-05T07:13:27.988 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-02-05T07:13:27.988 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** Compaction Stats [default] ** 2024-02-05T07:13:27.988 INFO:journalctl@ceph.mon.c.smithi184.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-05T07:13:27.988 INFO:journalctl@ceph.mon.c.smithi184.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-05T07:13:27.988 INFO:journalctl@ceph.mon.c.smithi184.stdout: L0 1/0 1.64 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-02-05T07:13:27.988 INFO:journalctl@ceph.mon.c.smithi184.stdout: Sum 1/0 1.64 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-02-05T07:13:27.988 INFO:journalctl@ceph.mon.c.smithi184.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-02-05T07:13:27.988 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-02-05T07:13:27.989 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** Compaction Stats [default] ** 2024-02-05T07:13:27.989 INFO:journalctl@ceph.mon.c.smithi184.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-05T07:13:27.989 INFO:journalctl@ceph.mon.c.smithi184.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-05T07:13:27.989 INFO:journalctl@ceph.mon.c.smithi184.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-02-05T07:13:27.989 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-02-05T07:13:27.989 INFO:journalctl@ceph.mon.c.smithi184.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-05T07:13:27.989 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-02-05T07:13:27.989 INFO:journalctl@ceph.mon.c.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-05T07:13:27.989 INFO:journalctl@ceph.mon.c.smithi184.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-05T07:13:27.989 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-05T07:13:27.989 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-05T07:13:27.989 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-05T07:13:27.989 INFO:journalctl@ceph.mon.c.smithi184.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-05T07:13:27.989 INFO:journalctl@ceph.mon.c.smithi184.stdout: Cumulative compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-05T07:13:27.989 INFO:journalctl@ceph.mon.c.smithi184.stdout: Interval compaction: 0.00 GB write, 0.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout: Block cache BinnedLRUCache@0x557471c4f090#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: using public_addrv v1:172.21.15.184:6790/0 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: starting mon.c rank -1 at public addrs v1:172.21.15.184:6790/0 at bind addrs v1:172.21.15.184:6790/0 mon_data /var/lib/ceph/mon/ceph-c fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.c@-1(???) e0 preinit fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.c@-1(synchronizing).mds e1 new map 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.c@-1(synchronizing).mds e1 print_map 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout: e1 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout: legacy client fscid: -1 2024-02-05T07:13:27.990 INFO:journalctl@ceph.mon.c.smithi184.stdout: 2024-02-05T07:13:27.991 INFO:journalctl@ceph.mon.c.smithi184.stdout: No filesystems configured 2024-02-05T07:13:27.991 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-05T07:13:27.991 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-05T07:13:27.991 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-05T07:13:27.991 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-05T07:13:27.991 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-05T07:13:27.991 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-05T07:13:27.991 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-05T07:13:27.991 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-05T07:13:27.991 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-05T07:13:27.991 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-05T07:13:27.991 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:27.991 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='client.14178 v1:172.21.15.184:0/1210240845' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-05T07:13:27.992 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:27.992 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4011216135' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-05T07:13:27.992 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4011216135' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-05T07:13:27.992 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: osdmap e4: 0 total, 0 up, 0 in 2024-02-05T07:13:27.992 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:27.992 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:27.992 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:27.992 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:27.992 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:27.992 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi188", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:13:27.992 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:27.992 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:27.992 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: Updating smithi188:/etc/ceph/ceph.conf 2024-02-05T07:13:27.993 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: Updating smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:13:27.993 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-02-05T07:13:27.993 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:27.993 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:27.993 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:27.993 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: Updating smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-05T07:13:27.993 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:27.993 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:27.993 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:27.993 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:27.993 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:27.993 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:27.993 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='client.14182 v1:172.21.15.188:0/1065518000' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi184:[v1:172.21.15.184:6789]=a;smithi184:[v1:172.21.15.184:6790]=c;smithi188:[v1:172.21.15.188:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: Saving service mon spec with placement smithi184:[v1:172.21.15.184:6789]=a;smithi184:[v1:172.21.15.184:6790]=c;smithi188:[v1:172.21.15.188:6789]=b;count:3 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: Deploying daemon mon.b on smithi188 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.a calling monitor election 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.b calling monitor election 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:27.994 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:27.995 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:27.995 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:27.995 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-05T07:13:27.995 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: monmap e2: 2 mons at {a=v1:172.21.15.184:6789/0,b=v1:172.21.15.188:6789/0} removed_ranks: {} disallowed_leaders: {} 2024-02-05T07:13:27.995 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: fsmap 2024-02-05T07:13:27.995 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: osdmap e4: 0 total, 0 up, 0 in 2024-02-05T07:13:27.995 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mgrmap e13: y(active, since 40s) 2024-02-05T07:13:27.995 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: overall HEALTH_OK 2024-02-05T07:13:27.995 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:27.995 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:27.995 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:27.995 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-05T07:13:27.995 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:27.996 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: Deploying daemon mon.c on smithi184 2024-02-05T07:13:27.996 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.188:0/4094160402' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-05T07:13:27.996 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:27.996 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:27.996 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 ceph-mon[41609]: mon.c@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2024-02-05T07:13:27.996 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 bash[41572]: af1dea666a1e14d9aa23d20cbe090f1e01f6ddad7532f685a75a119338d9164b 2024-02-05T07:13:28.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:27 smithi184 systemd[1]: Started Ceph mon.c for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:13:32.997 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.994+0000 7fd6e025e700 1 -- 172.21.15.188:0/2624327908 >> v1:172.21.15.184:6789/0 conn(0x7fd6bc0035f0 legacy=0x7fd6bc005a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:32.997 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.994+0000 7fd6e025e700 1 -- 172.21.15.188:0/2624327908 shutdown_connections 2024-02-05T07:13:32.998 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.995+0000 7fd6e025e700 1 -- 172.21.15.188:0/2624327908 >> 172.21.15.188:0/2624327908 conn(0x7fd6d80fd2b0 msgr2=0x7fd6d80ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:32.998 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.995+0000 7fd6e025e700 1 -- 172.21.15.188:0/2624327908 shutdown_connections 2024-02-05T07:13:32.998 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.995+0000 7fd6e025e700 1 -- 172.21.15.188:0/2624327908 wait complete. 2024-02-05T07:13:32.999 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.996+0000 7fd6e025e700 1 Processor -- start 2024-02-05T07:13:32.999 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.996+0000 7fd6e025e700 1 -- start start 2024-02-05T07:13:32.999 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.996+0000 7fd6e025e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd6d81a6320 con 0x7fd6d81a2650 2024-02-05T07:13:32.999 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.996+0000 7fd6e025e700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd6d81a7500 con 0x7fd6d8196ad0 2024-02-05T07:13:32.999 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.996+0000 7fd6e025e700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd6d81a8700 con 0x7fd6bc0035f0 2024-02-05T07:13:32.999 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.996+0000 7fd6dd7f9700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fd6d8196ad0 0x7fd6d81a0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:52456/0 (socket says 172.21.15.188:52456) 2024-02-05T07:13:32.999 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.996+0000 7fd6dd7f9700 1 -- 172.21.15.188:0/2535147968 learned_addr learned my addr 172.21.15.188:0/2535147968 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:13:32.999 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.996+0000 7fd6de7fb700 1 --1- 172.21.15.188:0/2535147968 >> v1:172.21.15.184:6789/0 conn(0x7fd6d81a2650 0x7fd6d81a4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.188:52202/0 (socket says 172.21.15.188:52202) 2024-02-05T07:13:33.000 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.998+0000 7fd6ceffd700 1 -- 172.21.15.188:0/2535147968 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2670132681 0 0) 0x7fd6d81a6320 con 0x7fd6d81a2650 2024-02-05T07:13:33.000 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.998+0000 7fd6ceffd700 1 -- 172.21.15.188:0/2535147968 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6c4003bb0 con 0x7fd6d81a2650 2024-02-05T07:13:33.001 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.998+0000 7fd6ceffd700 1 -- 172.21.15.188:0/2535147968 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1587891781 0 0) 0x7fd6c4003bb0 con 0x7fd6d81a2650 2024-02-05T07:13:33.001 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.999+0000 7fd6ceffd700 1 -- 172.21.15.188:0/2535147968 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd6d81a6320 con 0x7fd6d81a2650 2024-02-05T07:13:33.001 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.999+0000 7fd6ceffd700 1 -- 172.21.15.188:0/2535147968 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fd6d0001b70 con 0x7fd6d81a2650 2024-02-05T07:13:33.002 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.999+0000 7fd6ceffd700 1 -- 172.21.15.188:0/2535147968 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 512889085 0 0) 0x7fd6d81a6320 con 0x7fd6d81a2650 2024-02-05T07:13:33.002 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.999+0000 7fd6ceffd700 1 -- 172.21.15.188:0/2535147968 >> v1:172.21.15.184:6790/0 conn(0x7fd6bc0035f0 legacy=0x7fd6d81963c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:33.002 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.999+0000 7fd6ceffd700 1 -- 172.21.15.188:0/2535147968 >> v1:172.21.15.188:6789/0 conn(0x7fd6d8196ad0 legacy=0x7fd6d81a0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:33.002 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.999+0000 7fd6ceffd700 1 -- 172.21.15.188:0/2535147968 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d81a9900 con 0x7fd6d81a2650 2024-02-05T07:13:33.002 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.999+0000 7fd6e025e700 1 -- 172.21.15.188:0/2535147968 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d81a6510 con 0x7fd6d81a2650 2024-02-05T07:13:33.002 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.999+0000 7fd6e025e700 1 -- 172.21.15.188:0/2535147968 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d81a69d0 con 0x7fd6d81a2650 2024-02-05T07:13:33.002 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.999+0000 7fd6ceffd700 1 -- 172.21.15.188:0/2535147968 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fd6d0002160 con 0x7fd6d81a2650 2024-02-05T07:13:33.002 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:32.999+0000 7fd6ceffd700 1 -- 172.21.15.188:0/2535147968 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fd6d0005f20 con 0x7fd6d81a2650 2024-02-05T07:13:33.003 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:33.000+0000 7fd6ceffd700 1 -- 172.21.15.188:0/2535147968 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 13) v1 ==== 45954+0+0 (unknown 3144929400 0 0) 0x7fd6d00060a0 con 0x7fd6d81a2650 2024-02-05T07:13:33.003 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:33.000+0000 7fd6e025e700 1 -- 172.21.15.188:0/2535147968 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6bc006b70 con 0x7fd6d81a2650 2024-02-05T07:13:33.003 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:33.000+0000 7fd6ceffd700 1 -- 172.21.15.188:0/2535147968 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 2979786674 0 0) 0x7fd6d0048210 con 0x7fd6d81a2650 2024-02-05T07:13:33.008 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:33.005+0000 7fd6ceffd700 1 -- 172.21.15.188:0/2535147968 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fd6d0007a00 con 0x7fd6d81a2650 2024-02-05T07:13:33.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:13:33.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: mon.a calling monitor election 2024-02-05T07:13:33.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: mon.b calling monitor election 2024-02-05T07:13:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: mon.c calling monitor election 2024-02-05T07:13:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: mon.a calling monitor election 2024-02-05T07:13:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-02-05T07:13:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: monmap e3: 3 mons at {a=v1:172.21.15.184:6789/0,b=v1:172.21.15.188:6789/0,c=v1:172.21.15.184:6790/0} removed_ranks: {} disallowed_leaders: {} 2024-02-05T07:13:33.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: fsmap 2024-02-05T07:13:33.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: osdmap e4: 0 total, 0 up, 0 in 2024-02-05T07:13:33.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: mgrmap e13: y(active, since 48s) 2024-02-05T07:13:33.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: overall HEALTH_OK 2024-02-05T07:13:33.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:33.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:33.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:33.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:33 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:33.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:33.290+0000 7fd6e025e700 1 -- 172.21.15.188:0/2535147968 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd6bc006e20 con 0x7fd6d81a2650 2024-02-05T07:13:33.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:33.291+0000 7fd6ceffd700 1 -- 172.21.15.188:0/2535147968 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1133 (unknown 409899127 0 3000797300) 0x7fd6d0014e70 con 0x7fd6d81a2650 2024-02-05T07:13:33.293 INFO:teuthology.orchestra.run.smithi188.stdout: 2024-02-05T07:13:33.293 INFO:teuthology.orchestra.run.smithi188.stdout:{"epoch":3,"fsid":"ae38c7f2-c3f5-11ee-95b6-87774f69a715","modified":"2024-02-05T07:13:27.941311Z","created":"2024-02-05T07:11:41.133194Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6789","nonce":0}]},"addr":"172.21.15.188:6789/0","public_addr":"172.21.15.188:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6790","nonce":0}]},"addr":"172.21.15.184:6790/0","public_addr":"172.21.15.184:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-02-05T07:13:33.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:33.293+0000 7fd6e025e700 1 -- 172.21.15.188:0/2535147968 >> v1:172.21.15.184:6800/2865218501 conn(0x7fd6c403a190 legacy=0x7fd6c403c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:33.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:33.293+0000 7fd6e025e700 1 -- 172.21.15.188:0/2535147968 >> v1:172.21.15.184:6789/0 conn(0x7fd6d81a2650 legacy=0x7fd6d81a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:33.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:33.293+0000 7fd6e025e700 1 -- 172.21.15.188:0/2535147968 shutdown_connections 2024-02-05T07:13:33.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:33.293+0000 7fd6e025e700 1 -- 172.21.15.188:0/2535147968 >> 172.21.15.188:0/2535147968 conn(0x7fd6d80fd2b0 msgr2=0x7fd6d8105290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:33.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:33.293+0000 7fd6e025e700 1 -- 172.21.15.188:0/2535147968 shutdown_connections 2024-02-05T07:13:33.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:33.294+0000 7fd6e025e700 1 -- 172.21.15.188:0/2535147968 wait complete. 2024-02-05T07:13:33.296 INFO:teuthology.orchestra.run.smithi188.stderr:dumped monmap epoch 3 2024-02-05T07:13:33.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:13:33.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: mon.a calling monitor election 2024-02-05T07:13:33.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: mon.b calling monitor election 2024-02-05T07:13:33.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:33.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:33.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: mon.c calling monitor election 2024-02-05T07:13:33.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:33.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:33.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: mon.a calling monitor election 2024-02-05T07:13:33.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-02-05T07:13:33.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: monmap e3: 3 mons at {a=v1:172.21.15.184:6789/0,b=v1:172.21.15.188:6789/0,c=v1:172.21.15.184:6790/0} removed_ranks: {} disallowed_leaders: {} 2024-02-05T07:13:33.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: fsmap 2024-02-05T07:13:33.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: osdmap e4: 0 total, 0 up, 0 in 2024-02-05T07:13:33.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: mgrmap e13: y(active, since 48s) 2024-02-05T07:13:33.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: overall HEALTH_OK 2024-02-05T07:13:33.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:33.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:33.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:33.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:33.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:13:33.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: mon.a calling monitor election 2024-02-05T07:13:33.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: mon.b calling monitor election 2024-02-05T07:13:33.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:13:33.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:33.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: mon.c calling monitor election 2024-02-05T07:13:33.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:33.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:33.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:33.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: mon.a calling monitor election 2024-02-05T07:13:33.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-02-05T07:13:33.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: monmap e3: 3 mons at {a=v1:172.21.15.184:6789/0,b=v1:172.21.15.188:6789/0,c=v1:172.21.15.184:6790/0} removed_ranks: {} disallowed_leaders: {} 2024-02-05T07:13:33.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: fsmap 2024-02-05T07:13:33.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: osdmap e4: 0 total, 0 up, 0 in 2024-02-05T07:13:33.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: mgrmap e13: y(active, since 48s) 2024-02-05T07:13:33.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: overall HEALTH_OK 2024-02-05T07:13:33.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:33.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:33.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:33.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:33 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:33.837 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-05T07:13:33.837 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph config generate-minimal-conf 2024-02-05T07:13:34.203 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:34 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:34.203 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.188:0/2535147968' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-05T07:13:34.203 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:34 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:34.204 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:34 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:34.204 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.188:0/2535147968' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-05T07:13:34.204 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:34 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:34.378 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:34 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:34.378 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.188:0/2535147968' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-05T07:13:34.379 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:34 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:13:34.422 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:13:35.496 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[29861]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:35.496 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:35.496 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:35.496 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:35.497 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:35.497 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:35.497 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:35.497 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:35.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[41609]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:35.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:35.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:35.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:35.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:35.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:35.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:35.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:35 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:35.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:35 smithi188 ceph-mon[33283]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:35.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:35 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:35.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:35 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:35.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:35 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:35.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:35 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:35.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:35 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:35.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:35 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:35.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:35 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:35.976 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.974+0000 7fb330e29700 1 -- 172.21.15.184:0/3045393317 >> v1:172.21.15.184:6789/0 conn(0x7fb32c106610 legacy=0x7fb32c1069f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:35.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.974+0000 7fb330e29700 1 -- 172.21.15.184:0/3045393317 shutdown_connections 2024-02-05T07:13:35.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.974+0000 7fb330e29700 1 -- 172.21.15.184:0/3045393317 >> 172.21.15.184:0/3045393317 conn(0x7fb32c0fc090 msgr2=0x7fb32c0fe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:35.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.974+0000 7fb330e29700 1 -- 172.21.15.184:0/3045393317 shutdown_connections 2024-02-05T07:13:35.977 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.974+0000 7fb330e29700 1 -- 172.21.15.184:0/3045393317 wait complete. 2024-02-05T07:13:35.979 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.975+0000 7fb330e29700 1 Processor -- start 2024-02-05T07:13:35.979 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.975+0000 7fb330e29700 1 -- start start 2024-02-05T07:13:35.979 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.975+0000 7fb330e29700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb32c1a6290 con 0x7fb32c196a40 2024-02-05T07:13:35.979 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.975+0000 7fb330e29700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb32c1a7470 con 0x7fb32c106610 2024-02-05T07:13:35.979 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.975+0000 7fb330e29700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb32c1a8670 con 0x7fb32c1a25c0 2024-02-05T07:13:35.979 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.975+0000 7fb329d9b700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb32c196a40 0x7fb32c1a0ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46804/0 (socket says 172.21.15.184:46804) 2024-02-05T07:13:35.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.975+0000 7fb329d9b700 1 -- 172.21.15.184:0/505882725 learned_addr learned my addr 172.21.15.184:0/505882725 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:13:35.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1559171169 0 0) 0x7fb32c1a8670 con 0x7fb32c1a25c0 2024-02-05T07:13:35.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb314003bb0 con 0x7fb32c1a25c0 2024-02-05T07:13:35.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861106734 0 0) 0x7fb32c1a6290 con 0x7fb32c196a40 2024-02-05T07:13:35.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb32c1a8670 con 0x7fb32c196a40 2024-02-05T07:13:35.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750302870 0 0) 0x7fb32c1a7470 con 0x7fb32c106610 2024-02-05T07:13:35.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb32c1a6290 con 0x7fb32c106610 2024-02-05T07:13:35.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3350768839 0 0) 0x7fb314003bb0 con 0x7fb32c1a25c0 2024-02-05T07:13:35.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb32c1a7470 con 0x7fb32c1a25c0 2024-02-05T07:13:35.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fb324001ac0 con 0x7fb32c1a25c0 2024-02-05T07:13:35.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4233860922 0 0) 0x7fb32c1a8670 con 0x7fb32c196a40 2024-02-05T07:13:35.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb314003bb0 con 0x7fb32c196a40 2024-02-05T07:13:35.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fb31c001790 con 0x7fb32c196a40 2024-02-05T07:13:35.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2244582388 0 0) 0x7fb32c1a6290 con 0x7fb32c106610 2024-02-05T07:13:35.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb32c1a8670 con 0x7fb32c106610 2024-02-05T07:13:35.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fb320001900 con 0x7fb32c106610 2024-02-05T07:13:35.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2579870565 0 0) 0x7fb32c1a7470 con 0x7fb32c1a25c0 2024-02-05T07:13:35.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 >> v1:172.21.15.188:6789/0 conn(0x7fb32c106610 legacy=0x7fb32c196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:35.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 >> v1:172.21.15.184:6789/0 conn(0x7fb32c196a40 legacy=0x7fb32c1a0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:35.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c1a9870 con 0x7fb32c1a25c0 2024-02-05T07:13:35.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb330e29700 1 -- 172.21.15.184:0/505882725 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb32c1a7660 con 0x7fb32c1a25c0 2024-02-05T07:13:35.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb330e29700 1 -- 172.21.15.184:0/505882725 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb32c1a7b60 con 0x7fb32c1a25c0 2024-02-05T07:13:35.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fb324002140 con 0x7fb32c1a25c0 2024-02-05T07:13:35.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.976+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fb324004d10 con 0x7fb32c1a25c0 2024-02-05T07:13:35.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.977+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 13) v1 ==== 45954+0+0 (unknown 3144929400 0 0) 0x7fb3240102e0 con 0x7fb32c1a25c0 2024-02-05T07:13:35.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.977+0000 7fb330e29700 1 -- 172.21.15.184:0/505882725 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb30c005120 con 0x7fb32c1a25c0 2024-02-05T07:13:35.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.977+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 2979786674 0 0) 0x7fb324046150 con 0x7fb32c1a25c0 2024-02-05T07:13:35.984 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:35.982+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fb324011c50 con 0x7fb32c1a25c0 2024-02-05T07:13:36.179 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:36.177+0000 7fb330e29700 1 -- 172.21.15.184:0/505882725 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fb30c0053d0 con 0x7fb32c1a25c0 2024-02-05T07:13:36.180 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:36.177+0000 7fb31b7fe700 1 -- 172.21.15.184:0/505882725 <== mon.2 v1:172.21.15.184:6790/0 10 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+193 (unknown 2189217731 0 820190251) 0x7fb32401cf90 con 0x7fb32c1a25c0 2024-02-05T07:13:36.180 INFO:teuthology.orchestra.run.smithi184.stdout:# minimal ceph.conf for ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:13:36.180 INFO:teuthology.orchestra.run.smithi184.stdout:[global] 2024-02-05T07:13:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: fsid = ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:13:36.180 INFO:teuthology.orchestra.run.smithi184.stdout: mon_host = 172.21.15.184:6789/0 172.21.15.188:6789/0 v1:172.21.15.184:6790/0 2024-02-05T07:13:36.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:36.179+0000 7fb330e29700 1 -- 172.21.15.184:0/505882725 >> v1:172.21.15.184:6800/2865218501 conn(0x7fb31403a600 legacy=0x7fb31403cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:36.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:36.179+0000 7fb330e29700 1 -- 172.21.15.184:0/505882725 >> v1:172.21.15.184:6790/0 conn(0x7fb32c1a25c0 legacy=0x7fb32c1a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:36.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:36.180+0000 7fb330e29700 1 -- 172.21.15.184:0/505882725 shutdown_connections 2024-02-05T07:13:36.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:36.180+0000 7fb330e29700 1 -- 172.21.15.184:0/505882725 >> 172.21.15.184:0/505882725 conn(0x7fb32c0fc090 msgr2=0x7fb32c069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:36.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:36.180+0000 7fb330e29700 1 -- 172.21.15.184:0/505882725 shutdown_connections 2024-02-05T07:13:36.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:36.180+0000 7fb330e29700 1 -- 172.21.15.184:0/505882725 wait complete. 2024-02-05T07:13:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-05T07:13:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: Updating smithi188:/etc/ceph/ceph.conf 2024-02-05T07:13:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: Updating smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:13:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: Updating smithi184:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:13:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-05T07:13:36.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-05T07:13:36.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:36.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/505882725' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-05T07:13:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: Updating smithi188:/etc/ceph/ceph.conf 2024-02-05T07:13:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: Updating smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:13:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: Updating smithi184:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:13:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-05T07:13:36.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-05T07:13:36.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:36.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/505882725' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:36.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-05T07:13:36.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: Updating smithi188:/etc/ceph/ceph.conf 2024-02-05T07:13:36.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: Updating smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:13:36.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: Updating smithi184:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:13:36.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:36.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-05T07:13:36.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-05T07:13:36.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:36.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/505882725' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:37.167 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-05T07:13:37.167 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:13:37.167 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.conf 2024-02-05T07:13:37.196 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:13:37.196 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-05T07:13:37.263 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-05T07:13:37.263 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.conf 2024-02-05T07:13:37.297 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-05T07:13:37.297 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-05T07:13:37.366 INFO:tasks.cephadm:Adding mgr.y on smithi184 2024-02-05T07:13:37.367 INFO:tasks.cephadm:Adding mgr.x on smithi188 2024-02-05T07:13:37.367 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch apply mgr '2;smithi184=y;smithi188=x' 2024-02-05T07:13:37.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:37 smithi188 ceph-mon[33283]: Reconfiguring mon.a (unknown last config time)... 2024-02-05T07:13:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:37 smithi188 ceph-mon[33283]: Reconfiguring daemon mon.a on smithi184 2024-02-05T07:13:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:37 smithi188 ceph-mon[33283]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:37.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:37 smithi184 ceph-mon[29861]: Reconfiguring mon.a (unknown last config time)... 2024-02-05T07:13:37.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:37 smithi184 ceph-mon[29861]: Reconfiguring daemon mon.a on smithi184 2024-02-05T07:13:37.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:37 smithi184 ceph-mon[29861]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:37 smithi184 ceph-mon[41609]: Reconfiguring mon.a (unknown last config time)... 2024-02-05T07:13:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:37 smithi184 ceph-mon[41609]: Reconfiguring daemon mon.a on smithi184 2024-02-05T07:13:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:37 smithi184 ceph-mon[41609]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:37.640 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:13:38.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:38 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:38.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:38 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:38.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:38 smithi188 ceph-mon[33283]: Reconfiguring mon.c (monmap changed)... 2024-02-05T07:13:38.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:38 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-05T07:13:38.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:38 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-05T07:13:38.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:38 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:38.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:38 smithi188 ceph-mon[33283]: Reconfiguring daemon mon.c on smithi184 2024-02-05T07:13:38.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:38 smithi188 ceph-mon[33283]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:38.947 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:38.947 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:38.947 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[41609]: Reconfiguring mon.c (monmap changed)... 2024-02-05T07:13:38.947 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-05T07:13:38.947 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-05T07:13:38.948 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:38.948 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[41609]: Reconfiguring daemon mon.c on smithi184 2024-02-05T07:13:38.948 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[41609]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:38.948 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:38.948 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:38.948 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[29861]: Reconfiguring mon.c (monmap changed)... 2024-02-05T07:13:38.948 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-05T07:13:38.948 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-05T07:13:38.948 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:38.948 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[29861]: Reconfiguring daemon mon.c on smithi184 2024-02-05T07:13:38.948 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:38 smithi184 ceph-mon[29861]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:39.218 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.216+0000 7f9cf8fc1700 1 -- 172.21.15.188:0/2875717703 >> v1:172.21.15.184:6789/0 conn(0x7f9cf40ffe60 legacy=0x7f9cf4100280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:39.218 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.216+0000 7f9cf8fc1700 1 -- 172.21.15.188:0/2875717703 shutdown_connections 2024-02-05T07:13:39.219 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.216+0000 7f9cf8fc1700 1 -- 172.21.15.188:0/2875717703 >> 172.21.15.188:0/2875717703 conn(0x7f9cf40fb3e0 msgr2=0x7f9cf40fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:39.219 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.216+0000 7f9cf8fc1700 1 -- 172.21.15.188:0/2875717703 shutdown_connections 2024-02-05T07:13:39.219 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.216+0000 7f9cf8fc1700 1 -- 172.21.15.188:0/2875717703 wait complete. 2024-02-05T07:13:39.221 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.217+0000 7f9cf8fc1700 1 Processor -- start 2024-02-05T07:13:39.221 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.217+0000 7f9cf8fc1700 1 -- start start 2024-02-05T07:13:39.221 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.217+0000 7f9cf8fc1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9cf41a1930 con 0x7f9cf4106050 2024-02-05T07:13:39.221 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.217+0000 7f9cf8fc1700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9cf41a2b30 con 0x7f9cf40ffe60 2024-02-05T07:13:39.221 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.217+0000 7f9cf8fc1700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9cf41a3d30 con 0x7f9cf419dc50 2024-02-05T07:13:39.221 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.217+0000 7f9cf259c700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f9cf40ffe60 0x7f9cf4198e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:52472/0 (socket says 172.21.15.188:52472) 2024-02-05T07:13:39.221 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.217+0000 7f9cf259c700 1 -- 172.21.15.188:0/4237348924 learned_addr learned my addr 172.21.15.188:0/4237348924 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:13:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.217+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308624737 0 0) 0x7f9cf41a2b30 con 0x7f9cf40ffe60 2024-02-05T07:13:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cdc003bb0 con 0x7f9cf40ffe60 2024-02-05T07:13:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194512434 0 0) 0x7f9cf41a1930 con 0x7f9cf4106050 2024-02-05T07:13:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cf41a2b30 con 0x7f9cf4106050 2024-02-05T07:13:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1578880341 0 0) 0x7f9cf41a3d30 con 0x7f9cf419dc50 2024-02-05T07:13:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cf41a1930 con 0x7f9cf419dc50 2024-02-05T07:13:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1414538291 0 0) 0x7f9cdc003bb0 con 0x7f9cf40ffe60 2024-02-05T07:13:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9cf41a3d30 con 0x7f9cf40ffe60 2024-02-05T07:13:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9ce40038d0 con 0x7f9cf40ffe60 2024-02-05T07:13:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2094613376 0 0) 0x7f9cf41a1930 con 0x7f9cf419dc50 2024-02-05T07:13:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9cdc003bb0 con 0x7f9cf419dc50 2024-02-05T07:13:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9cec001b50 con 0x7f9cf419dc50 2024-02-05T07:13:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 17479516 0 0) 0x7f9cf41a2b30 con 0x7f9cf4106050 2024-02-05T07:13:39.222 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9cf41a1930 con 0x7f9cf4106050 2024-02-05T07:13:39.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9ce80017b0 con 0x7f9cf4106050 2024-02-05T07:13:39.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3928433924 0 0) 0x7f9cf41a3d30 con 0x7f9cf40ffe60 2024-02-05T07:13:39.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 >> v1:172.21.15.184:6790/0 conn(0x7f9cf419dc50 legacy=0x7f9cf41a0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:39.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 >> v1:172.21.15.184:6789/0 conn(0x7f9cf4106050 legacy=0x7f9cf419c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:39.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf41a4f30 con 0x7f9cf40ffe60 2024-02-05T07:13:39.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9cf8fc1700 1 -- 172.21.15.188:0/4237348924 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf41a1b20 con 0x7f9cf40ffe60 2024-02-05T07:13:39.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9cf8fc1700 1 -- 172.21.15.188:0/4237348924 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf41a2020 con 0x7f9cf40ffe60 2024-02-05T07:13:39.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f9ce40016c0 con 0x7f9cf40ffe60 2024-02-05T07:13:39.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.218+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9ce4004fc0 con 0x7f9cf40ffe60 2024-02-05T07:13:39.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.219+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 13) v1 ==== 45954+0+0 (unknown 3144929400 0 0) 0x7f9ce4005120 con 0x7f9cf40ffe60 2024-02-05T07:13:39.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.219+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 2979786674 0 0) 0x7f9ce4047370 con 0x7f9cf40ffe60 2024-02-05T07:13:39.223 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.219+0000 7f9cf8fc1700 1 -- 172.21.15.188:0/4237348924 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd4005150 con 0x7f9cf40ffe60 2024-02-05T07:13:39.226 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.224+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f9ce4016be0 con 0x7f9cf40ffe60 2024-02-05T07:13:39.436 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.434+0000 7f9cf8fc1700 1 -- 172.21.15.188:0/4237348924 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi184=y;smithi188=x", "target": ["mon-mgr", ""]}) v1 -- 0x7f9cd4000bc0 con 0x7f9cdc03a580 2024-02-05T07:13:39.441 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.439+0000 7f9ce37fe700 1 -- 172.21.15.188:0/4237348924 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (unknown 0 0 325935098) 0x7f9cd4000bc0 con 0x7f9cdc03a580 2024-02-05T07:13:39.441 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled mgr update... 2024-02-05T07:13:39.443 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.441+0000 7f9cf8fc1700 1 -- 172.21.15.188:0/4237348924 >> v1:172.21.15.184:6800/2865218501 conn(0x7f9cdc03a580 legacy=0x7f9cdc03ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:39.443 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.441+0000 7f9cf8fc1700 1 -- 172.21.15.188:0/4237348924 >> v1:172.21.15.188:6789/0 conn(0x7f9cf40ffe60 legacy=0x7f9cf4198e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:39.443 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.441+0000 7f9cf8fc1700 1 -- 172.21.15.188:0/4237348924 shutdown_connections 2024-02-05T07:13:39.443 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.441+0000 7f9cf8fc1700 1 -- 172.21.15.188:0/4237348924 >> 172.21.15.188:0/4237348924 conn(0x7f9cf40fb3e0 msgr2=0x7f9cf40fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:39.444 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.441+0000 7f9cf8fc1700 1 -- 172.21.15.188:0/4237348924 shutdown_connections 2024-02-05T07:13:39.444 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:13:39.441+0000 7f9cf8fc1700 1 -- 172.21.15.188:0/4237348924 wait complete. 2024-02-05T07:13:40.054 DEBUG:teuthology.orchestra.run.smithi188:mgr.x> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mgr.x.service 2024-02-05T07:13:40.056 INFO:tasks.cephadm:Deploying OSDs... 2024-02-05T07:13:40.057 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:13:40.057 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2024-02-05T07:13:40.074 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-05T07:13:40.074 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2024-02-05T07:13:40.130 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-05T07:13:40.130 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-05T07:13:40.130 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-02-05T07:13:40.130 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-05T07:13:40.130 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-02-05T07:13:40.130 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-02-05 07:13:27.443978020 +0000 2024-02-05T07:13:40.130 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-02-05 07:07:55.139815175 +0000 2024-02-05T07:13:40.130 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-02-05 07:07:55.139815175 +0000 2024-02-05T07:13:40.130 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-02-05 07:07:55.139815175 +0000 2024-02-05T07:13:40.131 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-05T07:13:40.199 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-02-05T07:13:40.199 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-02-05T07:13:40.199 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000259172 s, 2.0 MB/s 2024-02-05T07:13:40.200 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-05T07:13:40.256 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2024-02-05T07:13:40.312 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-05T07:13:40.312 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-05T07:13:40.312 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-02-05T07:13:40.312 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-05T07:13:40.312 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-02-05T07:13:40.312 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-02-05 07:13:27.443978020 +0000 2024-02-05T07:13:40.312 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-02-05 07:07:55.495807865 +0000 2024-02-05T07:13:40.313 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-02-05 07:07:55.495807865 +0000 2024-02-05T07:13:40.313 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-02-05 07:07:55.495807865 +0000 2024-02-05T07:13:40.313 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-05T07:13:40.351 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:40 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:40.351 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:40 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:40.351 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:40 smithi188 ceph-mon[33283]: Reconfiguring mon.b (monmap changed)... 2024-02-05T07:13:40.351 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:40 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-05T07:13:40.352 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:40 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-05T07:13:40.352 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:40 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:40.352 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:40 smithi188 ceph-mon[33283]: Reconfiguring daemon mon.b on smithi188 2024-02-05T07:13:40.352 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:40 smithi188 ceph-mon[33283]: from='client.24103 v1:172.21.15.188:0/4237348924' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi184=y;smithi188=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:13:40.352 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:40 smithi188 ceph-mon[33283]: Saving service mgr spec with placement smithi184=y;smithi188=x;count:2 2024-02-05T07:13:40.352 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:40 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:40.352 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:40 smithi188 ceph-mon[33283]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:40.379 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-02-05T07:13:40.379 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-02-05T07:13:40.379 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.00021478 s, 2.4 MB/s 2024-02-05T07:13:40.380 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-05T07:13:40.437 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2024-02-05T07:13:40.492 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-05T07:13:40.492 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-05T07:13:40.493 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-02-05T07:13:40.493 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-05T07:13:40.493 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-02-05T07:13:40.493 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-02-05 07:13:27.443978020 +0000 2024-02-05T07:13:40.493 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-02-05 07:07:55.850800576 +0000 2024-02-05T07:13:40.493 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-02-05 07:07:55.850800576 +0000 2024-02-05T07:13:40.493 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-02-05 07:07:55.850800576 +0000 2024-02-05T07:13:40.493 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-05T07:13:40.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:40.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:40.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[29861]: Reconfiguring mon.b (monmap changed)... 2024-02-05T07:13:40.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-05T07:13:40.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-05T07:13:40.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:40.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[29861]: Reconfiguring daemon mon.b on smithi188 2024-02-05T07:13:40.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[29861]: from='client.24103 v1:172.21.15.188:0/4237348924' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi184=y;smithi188=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:13:40.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[29861]: Saving service mgr spec with placement smithi184=y;smithi188=x;count:2 2024-02-05T07:13:40.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:40.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[29861]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:40.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:40.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:40.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[41609]: Reconfiguring mon.b (monmap changed)... 2024-02-05T07:13:40.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-05T07:13:40.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-05T07:13:40.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:40.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[41609]: Reconfiguring daemon mon.b on smithi188 2024-02-05T07:13:40.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[41609]: from='client.24103 v1:172.21.15.188:0/4237348924' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi184=y;smithi188=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:13:40.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[41609]: Saving service mgr spec with placement smithi184=y;smithi188=x;count:2 2024-02-05T07:13:40.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:40.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:40 smithi184 ceph-mon[41609]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:40.549 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-02-05T07:13:40.549 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-02-05T07:13:40.549 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000290825 s, 1.8 MB/s 2024-02-05T07:13:40.550 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-05T07:13:40.606 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2024-02-05T07:13:40.661 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-05T07:13:40.661 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-05T07:13:40.662 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-02-05T07:13:40.662 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-05T07:13:40.662 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-02-05T07:13:40.662 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-02-05 07:13:27.444978000 +0000 2024-02-05T07:13:40.662 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-02-05 07:07:56.193793534 +0000 2024-02-05T07:13:40.662 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-02-05 07:07:56.193793534 +0000 2024-02-05T07:13:40.662 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-02-05 07:07:56.193793534 +0000 2024-02-05T07:13:40.662 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-05T07:13:40.727 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-02-05T07:13:40.727 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-02-05T07:13:40.727 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000197904 s, 2.6 MB/s 2024-02-05T07:13:40.728 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-05T07:13:40.784 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-05T07:13:40.785 DEBUG:teuthology.orchestra.run.smithi188:> dd if=/scratch_devs of=/dev/stdout 2024-02-05T07:13:40.800 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-05T07:13:40.801 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_1 2024-02-05T07:13:40.857 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-05T07:13:40.857 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-05T07:13:40.857 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-02-05T07:13:40.857 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-05T07:13:40.857 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-02-05T07:13:40.857 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-02-05 07:13:18.740213844 +0000 2024-02-05T07:13:40.857 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-02-05 07:07:55.137976071 +0000 2024-02-05T07:13:40.857 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-02-05 07:07:55.137976071 +0000 2024-02-05T07:13:40.857 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-02-05 07:07:55.137976071 +0000 2024-02-05T07:13:40.857 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-05T07:13:40.924 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-02-05T07:13:40.924 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-02-05T07:13:40.924 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000212566 s, 2.4 MB/s 2024-02-05T07:13:40.925 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-05T07:13:40.981 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_2 2024-02-05T07:13:41.035 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-05T07:13:41.036 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-05T07:13:41.036 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-02-05T07:13:41.036 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-05T07:13:41.036 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-02-05T07:13:41.036 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-02-05 07:13:18.740213844 +0000 2024-02-05T07:13:41.036 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-02-05 07:07:55.486969663 +0000 2024-02-05T07:13:41.036 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-02-05 07:07:55.486969663 +0000 2024-02-05T07:13:41.036 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-02-05 07:07:55.486969663 +0000 2024-02-05T07:13:41.036 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-05T07:13:41.102 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-02-05T07:13:41.102 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-02-05T07:13:41.102 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000224519 s, 2.3 MB/s 2024-02-05T07:13:41.104 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-05T07:13:41.159 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_3 2024-02-05T07:13:41.215 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-05T07:13:41.215 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-05T07:13:41.216 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-02-05T07:13:41.216 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-05T07:13:41.216 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-02-05T07:13:41.216 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-02-05 07:13:18.741213826 +0000 2024-02-05T07:13:41.216 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-02-05 07:07:55.825963440 +0000 2024-02-05T07:13:41.216 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-02-05 07:07:55.825963440 +0000 2024-02-05T07:13:41.216 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-02-05 07:07:55.825963440 +0000 2024-02-05T07:13:41.216 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-05T07:13:41.281 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-02-05T07:13:41.282 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-02-05T07:13:41.282 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000181019 s, 2.8 MB/s 2024-02-05T07:13:41.283 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-05T07:13:41.338 DEBUG:teuthology.orchestra.run.smithi188:> stat /dev/vg_nvme/lv_4 2024-02-05T07:13:41.394 INFO:teuthology.orchestra.run.smithi188.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-05T07:13:41.394 INFO:teuthology.orchestra.run.smithi188.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-05T07:13:41.394 INFO:teuthology.orchestra.run.smithi188.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-02-05T07:13:41.394 INFO:teuthology.orchestra.run.smithi188.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-05T07:13:41.394 INFO:teuthology.orchestra.run.smithi188.stdout:Context: system_u:object_r:device_t:s0 2024-02-05T07:13:41.394 INFO:teuthology.orchestra.run.smithi188.stdout:Access: 2024-02-05 07:13:18.741213826 +0000 2024-02-05T07:13:41.394 INFO:teuthology.orchestra.run.smithi188.stdout:Modify: 2024-02-05 07:07:56.148957510 +0000 2024-02-05T07:13:41.395 INFO:teuthology.orchestra.run.smithi188.stdout:Change: 2024-02-05 07:07:56.148957510 +0000 2024-02-05T07:13:41.395 INFO:teuthology.orchestra.run.smithi188.stdout: Birth: 2024-02-05 07:07:56.148957510 +0000 2024-02-05T07:13:41.395 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-05T07:13:41.460 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records in 2024-02-05T07:13:41.460 INFO:teuthology.orchestra.run.smithi188.stderr:1+0 records out 2024-02-05T07:13:41.460 INFO:teuthology.orchestra.run.smithi188.stderr:512 bytes copied, 0.000198027 s, 2.6 MB/s 2024-02-05T07:13:41.461 DEBUG:teuthology.orchestra.run.smithi188:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-05T07:13:41.518 INFO:tasks.cephadm:Deploying osd.0 on smithi184 with /dev/vg_nvme/lv_4... 2024-02-05T07:13:41.518 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-05T07:13:41.756 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:13:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:42 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:42 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:42 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:42 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:42 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:42 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:42 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-05T07:13:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:42 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-05T07:13:42.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:42 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-05T07:13:42.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:42 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:42.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:42 smithi188 ceph-mon[33283]: Deploying daemon mgr.x on smithi188 2024-02-05T07:13:42.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:42.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:42.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:42.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:42.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:42.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:42.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-05T07:13:42.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-05T07:13:42.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-05T07:13:42.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:42.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[29861]: Deploying daemon mgr.x on smithi188 2024-02-05T07:13:42.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:42.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:42.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:42.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:42.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:42.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:42.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-05T07:13:42.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-05T07:13:42.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-05T07:13:42.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:42.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:42 smithi184 ceph-mon[41609]: Deploying daemon mgr.x on smithi188 2024-02-05T07:13:43.259 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:43 smithi184 ceph-mon[29861]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:43.259 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:43 smithi184 ceph-mon[41609]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:43.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:43 smithi188 ceph-mon[33283]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:43.499 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:43 smithi188 podman[35352]: 2024-02-05 07:13:43.290861954 +0000 UTC m=+0.018663119 image pull 8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0 2024-02-05T07:13:43.614 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-05T07:13:43.614 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-05T07:13:43.614 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2024-02-05T07:13:43.614 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2024-02-05T07:13:43.614 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0126506 s, 829 MB/s 2024-02-05T07:13:43.614 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2024-02-05T07:13:43.999 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:43 smithi188 podman[35352]: 2024-02-05 07:13:43.601303545 +0000 UTC m=+0.329104697 container init be566d4e8ebac598bb792db16a93872cb9429a7b85885ac9bbfef27613140514 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-02-05T07:13:43.999 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:43 smithi188 podman[35352]: 2024-02-05 07:13:43.606585723 +0000 UTC m=+0.334386876 container start be566d4e8ebac598bb792db16a93872cb9429a7b85885ac9bbfef27613140514 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x, org.label-schema.vendor=CentOS, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-02-05T07:13:43.999 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:43 smithi188 ceph-mgr[35390]: -- 172.21.15.188:0/3761316641 <== mon.1 v1:172.21.15.188:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (unknown 2480620016 0 0) 0x563a08cea9c0 con 0x563a08cc0800 2024-02-05T07:13:43.999 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:43 smithi188 bash[35352]: be566d4e8ebac598bb792db16a93872cb9429a7b85885ac9bbfef27613140514 2024-02-05T07:13:43.999 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:43 smithi188 systemd[1]: Started Ceph mgr.x for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:13:44.248 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch daemon add osd smithi184:vg_nvme/lv_4 2024-02-05T07:13:44.484 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:13:44.498 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:44 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:44.163+0000 7ff7b4e98200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-05T07:13:44.499 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:44 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:44.260+0000 7ff7b4e98200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-05T07:13:44.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:44 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:44.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:44 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:44.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:44 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:44.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:44 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:44.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:44 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:44.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:44 smithi184 ceph-mon[41609]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:44.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:44 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:44.926 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:44 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:44.926 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:44 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:44.926 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:44 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:44.926 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:44 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:44.926 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:44 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:44.926 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:44 smithi184 ceph-mon[29861]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:44.926 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:44 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:44.999 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:44 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:44.940+0000 7ff7b4e98200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-05T07:13:44.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:44 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:44.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:44 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:44.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:44 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:44.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:44 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:44.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:44 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:44.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:44 smithi188 ceph-mon[33283]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:44.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:44 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:45.294 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:45 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:45.038+0000 7ff7b4e98200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-05T07:13:45.294 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:45 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:45.193+0000 7ff7b4e98200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-05T07:13:45.640 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:45 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:45.291+0000 7ff7b4e98200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-05T07:13:45.641 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:45 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:45.376+0000 7ff7b4e98200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-05T07:13:45.641 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:45 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:45.638+0000 7ff7b4e98200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-05T07:13:45.926 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:45 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:45.747+0000 7ff7b4e98200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-05T07:13:45.926 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:45 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:45.832+0000 7ff7b4e98200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-05T07:13:45.926 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:45 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:45.923+0000 7ff7b4e98200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-05T07:13:46.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.026+0000 7f099ff17700 1 -- 172.21.15.184:0/3065246203 >> v1:172.21.15.184:6790/0 conn(0x7f0998105f60 legacy=0x7f09981083b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:46.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.027+0000 7f099ff17700 1 -- 172.21.15.184:0/3065246203 shutdown_connections 2024-02-05T07:13:46.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.027+0000 7f099ff17700 1 -- 172.21.15.184:0/3065246203 >> 172.21.15.184:0/3065246203 conn(0x7f09980fd0d0 msgr2=0x7f09980ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:13:46.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.027+0000 7f099ff17700 1 -- 172.21.15.184:0/3065246203 shutdown_connections 2024-02-05T07:13:46.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.027+0000 7f099ff17700 1 -- 172.21.15.184:0/3065246203 wait complete. 2024-02-05T07:13:46.031 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.027+0000 7f099ff17700 1 Processor -- start 2024-02-05T07:13:46.031 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.027+0000 7f099ff17700 1 -- start start 2024-02-05T07:13:46.031 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.027+0000 7f099ff17700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f09981978b0 con 0x7f0998109ca0 2024-02-05T07:13:46.031 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.027+0000 7f099ff17700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f09981a30a0 con 0x7f0998105f60 2024-02-05T07:13:46.031 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.027+0000 7f099ff17700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f09981a4240 con 0x7f0998101b30 2024-02-05T07:13:46.031 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.027+0000 7f099dcb3700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f0998101b30 0x7f0998196d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:47780/0 (socket says 172.21.15.184:47780) 2024-02-05T07:13:46.031 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.027+0000 7f099dcb3700 1 -- 172.21.15.184:0/625530414 learned_addr learned my addr 172.21.15.184:0/625530414 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:13:46.031 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122227758 0 0) 0x7f09981978b0 con 0x7f0998109ca0 2024-02-05T07:13:46.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09840035b0 con 0x7f0998109ca0 2024-02-05T07:13:46.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175295453 0 0) 0x7f09981a4240 con 0x7f0998101b30 2024-02-05T07:13:46.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09981978b0 con 0x7f0998101b30 2024-02-05T07:13:46.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3801336131 0 0) 0x7f09981a30a0 con 0x7f0998105f60 2024-02-05T07:13:46.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09981a4240 con 0x7f0998105f60 2024-02-05T07:13:46.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2235176009 0 0) 0x7f09840035b0 con 0x7f0998109ca0 2024-02-05T07:13:46.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f09981a30a0 con 0x7f0998109ca0 2024-02-05T07:13:46.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f0990001b70 con 0x7f0998109ca0 2024-02-05T07:13:46.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 548304129 0 0) 0x7f09981978b0 con 0x7f0998101b30 2024-02-05T07:13:46.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f09840035b0 con 0x7f0998101b30 2024-02-05T07:13:46.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f0994000fe0 con 0x7f0998101b30 2024-02-05T07:13:46.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 171471387 0 0) 0x7f09981a4240 con 0x7f0998105f60 2024-02-05T07:13:46.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f09981978b0 con 0x7f0998105f60 2024-02-05T07:13:46.032 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f0988001430 con 0x7f0998105f60 2024-02-05T07:13:46.033 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3053176809 0 0) 0x7f09981a30a0 con 0x7f0998109ca0 2024-02-05T07:13:46.033 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 >> v1:172.21.15.184:6790/0 conn(0x7f0998101b30 legacy=0x7f0998196d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:46.033 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 >> v1:172.21.15.188:6789/0 conn(0x7f0998105f60 legacy=0x7f099819d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:13:46.033 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09981a53e0 con 0x7f0998109ca0 2024-02-05T07:13:46.033 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f099ff17700 1 -- 172.21.15.184:0/625530414 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09981a3290 con 0x7f0998109ca0 2024-02-05T07:13:46.033 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f099ff17700 1 -- 172.21.15.184:0/625530414 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f09981a3790 con 0x7f0998109ca0 2024-02-05T07:13:46.033 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f09900020e0 con 0x7f0998109ca0 2024-02-05T07:13:46.033 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.028+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f0990004d00 con 0x7f0998109ca0 2024-02-05T07:13:46.033 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.029+0000 7f099ff17700 1 -- 172.21.15.184:0/625530414 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097c005150 con 0x7f0998109ca0 2024-02-05T07:13:46.033 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.029+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 13) v1 ==== 45954+0+0 (unknown 3144929400 0 0) 0x7f09900101f0 con 0x7f0998109ca0 2024-02-05T07:13:46.033 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.029+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 2979786674 0 0) 0x7f0990046370 con 0x7f0998109ca0 2024-02-05T07:13:46.036 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.034+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f0990011b70 con 0x7f0998109ca0 2024-02-05T07:13:46.235 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:46 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:46.101+0000 7ff7b4e98200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-05T07:13:46.250 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:46.248+0000 7f099ff17700 1 -- 172.21.15.184:0/625530414 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f097c000bc0 con 0x7f098403a4f0 2024-02-05T07:13:46.443 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:46.443 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:46.443 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:46.443 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:46.443 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:46.443 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-05T07:13:46.443 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-05T07:13:46.443 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:46.444 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:46.444 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:46.444 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:46.444 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:46.444 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:46.444 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-05T07:13:46.444 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-05T07:13:46.444 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:46 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:46.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:46 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:46.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:46 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:46.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:46 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:46.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:46 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:46.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:46 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:46.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:46 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-05T07:13:46.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:46 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-05T07:13:46.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:46 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:47.200 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:47.069+0000 7ff7b4e98200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-05T07:13:47.201 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:47.198+0000 7ff7b4e98200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-05T07:13:47.496 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[29861]: Reconfiguring mgr.y (unknown last config time)... 2024-02-05T07:13:47.496 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[29861]: Reconfiguring daemon mgr.y on smithi184 2024-02-05T07:13:47.496 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[29861]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:47.496 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:13:47.496 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:13:47.496 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:47.496 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:47.496 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:47.496 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:47.496 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:47.496 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:47.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[41609]: Reconfiguring mgr.y (unknown last config time)... 2024-02-05T07:13:47.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[41609]: Reconfiguring daemon mgr.y on smithi184 2024-02-05T07:13:47.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[41609]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:47.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:13:47.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:13:47.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:47.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:47.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:47.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:47.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:47.497 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:47 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-mon[33283]: Reconfiguring mgr.y (unknown last config time)... 2024-02-05T07:13:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-mon[33283]: Reconfiguring daemon mgr.y on smithi184 2024-02-05T07:13:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-mon[33283]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:13:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:13:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:13:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:13:47.823 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:47.536+0000 7ff7b4e98200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-05T07:13:47.823 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:47.626+0000 7ff7b4e98200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-05T07:13:47.824 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:47.821+0000 7ff7b4e98200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-05T07:13:48.244 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:48.001+0000 7ff7b4e98200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-05T07:13:48.390 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:48 smithi184 ceph-mon[29861]: from='client.14217 v1:172.21.15.184:0/625530414' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:13:48.391 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:48 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:48.391 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:48 smithi184 ceph-mon[29861]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:48.391 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:48 smithi184 ceph-mon[41609]: from='client.14217 v1:172.21.15.184:0/625530414' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:13:48.391 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:48 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:48.391 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:48 smithi184 ceph-mon[41609]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:48.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:48 smithi188 ceph-mon[33283]: from='client.14217 v1:172.21.15.184:0/625530414' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:13:48.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:48 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:13:48.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:48 smithi188 ceph-mon[33283]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:48.499 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:48.284+0000 7ff7b4e98200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-05T07:13:48.999 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:48.547+0000 7ff7b4e98200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-05T07:13:48.999 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:48.782+0000 7ff7b4e98200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-05T07:13:49.999 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:49.576+0000 7ff7b4e98200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-05T07:13:50.455 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1149622787' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55bd1041-d85f-429b-842b-f0ad482a2b35"}]: dispatch 2024-02-05T07:13:50.455 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1149622787' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55bd1041-d85f-429b-842b-f0ad482a2b35"}]': finished 2024-02-05T07:13:50.455 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:50 smithi188 ceph-mon[33283]: osdmap e5: 1 total, 0 up, 1 in 2024-02-05T07:13:50.455 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:50 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:13:50.456 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1905863860' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:13:50.456 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:50.143+0000 7ff7b4e98200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-05T07:13:50.456 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:50.240+0000 7ff7b4e98200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-05T07:13:50.456 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:13:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:13:50.453+0000 7ff7b4e98200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-05T07:13:50.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1149622787' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55bd1041-d85f-429b-842b-f0ad482a2b35"}]: dispatch 2024-02-05T07:13:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1149622787' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55bd1041-d85f-429b-842b-f0ad482a2b35"}]': finished 2024-02-05T07:13:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:50 smithi184 ceph-mon[29861]: osdmap e5: 1 total, 0 up, 1 in 2024-02-05T07:13:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:50 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:13:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1905863860' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:13:50.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1149622787' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55bd1041-d85f-429b-842b-f0ad482a2b35"}]: dispatch 2024-02-05T07:13:50.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1149622787' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55bd1041-d85f-429b-842b-f0ad482a2b35"}]': finished 2024-02-05T07:13:50.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:50 smithi184 ceph-mon[41609]: osdmap e5: 1 total, 0 up, 1 in 2024-02-05T07:13:50.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:50 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:13:50.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1905863860' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:13:51.129 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:13:51.126+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mgrmap(e 14) v1 ==== 91316+0+0 (unknown 4198794216 0 0) 0x7f0990044c10 con 0x7f0998109ca0 2024-02-05T07:13:51.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:51 smithi188 ceph-mon[33283]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:51.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:51 smithi188 ceph-mon[33283]: Standby manager daemon x started 2024-02-05T07:13:51.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:51 smithi188 ceph-mon[33283]: from='mgr.? v1:172.21.15.188:0/2328497694' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-05T07:13:51.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:51 smithi188 ceph-mon[33283]: from='mgr.? v1:172.21.15.188:0/2328497694' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-05T07:13:51.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:51 smithi188 ceph-mon[33283]: from='mgr.? v1:172.21.15.188:0/2328497694' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-05T07:13:51.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:51 smithi188 ceph-mon[33283]: from='mgr.? v1:172.21.15.188:0/2328497694' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-05T07:13:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:51 smithi184 ceph-mon[29861]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:51 smithi184 ceph-mon[29861]: Standby manager daemon x started 2024-02-05T07:13:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:51 smithi184 ceph-mon[29861]: from='mgr.? v1:172.21.15.188:0/2328497694' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-05T07:13:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:51 smithi184 ceph-mon[29861]: from='mgr.? v1:172.21.15.188:0/2328497694' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-05T07:13:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:51 smithi184 ceph-mon[29861]: from='mgr.? v1:172.21.15.188:0/2328497694' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-05T07:13:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:51 smithi184 ceph-mon[29861]: from='mgr.? v1:172.21.15.188:0/2328497694' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-05T07:13:51.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:51 smithi184 ceph-mon[41609]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:51.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:51 smithi184 ceph-mon[41609]: Standby manager daemon x started 2024-02-05T07:13:51.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:51 smithi184 ceph-mon[41609]: from='mgr.? v1:172.21.15.188:0/2328497694' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-05T07:13:51.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:51 smithi184 ceph-mon[41609]: from='mgr.? v1:172.21.15.188:0/2328497694' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-05T07:13:51.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:51 smithi184 ceph-mon[41609]: from='mgr.? v1:172.21.15.188:0/2328497694' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-05T07:13:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:51 smithi184 ceph-mon[41609]: from='mgr.? v1:172.21.15.188:0/2328497694' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-05T07:13:52.369 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:52 smithi184 ceph-mon[29861]: mgrmap e14: y(active, since 66s), standbys: x 2024-02-05T07:13:52.369 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:52 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-05T07:13:52.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:52 smithi184 ceph-mon[41609]: mgrmap e14: y(active, since 66s), standbys: x 2024-02-05T07:13:52.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:52 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-05T07:13:52.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:52 smithi188 ceph-mon[33283]: mgrmap e14: y(active, since 66s), standbys: x 2024-02-05T07:13:52.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:52 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-05T07:13:53.400 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:53 smithi184 ceph-mon[29861]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:53.400 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:53 smithi184 ceph-mon[41609]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:53.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:53 smithi188 ceph-mon[33283]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:55.241 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:55 smithi184 ceph-mon[29861]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:55.241 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:55 smithi184 ceph-mon[41609]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:55.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:55 smithi188 ceph-mon[33283]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:56.452 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:56 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-05T07:13:56.453 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:56 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:56.453 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:56 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-05T07:13:56.453 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:56 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:56.486 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:56 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-05T07:13:56.486 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:56 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:13:57.350 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:57 smithi184 ceph-mon[29861]: Deploying daemon osd.0 on smithi184 2024-02-05T07:13:57.350 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:57 smithi184 ceph-mon[29861]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:57.350 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:57 smithi184 ceph-mon[41609]: Deploying daemon osd.0 on smithi184 2024-02-05T07:13:57.351 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:57 smithi184 ceph-mon[41609]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:57.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:57 smithi188 ceph-mon[33283]: Deploying daemon osd.0 on smithi184 2024-02-05T07:13:57.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:57 smithi188 ceph-mon[33283]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:59.268 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:13:59 smithi184 ceph-mon[29861]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:59.268 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:13:59 smithi184 ceph-mon[41609]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:13:59.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:13:59 smithi188 ceph-mon[33283]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:14:01.315 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:01 smithi184 ceph-mon[29861]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:14:01.315 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:01 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:01.315 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:01 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:01.315 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:01 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:14:01.316 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:01 smithi184 ceph-mon[41609]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:14:01.316 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:01 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:01.316 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:01 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:01.316 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:01 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:14:01.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:01 smithi188 ceph-mon[33283]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:14:01.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:01 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:01.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:01 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:01.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:01 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:14:03.346 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:03 smithi184 ceph-mon[29861]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:14:03.346 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:03 smithi184 ceph-mon[41609]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:14:03.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:03 smithi188 ceph-mon[33283]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:14:04.559 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:04.559 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:04.559 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[29861]: from='osd.0 v1:172.21.15.184:6801/2828935930' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-05T07:14:04.559 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[29861]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-05T07:14:04.559 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[29861]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:14:04.559 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:04.559 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:14:04.559 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:04.560 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:04.560 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:04.560 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[41609]: from='osd.0 v1:172.21.15.184:6801/2828935930' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-05T07:14:04.560 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[41609]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-05T07:14:04.560 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[41609]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:14:04.560 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:04.560 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:14:04.560 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:04 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:04.605 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 0 on host 'smithi184' 2024-02-05T07:14:04.605 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:04.602+0000 7f098effd700 1 -- 172.21.15.184:0/625530414 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 1276792609) 0x7f097c000bc0 con 0x7f098403a4f0 2024-02-05T07:14:04.606 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:04.604+0000 7f099ff17700 1 -- 172.21.15.184:0/625530414 >> v1:172.21.15.184:6800/2865218501 conn(0x7f098403a4f0 legacy=0x7f098403c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:14:04.607 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:04.604+0000 7f099ff17700 1 -- 172.21.15.184:0/625530414 >> v1:172.21.15.184:6789/0 conn(0x7f0998109ca0 legacy=0x7f09981a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:14:04.607 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:04.605+0000 7f099ff17700 1 -- 172.21.15.184:0/625530414 shutdown_connections 2024-02-05T07:14:04.607 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:04.605+0000 7f099ff17700 1 -- 172.21.15.184:0/625530414 >> 172.21.15.184:0/625530414 conn(0x7f09980fd0d0 msgr2=0x7f09981083b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:14:04.607 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:04.605+0000 7f099ff17700 1 -- 172.21.15.184:0/625530414 shutdown_connections 2024-02-05T07:14:04.607 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:04.605+0000 7f099ff17700 1 -- 172.21.15.184:0/625530414 wait complete. 2024-02-05T07:14:04.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:04 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:04.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:04 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:04.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:04 smithi188 ceph-mon[33283]: from='osd.0 v1:172.21.15.184:6801/2828935930' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-05T07:14:04.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:04 smithi188 ceph-mon[33283]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-05T07:14:04.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:04 smithi188 ceph-mon[33283]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:14:04.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:04 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:04.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:04 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:14:05.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:04 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:05.237 DEBUG:teuthology.orchestra.run.smithi184:osd.0> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.0.service 2024-02-05T07:14:05.239 INFO:tasks.cephadm:Deploying osd.1 on smithi184 with /dev/vg_nvme/lv_3... 2024-02-05T07:14:05.239 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-05T07:14:05.757 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[41609]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-05T07:14:05.757 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[41609]: osdmap e6: 1 total, 0 up, 1 in 2024-02-05T07:14:05.757 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:14:05.757 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[41609]: from='osd.0 v1:172.21.15.184:6801/2828935930' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:14:05.757 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[41609]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:14:05.757 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:05.757 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:05.757 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:14:05.758 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[29861]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-05T07:14:05.758 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[29861]: osdmap e6: 1 total, 0 up, 1 in 2024-02-05T07:14:05.758 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:14:05.758 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[29861]: from='osd.0 v1:172.21.15.184:6801/2828935930' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:14:05.758 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[29861]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:14:05.758 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:05.758 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:05.758 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:14:05.758 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-0[45904]: 2024-02-05T07:14:05.541+0000 7f23b8b35700 -1 osd.0 0 waiting for initial osdmap 2024-02-05T07:14:05.759 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:14:05 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-0[45904]: 2024-02-05T07:14:05.543+0000 7f23b492f700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-05T07:14:05.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:05 smithi188 ceph-mon[33283]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-05T07:14:05.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:05 smithi188 ceph-mon[33283]: osdmap e6: 1 total, 0 up, 1 in 2024-02-05T07:14:05.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:05 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:14:05.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:05 smithi188 ceph-mon[33283]: from='osd.0 v1:172.21.15.184:6801/2828935930' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:14:05.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:05 smithi188 ceph-mon[33283]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:14:05.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:05 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:05.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:05 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:05.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:05 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:14:05.999 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:14:06.715 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:06 smithi184 ceph-mon[29861]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-05T07:14:06.715 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:06 smithi184 ceph-mon[29861]: osdmap e7: 1 total, 0 up, 1 in 2024-02-05T07:14:06.715 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:06 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:14:06.715 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:06 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:14:06.715 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:06 smithi184 ceph-mon[29861]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:14:06.715 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:06 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:14:06.716 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:06 smithi184 ceph-mon[41609]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-05T07:14:06.716 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:06 smithi184 ceph-mon[41609]: osdmap e7: 1 total, 0 up, 1 in 2024-02-05T07:14:06.716 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:06 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:14:06.716 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:06 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:14:06.716 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:06 smithi184 ceph-mon[41609]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:14:06.716 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:06 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:14:06.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:06 smithi188 ceph-mon[33283]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-05T07:14:06.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:06 smithi188 ceph-mon[33283]: osdmap e7: 1 total, 0 up, 1 in 2024-02-05T07:14:06.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:06 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:14:06.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:06 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:14:06.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:06 smithi188 ceph-mon[33283]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-05T07:14:06.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:06 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:14:07.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:07 smithi188 ceph-mon[33283]: purged_snaps scrub starts 2024-02-05T07:14:07.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:07 smithi188 ceph-mon[33283]: purged_snaps scrub ok 2024-02-05T07:14:07.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:07 smithi188 ceph-mon[33283]: osd.0 v1:172.21.15.184:6801/2828935930 boot 2024-02-05T07:14:07.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:07 smithi188 ceph-mon[33283]: osdmap e8: 1 total, 1 up, 1 in 2024-02-05T07:14:07.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:07 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:14:08.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:07 smithi184 ceph-mon[29861]: purged_snaps scrub starts 2024-02-05T07:14:08.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:07 smithi184 ceph-mon[29861]: purged_snaps scrub ok 2024-02-05T07:14:08.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:07 smithi184 ceph-mon[29861]: osd.0 v1:172.21.15.184:6801/2828935930 boot 2024-02-05T07:14:08.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:07 smithi184 ceph-mon[29861]: osdmap e8: 1 total, 1 up, 1 in 2024-02-05T07:14:08.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:07 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:14:08.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:07 smithi184 ceph-mon[41609]: purged_snaps scrub starts 2024-02-05T07:14:08.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:07 smithi184 ceph-mon[41609]: purged_snaps scrub ok 2024-02-05T07:14:08.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:07 smithi184 ceph-mon[41609]: osd.0 v1:172.21.15.184:6801/2828935930 boot 2024-02-05T07:14:08.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:07 smithi184 ceph-mon[41609]: osdmap e8: 1 total, 1 up, 1 in 2024-02-05T07:14:08.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:07 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:14:08.854 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:08 smithi184 ceph-mon[29861]: osdmap e9: 1 total, 1 up, 1 in 2024-02-05T07:14:08.855 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:08 smithi184 ceph-mon[29861]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:08.855 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:08 smithi184 ceph-mon[41609]: osdmap e9: 1 total, 1 up, 1 in 2024-02-05T07:14:08.855 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:08 smithi184 ceph-mon[41609]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:08.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:08 smithi188 ceph-mon[33283]: osdmap e9: 1 total, 1 up, 1 in 2024-02-05T07:14:08.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:08 smithi188 ceph-mon[33283]: pgmap v41: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:09.195 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-05T07:14:09.195 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-05T07:14:09.195 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2024-02-05T07:14:09.195 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2024-02-05T07:14:09.195 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0123349 s, 850 MB/s 2024-02-05T07:14:09.195 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2024-02-05T07:14:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[29861]: Detected new or changed devices on smithi184 2024-02-05T07:14:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:14:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[29861]: Adjusting osd_memory_target on smithi184 to 16064M 2024-02-05T07:14:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:14:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[41609]: Detected new or changed devices on smithi184 2024-02-05T07:14:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:14:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[41609]: Adjusting osd_memory_target on smithi184 to 16064M 2024-02-05T07:14:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:14:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:09 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:09.827 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch daemon add osd smithi184:vg_nvme/lv_3 2024-02-05T07:14:09.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:09 smithi188 ceph-mon[33283]: Detected new or changed devices on smithi184 2024-02-05T07:14:09.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:09 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:09.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:09 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:09.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:09 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:14:09.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:09 smithi188 ceph-mon[33283]: Adjusting osd_memory_target on smithi184 to 16064M 2024-02-05T07:14:09.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:09 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:09.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:09 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:10.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:09 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:14:10.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:09 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:10.076 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:14:10.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:10 smithi184 ceph-mon[29861]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:10 smithi184 ceph-mon[41609]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:10.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:10 smithi188 ceph-mon[33283]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:11.727 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.723+0000 7f6b6448d700 1 -- 172.21.15.184:0/648292711 >> v1:172.21.15.184:6789/0 conn(0x7f6b5c102060 legacy=0x7f6b5c102480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:14:11.727 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.723+0000 7f6b6448d700 1 -- 172.21.15.184:0/648292711 shutdown_connections 2024-02-05T07:14:11.727 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.723+0000 7f6b6448d700 1 -- 172.21.15.184:0/648292711 >> 172.21.15.184:0/648292711 conn(0x7f6b5c0fb790 msgr2=0x7f6b5c0fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:14:11.727 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.723+0000 7f6b6448d700 1 -- 172.21.15.184:0/648292711 shutdown_connections 2024-02-05T07:14:11.727 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.723+0000 7f6b6448d700 1 -- 172.21.15.184:0/648292711 wait complete. 2024-02-05T07:14:11.727 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.723+0000 7f6b6448d700 1 Processor -- start 2024-02-05T07:14:11.727 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.723+0000 7f6b6448d700 1 -- start start 2024-02-05T07:14:11.727 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b6448d700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6b5c10eb20 con 0x7f6b5c102060 2024-02-05T07:14:11.727 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b6448d700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6b5c197ac0 con 0x7f6b5c104f00 2024-02-05T07:14:11.728 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b6448d700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6b5c1a4260 con 0x7f6b5c108bb0 2024-02-05T07:14:11.728 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b62229700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f6b5c102060 0x7f6b5c196f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:60750/0 (socket says 172.21.15.184:60750) 2024-02-05T07:14:11.728 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b62229700 1 -- 172.21.15.184:0/1379779554 learned_addr learned my addr 172.21.15.184:0/1379779554 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:14:11.728 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b62a2a700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f6b5c108bb0 0x7f6b5c1a0b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:58286/0 (socket says 172.21.15.184:58286) 2024-02-05T07:14:11.728 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606139489 0 0) 0x7f6b5c1a4260 con 0x7f6b5c108bb0 2024-02-05T07:14:11.728 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b480035b0 con 0x7f6b5c108bb0 2024-02-05T07:14:11.728 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 404942159 0 0) 0x7f6b5c10eb20 con 0x7f6b5c102060 2024-02-05T07:14:11.728 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b5c1a4260 con 0x7f6b5c102060 2024-02-05T07:14:11.728 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044544230 0 0) 0x7f6b5c197ac0 con 0x7f6b5c104f00 2024-02-05T07:14:11.728 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b5c10eb20 con 0x7f6b5c104f00 2024-02-05T07:14:11.728 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 537759541 0 0) 0x7f6b480035b0 con 0x7f6b5c108bb0 2024-02-05T07:14:11.728 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6b5c197ac0 con 0x7f6b5c108bb0 2024-02-05T07:14:11.728 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6b54001bb0 con 0x7f6b5c108bb0 2024-02-05T07:14:11.729 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3642706283 0 0) 0x7f6b5c1a4260 con 0x7f6b5c102060 2024-02-05T07:14:11.729 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6b480035b0 con 0x7f6b5c102060 2024-02-05T07:14:11.729 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6b58001430 con 0x7f6b5c102060 2024-02-05T07:14:11.729 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2636071053 0 0) 0x7f6b5c10eb20 con 0x7f6b5c104f00 2024-02-05T07:14:11.729 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6b5c1a4260 con 0x7f6b5c104f00 2024-02-05T07:14:11.729 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6b4c001850 con 0x7f6b5c104f00 2024-02-05T07:14:11.729 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2486785355 0 0) 0x7f6b5c197ac0 con 0x7f6b5c108bb0 2024-02-05T07:14:11.729 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 >> v1:172.21.15.188:6789/0 conn(0x7f6b5c104f00 legacy=0x7f6b5c19d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:14:11.729 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.724+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 >> v1:172.21.15.184:6789/0 conn(0x7f6b5c102060 legacy=0x7f6b5c196f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:14:11.729 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.725+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c1a5400 con 0x7f6b5c108bb0 2024-02-05T07:14:11.729 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.725+0000 7f6b6448d700 1 -- 172.21.15.184:0/1379779554 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5c1a4450 con 0x7f6b5c108bb0 2024-02-05T07:14:11.729 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.725+0000 7f6b6448d700 1 -- 172.21.15.184:0/1379779554 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5c1a4950 con 0x7f6b5c108bb0 2024-02-05T07:14:11.729 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.725+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f6b54003eb0 con 0x7f6b5c108bb0 2024-02-05T07:14:11.729 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.725+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6b54005fb0 con 0x7f6b5c108bb0 2024-02-05T07:14:11.730 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.726+0000 7f6b6448d700 1 -- 172.21.15.184:0/1379779554 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b40005150 con 0x7f6b5c108bb0 2024-02-05T07:14:11.730 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.726+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 14) v1 ==== 91316+0+0 (unknown 4198794216 0 0) 0x7f6b54003a20 con 0x7f6b5c108bb0 2024-02-05T07:14:11.730 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.726+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(9..9 src has 1..9) v4 ==== 1541+0+0 (unknown 122945792 0 0) 0x7f6b54087630 con 0x7f6b5c108bb0 2024-02-05T07:14:11.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.731+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f6b540521a0 con 0x7f6b5c108bb0 2024-02-05T07:14:11.934 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:11.932+0000 7f6b6448d700 1 -- 172.21.15.184:0/1379779554 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6b40000bc0 con 0x7f6b4806ea10 2024-02-05T07:14:12.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:11 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:14:12.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:11 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:14:12.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:11 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:12.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:11 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:14:12.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:11 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:14:12.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:11 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:12.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:11 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:14:12.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:11 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:14:12.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:11 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:13.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:13 smithi184 ceph-mon[29861]: from='client.34142 v1:172.21.15.184:0/1379779554' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:14:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:13 smithi184 ceph-mon[29861]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:13.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:13 smithi184 ceph-mon[41609]: from='client.34142 v1:172.21.15.184:0/1379779554' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:14:13.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:13 smithi184 ceph-mon[41609]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:13.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:13 smithi188 ceph-mon[33283]: from='client.34142 v1:172.21.15.184:0/1379779554' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:14:13.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:13 smithi188 ceph-mon[33283]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:15.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:15 smithi188 ceph-mon[33283]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:15.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2120737459' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f44c46f-e055-4522-a4bc-452f92e923af"}]: dispatch 2024-02-05T07:14:15.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2120737459' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f44c46f-e055-4522-a4bc-452f92e923af"}]': finished 2024-02-05T07:14:15.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:15 smithi188 ceph-mon[33283]: osdmap e10: 2 total, 1 up, 2 in 2024-02-05T07:14:15.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:15 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:15.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:15 smithi184 ceph-mon[29861]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:15.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2120737459' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f44c46f-e055-4522-a4bc-452f92e923af"}]: dispatch 2024-02-05T07:14:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2120737459' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f44c46f-e055-4522-a4bc-452f92e923af"}]': finished 2024-02-05T07:14:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:15 smithi184 ceph-mon[29861]: osdmap e10: 2 total, 1 up, 2 in 2024-02-05T07:14:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:15 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:15.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:15 smithi184 ceph-mon[41609]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:15.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2120737459' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6f44c46f-e055-4522-a4bc-452f92e923af"}]: dispatch 2024-02-05T07:14:15.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2120737459' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6f44c46f-e055-4522-a4bc-452f92e923af"}]': finished 2024-02-05T07:14:15.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:15 smithi184 ceph-mon[41609]: osdmap e10: 2 total, 1 up, 2 in 2024-02-05T07:14:15.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:15 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:16.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3422741791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:14:16.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3422741791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:14:16.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3422741791' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:14:17.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:17 smithi188 ceph-mon[33283]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:17.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:17 smithi184 ceph-mon[29861]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:17.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:17 smithi184 ceph-mon[41609]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:19.397 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:19 smithi184 ceph-mon[29861]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:19.397 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:19 smithi184 ceph-mon[41609]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:19 smithi188 ceph-mon[33283]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:21.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:21 smithi184 ceph-mon[29861]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:21 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-05T07:14:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:21 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:21 smithi184 ceph-mon[41609]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:21 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-05T07:14:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:21 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:21 smithi188 ceph-mon[33283]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:21 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-05T07:14:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:21 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:22.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:22 smithi188 ceph-mon[33283]: Deploying daemon osd.1 on smithi184 2024-02-05T07:14:22.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:22 smithi184 ceph-mon[29861]: Deploying daemon osd.1 on smithi184 2024-02-05T07:14:22.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:22 smithi184 ceph-mon[41609]: Deploying daemon osd.1 on smithi184 2024-02-05T07:14:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:23 smithi188 ceph-mon[33283]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:23.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:23 smithi184 ceph-mon[29861]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:23.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:23 smithi184 ceph-mon[41609]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:25.416 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:25 smithi184 ceph-mon[29861]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:25.417 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:25 smithi184 ceph-mon[41609]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:25.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:25 smithi188 ceph-mon[33283]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:27.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:27 smithi188 ceph-mon[33283]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:27.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:27 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:27.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:27 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:27.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:27 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:14:27.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:27 smithi184 ceph-mon[29861]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:27.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:27 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:27.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:27 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:27.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:27 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:14:27.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:27 smithi184 ceph-mon[41609]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:27.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:27.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:27.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:14:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:29 smithi188 ceph-mon[33283]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:29.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:29 smithi184 ceph-mon[29861]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:29.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:29 smithi184 ceph-mon[41609]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:29.940 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 1 on host 'smithi184' 2024-02-05T07:14:29.940 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:29.938+0000 7f6b537fe700 1 -- 172.21.15.184:0/1379779554 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 269459861) 0x7f6b40000bc0 con 0x7f6b4806ea10 2024-02-05T07:14:29.942 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:29.940+0000 7f6b6448d700 1 -- 172.21.15.184:0/1379779554 >> v1:172.21.15.184:6800/2865218501 conn(0x7f6b4806ea10 legacy=0x7f6b48070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:14:29.942 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:29.940+0000 7f6b6448d700 1 -- 172.21.15.184:0/1379779554 >> v1:172.21.15.184:6790/0 conn(0x7f6b5c108bb0 legacy=0x7f6b5c1a0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:14:29.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:29.940+0000 7f6b6448d700 1 -- 172.21.15.184:0/1379779554 shutdown_connections 2024-02-05T07:14:29.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:29.940+0000 7f6b6448d700 1 -- 172.21.15.184:0/1379779554 >> 172.21.15.184:0/1379779554 conn(0x7f6b5c0fb790 msgr2=0x7f6b5c1003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:14:29.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:29.941+0000 7f6b6448d700 1 -- 172.21.15.184:0/1379779554 shutdown_connections 2024-02-05T07:14:29.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:29.941+0000 7f6b6448d700 1 -- 172.21.15.184:0/1379779554 wait complete. 2024-02-05T07:14:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:30 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:30 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:30 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:30 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:14:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:30 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:30 smithi188 ceph-mon[33283]: from='osd.1 v1:172.21.15.184:6805/1083118002' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-05T07:14:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:30 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:30 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:30 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:14:30.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:30.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:30.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:30.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:14:30.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:30.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[41609]: from='osd.1 v1:172.21.15.184:6805/1083118002' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-05T07:14:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:14:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:14:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[29861]: from='osd.1 v1:172.21.15.184:6805/1083118002' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-05T07:14:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:30.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:30.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:30 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:14:30.625 DEBUG:teuthology.orchestra.run.smithi184:osd.1> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.1.service 2024-02-05T07:14:30.627 INFO:tasks.cephadm:Deploying osd.2 on smithi184 with /dev/vg_nvme/lv_2... 2024-02-05T07:14:30.628 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-05T07:14:31.467 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:14:31.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:31 smithi184 ceph-mon[29861]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:31.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:31 smithi184 ceph-mon[29861]: from='osd.1 v1:172.21.15.184:6805/1083118002' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-05T07:14:31.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:31 smithi184 ceph-mon[29861]: osdmap e11: 2 total, 1 up, 2 in 2024-02-05T07:14:31.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:31 smithi184 ceph-mon[29861]: from='osd.1 v1:172.21.15.184:6805/1083118002' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:14:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:31 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:31.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:31 smithi184 ceph-mon[41609]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:31.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:31 smithi184 ceph-mon[41609]: from='osd.1 v1:172.21.15.184:6805/1083118002' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-05T07:14:31.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:31 smithi184 ceph-mon[41609]: osdmap e11: 2 total, 1 up, 2 in 2024-02-05T07:14:31.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:31 smithi184 ceph-mon[41609]: from='osd.1 v1:172.21.15.184:6805/1083118002' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:14:31.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:31 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:31 smithi188 ceph-mon[33283]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:31 smithi188 ceph-mon[33283]: from='osd.1 v1:172.21.15.184:6805/1083118002' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-05T07:14:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:31 smithi188 ceph-mon[33283]: osdmap e11: 2 total, 1 up, 2 in 2024-02-05T07:14:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:31 smithi188 ceph-mon[33283]: from='osd.1 v1:172.21.15.184:6805/1083118002' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:14:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:31 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:32.005 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:14:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-1[51940]: 2024-02-05T07:14:31.676+0000 7f51799de700 -1 osd.1 0 waiting for initial osdmap 2024-02-05T07:14:32.006 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:14:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-1[51940]: 2024-02-05T07:14:31.681+0000 7f51717d0700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-05T07:14:32.604 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:32 smithi184 ceph-mon[29861]: from='osd.1 v1:172.21.15.184:6805/1083118002' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-05T07:14:32.604 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:32 smithi184 ceph-mon[29861]: osdmap e12: 2 total, 1 up, 2 in 2024-02-05T07:14:32.604 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:32 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:32.604 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:32 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:32.605 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:32 smithi184 ceph-mon[29861]: from='osd.1 v1:172.21.15.184:6805/1083118002' entity='osd.1' 2024-02-05T07:14:32.605 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:32 smithi184 ceph-mon[29861]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:32.605 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:32 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:32.605 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:32 smithi184 ceph-mon[41609]: from='osd.1 v1:172.21.15.184:6805/1083118002' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-05T07:14:32.605 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:32 smithi184 ceph-mon[41609]: osdmap e12: 2 total, 1 up, 2 in 2024-02-05T07:14:32.605 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:32 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:32.605 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:32 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:32.605 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:32 smithi184 ceph-mon[41609]: from='osd.1 v1:172.21.15.184:6805/1083118002' entity='osd.1' 2024-02-05T07:14:32.605 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:32 smithi184 ceph-mon[41609]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:32.605 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:32 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:32 smithi188 ceph-mon[33283]: from='osd.1 v1:172.21.15.184:6805/1083118002' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-05T07:14:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:32 smithi188 ceph-mon[33283]: osdmap e12: 2 total, 1 up, 2 in 2024-02-05T07:14:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:32 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:32 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:32 smithi188 ceph-mon[33283]: from='osd.1 v1:172.21.15.184:6805/1083118002' entity='osd.1' 2024-02-05T07:14:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:32 smithi188 ceph-mon[33283]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-05T07:14:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:32 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:33.604 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:33 smithi184 ceph-mon[29861]: purged_snaps scrub starts 2024-02-05T07:14:33.604 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:33 smithi184 ceph-mon[29861]: purged_snaps scrub ok 2024-02-05T07:14:33.604 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:33 smithi184 ceph-mon[29861]: osd.1 v1:172.21.15.184:6805/1083118002 boot 2024-02-05T07:14:33.604 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:33 smithi184 ceph-mon[29861]: osdmap e13: 2 total, 2 up, 2 in 2024-02-05T07:14:33.604 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:33 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:33.605 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:33 smithi184 ceph-mon[41609]: purged_snaps scrub starts 2024-02-05T07:14:33.605 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:33 smithi184 ceph-mon[41609]: purged_snaps scrub ok 2024-02-05T07:14:33.605 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:33 smithi184 ceph-mon[41609]: osd.1 v1:172.21.15.184:6805/1083118002 boot 2024-02-05T07:14:33.605 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:33 smithi184 ceph-mon[41609]: osdmap e13: 2 total, 2 up, 2 in 2024-02-05T07:14:33.605 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:33 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:33 smithi188 ceph-mon[33283]: purged_snaps scrub starts 2024-02-05T07:14:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:33 smithi188 ceph-mon[33283]: purged_snaps scrub ok 2024-02-05T07:14:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:33 smithi188 ceph-mon[33283]: osd.1 v1:172.21.15.184:6805/1083118002 boot 2024-02-05T07:14:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:33 smithi188 ceph-mon[33283]: osdmap e13: 2 total, 2 up, 2 in 2024-02-05T07:14:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:33 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:14:34.160 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-05T07:14:34.161 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-05T07:14:34.161 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2024-02-05T07:14:34.161 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2024-02-05T07:14:34.161 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0146068 s, 718 MB/s 2024-02-05T07:14:34.161 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2024-02-05T07:14:34.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[29861]: osdmap e14: 2 total, 2 up, 2 in 2024-02-05T07:14:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[29861]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:14:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:14:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:14:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:34.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[41609]: osdmap e14: 2 total, 2 up, 2 in 2024-02-05T07:14:34.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[41609]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:34.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:34.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:34.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:14:34.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:14:34.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:34.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:34.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:14:34.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:34 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:34.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:34 smithi188 ceph-mon[33283]: osdmap e14: 2 total, 2 up, 2 in 2024-02-05T07:14:34.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:34 smithi188 ceph-mon[33283]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:34.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:34 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:34.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:34 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:34.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:34 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:14:34.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:34 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:14:34.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:34 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:34.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:34 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:34.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:34 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:14:34.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:34 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:35.239 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch daemon add osd smithi184:vg_nvme/lv_2 2024-02-05T07:14:35.477 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:14:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:36 smithi188 ceph-mon[33283]: Detected new or changed devices on smithi184 2024-02-05T07:14:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:36 smithi188 ceph-mon[33283]: Adjusting osd_memory_target on smithi184 to 8032M 2024-02-05T07:14:36.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:36 smithi184 ceph-mon[29861]: Detected new or changed devices on smithi184 2024-02-05T07:14:36.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:36 smithi184 ceph-mon[29861]: Adjusting osd_memory_target on smithi184 to 8032M 2024-02-05T07:14:36.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:36 smithi184 ceph-mon[41609]: Detected new or changed devices on smithi184 2024-02-05T07:14:36.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:36 smithi184 ceph-mon[41609]: Adjusting osd_memory_target on smithi184 to 8032M 2024-02-05T07:14:37.080 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.075+0000 7f71b82e5700 1 -- 172.21.15.184:0/1084953757 >> v1:172.21.15.184:6789/0 conn(0x7f71b0109ca0 legacy=0x7f71b010c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:14:37.080 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.075+0000 7f71b82e5700 1 -- 172.21.15.184:0/1084953757 shutdown_connections 2024-02-05T07:14:37.080 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.075+0000 7f71b82e5700 1 -- 172.21.15.184:0/1084953757 >> 172.21.15.184:0/1084953757 conn(0x7f71b00fd0d0 msgr2=0x7f71b00ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:14:37.080 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.075+0000 7f71b82e5700 1 -- 172.21.15.184:0/1084953757 shutdown_connections 2024-02-05T07:14:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.075+0000 7f71b82e5700 1 -- 172.21.15.184:0/1084953757 wait complete. 2024-02-05T07:14:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.075+0000 7f71b82e5700 1 Processor -- start 2024-02-05T07:14:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.075+0000 7f71b82e5700 1 -- start start 2024-02-05T07:14:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71b82e5700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f71b01a3ff0 con 0x7f71b0101b30 2024-02-05T07:14:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71b82e5700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f71b01a51f0 con 0x7f71b0109ca0 2024-02-05T07:14:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71b82e5700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f71b01a63f0 con 0x7f71b0105f60 2024-02-05T07:14:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71b6081700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f71b0101b30 0x7f71b00759e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:54002/0 (socket says 172.21.15.184:54002) 2024-02-05T07:14:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71b6081700 1 -- 172.21.15.184:0/3921868091 learned_addr learned my addr 172.21.15.184:0/3921868091 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:14:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124708228 0 0) 0x7f71b01a3ff0 con 0x7f71b0101b30 2024-02-05T07:14:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f719c0035b0 con 0x7f71b0101b30 2024-02-05T07:14:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534879894 0 0) 0x7f71b01a63f0 con 0x7f71b0105f60 2024-02-05T07:14:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71b01a3ff0 con 0x7f71b0105f60 2024-02-05T07:14:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221337733 0 0) 0x7f71b01a51f0 con 0x7f71b0109ca0 2024-02-05T07:14:37.081 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71b01a63f0 con 0x7f71b0109ca0 2024-02-05T07:14:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1036620484 0 0) 0x7f719c0035b0 con 0x7f71b0101b30 2024-02-05T07:14:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f71b01a51f0 con 0x7f71b0101b30 2024-02-05T07:14:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f71ac0018f0 con 0x7f71b0101b30 2024-02-05T07:14:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2811612181 0 0) 0x7f71b01a3ff0 con 0x7f71b0105f60 2024-02-05T07:14:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f719c0035b0 con 0x7f71b0105f60 2024-02-05T07:14:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f71a00017d0 con 0x7f71b0105f60 2024-02-05T07:14:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1719050885 0 0) 0x7f71b01a63f0 con 0x7f71b0109ca0 2024-02-05T07:14:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f71b01a3ff0 con 0x7f71b0109ca0 2024-02-05T07:14:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f71a8001ce0 con 0x7f71b0109ca0 2024-02-05T07:14:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3082752754 0 0) 0x7f71b01a51f0 con 0x7f71b0101b30 2024-02-05T07:14:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 >> v1:172.21.15.184:6790/0 conn(0x7f71b0105f60 legacy=0x7f71b019edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:14:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 >> v1:172.21.15.188:6789/0 conn(0x7f71b0109ca0 legacy=0x7f71b01a26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:14:37.082 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.076+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b01a75f0 con 0x7f71b0101b30 2024-02-05T07:14:37.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.077+0000 7f71b82e5700 1 -- 172.21.15.184:0/3921868091 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b01a65e0 con 0x7f71b0101b30 2024-02-05T07:14:37.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.077+0000 7f71b82e5700 1 -- 172.21.15.184:0/3921868091 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b01a6ae0 con 0x7f71b0101b30 2024-02-05T07:14:37.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.077+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f71ac001c80 con 0x7f71b0101b30 2024-02-05T07:14:37.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.077+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f71ac005c40 con 0x7f71b0101b30 2024-02-05T07:14:37.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.077+0000 7f71b82e5700 1 -- 172.21.15.184:0/3921868091 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7194005150 con 0x7f71b0101b30 2024-02-05T07:14:37.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.078+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 14) v1 ==== 91316+0+0 (unknown 4198794216 0 0) 0x7f71ac003950 con 0x7f71b0101b30 2024-02-05T07:14:37.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.079+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 1833+0+0 (unknown 1603441695 0 0) 0x7f71ac087600 con 0x7f71b0101b30 2024-02-05T07:14:37.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.083+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f71ac051e80 con 0x7f71b0101b30 2024-02-05T07:14:37.292 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:37.290+0000 7f71b82e5700 1 -- 172.21.15.184:0/3921868091 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7194000bc0 con 0x7f719c06e810 2024-02-05T07:14:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:37 smithi188 ceph-mon[33283]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:37.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:37 smithi184 ceph-mon[29861]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:37.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:37 smithi184 ceph-mon[41609]: pgmap v60: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:38.142 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:38 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:14:38.142 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:38 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:14:38.142 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:38 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:38.142 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:38 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:14:38.143 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:38 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:14:38.143 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:38 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:38 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:14:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:38 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:14:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:38 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:39.332 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:39 smithi184 ceph-mon[29861]: from='client.14271 v1:172.21.15.184:0/3921868091' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:14:39.333 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:39 smithi184 ceph-mon[29861]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:39.333 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:39 smithi184 ceph-mon[41609]: from='client.14271 v1:172.21.15.184:0/3921868091' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:14:39.333 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:39 smithi184 ceph-mon[41609]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:39.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:39 smithi188 ceph-mon[33283]: from='client.14271 v1:172.21.15.184:0/3921868091' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:14:39.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:39 smithi188 ceph-mon[33283]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:40.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4028813222' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16e61e10-2c70-4ae2-ac6f-871d6d08a20c"}]: dispatch 2024-02-05T07:14:40.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4028813222' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16e61e10-2c70-4ae2-ac6f-871d6d08a20c"}]': finished 2024-02-05T07:14:40.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:40 smithi188 ceph-mon[33283]: osdmap e15: 3 total, 2 up, 3 in 2024-02-05T07:14:40.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:40 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:40.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4028813222' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16e61e10-2c70-4ae2-ac6f-871d6d08a20c"}]: dispatch 2024-02-05T07:14:40.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4028813222' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16e61e10-2c70-4ae2-ac6f-871d6d08a20c"}]': finished 2024-02-05T07:14:40.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:40 smithi184 ceph-mon[29861]: osdmap e15: 3 total, 2 up, 3 in 2024-02-05T07:14:40.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:40 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:40.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4028813222' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16e61e10-2c70-4ae2-ac6f-871d6d08a20c"}]: dispatch 2024-02-05T07:14:40.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4028813222' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16e61e10-2c70-4ae2-ac6f-871d6d08a20c"}]': finished 2024-02-05T07:14:40.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:40 smithi184 ceph-mon[41609]: osdmap e15: 3 total, 2 up, 3 in 2024-02-05T07:14:40.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:40 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:41 smithi188 ceph-mon[33283]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4133642199' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:14:41.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:41 smithi184 ceph-mon[29861]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:41.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4133642199' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:14:41.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:41 smithi184 ceph-mon[41609]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:41.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4133642199' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:14:43.396 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:43 smithi184 ceph-mon[29861]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:43.396 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:43 smithi184 ceph-mon[41609]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:43.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:43 smithi188 ceph-mon[33283]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:45.379 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:45 smithi184 ceph-mon[29861]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:45.379 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:45 smithi184 ceph-mon[41609]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:45.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:45 smithi188 ceph-mon[33283]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:47.472 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:47 smithi184 ceph-mon[29861]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:47.472 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:47 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-05T07:14:47.472 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:47 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:47.472 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:47 smithi184 ceph-mon[41609]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:47.472 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:47 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-05T07:14:47.472 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:47 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:47.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:47 smithi188 ceph-mon[33283]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:47 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-05T07:14:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:47 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:14:48.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:48 smithi188 ceph-mon[33283]: Deploying daemon osd.2 on smithi184 2024-02-05T07:14:48.501 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:48 smithi184 ceph-mon[29861]: Deploying daemon osd.2 on smithi184 2024-02-05T07:14:48.501 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:48 smithi184 ceph-mon[41609]: Deploying daemon osd.2 on smithi184 2024-02-05T07:14:49.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:49 smithi184 ceph-mon[29861]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:49.407 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:49 smithi184 ceph-mon[41609]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:49.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:49 smithi188 ceph-mon[33283]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:51.375 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:51 smithi184 ceph-mon[29861]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:51.375 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:51 smithi184 ceph-mon[41609]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:51.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:51 smithi188 ceph-mon[33283]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:52 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:52 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:52 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:14:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:52 smithi188 ceph-mon[33283]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:52 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:52 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:52 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:14:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:52 smithi184 ceph-mon[29861]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:53.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:52 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:53.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:52 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:53.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:52 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:14:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:52 smithi184 ceph-mon[41609]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:55.461 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:55 smithi184 ceph-mon[29861]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:55.461 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:55 smithi184 ceph-mon[29861]: from='osd.2 v1:172.21.15.184:6809/2153385925' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-05T07:14:55.461 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:55 smithi184 ceph-mon[29861]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-05T07:14:55.462 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:55 smithi184 ceph-mon[41609]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:55.462 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:55 smithi184 ceph-mon[41609]: from='osd.2 v1:172.21.15.184:6809/2153385925' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-05T07:14:55.462 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:55 smithi184 ceph-mon[41609]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-05T07:14:55.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:55 smithi188 ceph-mon[33283]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:55.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:55 smithi188 ceph-mon[33283]: from='osd.2 v1:172.21.15.184:6809/2153385925' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-05T07:14:55.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:55 smithi188 ceph-mon[33283]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-05T07:14:55.542 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 2 on host 'smithi184' 2024-02-05T07:14:55.542 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:55.540+0000 7f71a77fe700 1 -- 172.21.15.184:0/3921868091 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 4096889417) 0x7f7194000bc0 con 0x7f719c06e810 2024-02-05T07:14:55.544 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:55.542+0000 7f71b82e5700 1 -- 172.21.15.184:0/3921868091 >> v1:172.21.15.184:6800/2865218501 conn(0x7f719c06e810 legacy=0x7f719c070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:14:55.545 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:55.542+0000 7f71b82e5700 1 -- 172.21.15.184:0/3921868091 >> v1:172.21.15.184:6789/0 conn(0x7f71b0101b30 legacy=0x7f71b00759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:14:55.545 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:55.542+0000 7f71b82e5700 1 -- 172.21.15.184:0/3921868091 shutdown_connections 2024-02-05T07:14:55.545 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:55.542+0000 7f71b82e5700 1 -- 172.21.15.184:0/3921868091 >> 172.21.15.184:0/3921868091 conn(0x7f71b00fd0d0 msgr2=0x7f71b0108b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:14:55.545 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:55.542+0000 7f71b82e5700 1 -- 172.21.15.184:0/3921868091 shutdown_connections 2024-02-05T07:14:55.545 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:14:55.542+0000 7f71b82e5700 1 -- 172.21.15.184:0/3921868091 wait complete. 2024-02-05T07:14:56.159 DEBUG:teuthology.orchestra.run.smithi184:osd.2> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.2.service 2024-02-05T07:14:56.161 INFO:tasks.cephadm:Deploying osd.3 on smithi184 with /dev/vg_nvme/lv_1... 2024-02-05T07:14:56.161 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-05T07:14:56.420 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[29861]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-05T07:14:56.420 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[29861]: osdmap e16: 3 total, 2 up, 3 in 2024-02-05T07:14:56.420 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[29861]: from='osd.2 v1:172.21.15.184:6809/2153385925' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:14:56.421 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:56.421 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[29861]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:14:56.421 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:56.421 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:56.421 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:56.421 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:56.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[41609]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-05T07:14:56.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[41609]: osdmap e16: 3 total, 2 up, 3 in 2024-02-05T07:14:56.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[41609]: from='osd.2 v1:172.21.15.184:6809/2153385925' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:14:56.421 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[41609]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:14:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:56.422 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:56 smithi188 ceph-mon[33283]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-05T07:14:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:56 smithi188 ceph-mon[33283]: osdmap e16: 3 total, 2 up, 3 in 2024-02-05T07:14:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:56 smithi188 ceph-mon[33283]: from='osd.2 v1:172.21.15.184:6809/2153385925' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:14:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:56 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:56 smithi188 ceph-mon[33283]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:14:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:56 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:56 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:56 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:56 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:14:56.670 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-2[58237]: 2024-02-05T07:14:56.584+0000 7f25bf818700 -1 osd.2 0 waiting for initial osdmap 2024-02-05T07:14:56.671 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:14:56 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-2[58237]: 2024-02-05T07:14:56.590+0000 7f25b760a700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-05T07:14:56.906 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:14:57.298 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:57 smithi184 ceph-mon[29861]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-05T07:14:57.299 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:57 smithi184 ceph-mon[29861]: osdmap e17: 3 total, 2 up, 3 in 2024-02-05T07:14:57.299 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:57 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:57.299 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:57 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:57.299 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:57 smithi184 ceph-mon[29861]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:57.299 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:57 smithi184 ceph-mon[29861]: from='osd.2 ' entity='osd.2' 2024-02-05T07:14:57.299 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:57 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:57.300 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:57 smithi184 ceph-mon[41609]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-05T07:14:57.300 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:57 smithi184 ceph-mon[41609]: osdmap e17: 3 total, 2 up, 3 in 2024-02-05T07:14:57.300 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:57 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:57.300 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:57 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:57.300 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:57 smithi184 ceph-mon[41609]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:57.301 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:57 smithi184 ceph-mon[41609]: from='osd.2 ' entity='osd.2' 2024-02-05T07:14:57.301 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:57 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:57.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:57 smithi188 ceph-mon[33283]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-05T07:14:57.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:57 smithi188 ceph-mon[33283]: osdmap e17: 3 total, 2 up, 3 in 2024-02-05T07:14:57.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:57 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:57.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:57 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:57.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:57 smithi188 ceph-mon[33283]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-05T07:14:57.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:57 smithi188 ceph-mon[33283]: from='osd.2 ' entity='osd.2' 2024-02-05T07:14:57.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:57 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:58.978 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:58 smithi184 ceph-mon[29861]: purged_snaps scrub starts 2024-02-05T07:14:58.978 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:58 smithi184 ceph-mon[29861]: purged_snaps scrub ok 2024-02-05T07:14:58.978 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:58 smithi184 ceph-mon[29861]: osd.2 v1:172.21.15.184:6809/2153385925 boot 2024-02-05T07:14:58.978 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:58 smithi184 ceph-mon[29861]: osdmap e18: 3 total, 3 up, 3 in 2024-02-05T07:14:58.978 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:58 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:58.978 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:58 smithi184 ceph-mon[29861]: pgmap v75: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:14:58.978 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:58 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:14:58.978 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:58 smithi184 ceph-mon[41609]: purged_snaps scrub starts 2024-02-05T07:14:58.979 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:58 smithi184 ceph-mon[41609]: purged_snaps scrub ok 2024-02-05T07:14:58.979 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:58 smithi184 ceph-mon[41609]: osd.2 v1:172.21.15.184:6809/2153385925 boot 2024-02-05T07:14:58.979 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:58 smithi184 ceph-mon[41609]: osdmap e18: 3 total, 3 up, 3 in 2024-02-05T07:14:58.979 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:58 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:58.979 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:58 smithi184 ceph-mon[41609]: pgmap v75: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:14:58.979 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:58 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:14:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:58 smithi188 ceph-mon[33283]: purged_snaps scrub starts 2024-02-05T07:14:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:58 smithi188 ceph-mon[33283]: purged_snaps scrub ok 2024-02-05T07:14:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:58 smithi188 ceph-mon[33283]: osd.2 v1:172.21.15.184:6809/2153385925 boot 2024-02-05T07:14:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:58 smithi188 ceph-mon[33283]: osdmap e18: 3 total, 3 up, 3 in 2024-02-05T07:14:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:58 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:14:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:58 smithi188 ceph-mon[33283]: pgmap v75: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:14:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:58 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:14:59.750 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:59 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-05T07:14:59.750 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:59 smithi184 ceph-mon[29861]: osdmap e19: 3 total, 3 up, 3 in 2024-02-05T07:14:59.750 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:14:59 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:14:59.750 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:59 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-05T07:14:59.750 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:59 smithi184 ceph-mon[41609]: osdmap e19: 3 total, 3 up, 3 in 2024-02-05T07:14:59.750 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:14:59 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:14:59.955 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-05T07:14:59.955 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-05T07:14:59.955 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2024-02-05T07:14:59.955 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2024-02-05T07:14:59.955 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112609 s, 931 MB/s 2024-02-05T07:14:59.955 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2024-02-05T07:14:59.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:59 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-05T07:14:59.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:59 smithi188 ceph-mon[33283]: osdmap e19: 3 total, 3 up, 3 in 2024-02-05T07:14:59.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:14:59 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:15:00.446 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:15:00 smithi184 sudo[62001]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-05T07:15:00.446 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:15:00 smithi184 sudo[62001]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-05T07:15:00.446 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:15:00 smithi184 sudo[62001]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-05T07:15:00.446 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:15:00 smithi184 sudo[62001]: pam_unix(sudo:session): session closed for user root 2024-02-05T07:15:00.722 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:15:00 smithi184 sudo[62043]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-05T07:15:00.722 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:15:00 smithi184 sudo[62043]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-05T07:15:00.722 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:15:00 smithi184 sudo[62043]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-05T07:15:00.722 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:15:00 smithi184 sudo[62043]: pam_unix(sudo:session): session closed for user root 2024-02-05T07:15:00.722 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-05T07:15:00.722 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: osdmap e20: 3 total, 3 up, 3 in 2024-02-05T07:15:00.723 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: Detected new or changed devices on smithi184 2024-02-05T07:15:00.723 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:00.723 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:00.723 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:00.723 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:00.723 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:00.723 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:00.723 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: Adjusting osd_memory_target on smithi184 to 5354M 2024-02-05T07:15:00.723 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:00.723 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:00.723 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:00.723 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:00.723 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:15:00.723 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:00.723 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:00.724 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:00.724 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:00.724 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-05T07:15:00.724 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: osdmap e20: 3 total, 3 up, 3 in 2024-02-05T07:15:00.724 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: Detected new or changed devices on smithi184 2024-02-05T07:15:00.724 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:00.724 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:00.724 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:00.724 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:00.724 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:00.725 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:00.725 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: Adjusting osd_memory_target on smithi184 to 5354M 2024-02-05T07:15:00.725 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:00.725 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:00.725 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:00.725 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:00.725 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:15:00.725 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:00.725 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:00.725 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:00.725 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:00 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:00.748 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch daemon add osd smithi184:vg_nvme/lv_1 2024-02-05T07:15:00.993 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:15:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-05T07:15:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: osdmap e20: 3 total, 3 up, 3 in 2024-02-05T07:15:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: Detected new or changed devices on smithi184 2024-02-05T07:15:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: pgmap v78: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: Adjusting osd_memory_target on smithi184 to 5354M 2024-02-05T07:15:01.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:01.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:01.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:01.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:01.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:15:01.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:01.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:01.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:01.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:00 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:01.021 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:15:00 smithi184 sudo[62064]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-05T07:15:01.021 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:15:00 smithi184 sudo[62064]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-05T07:15:01.021 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:15:00 smithi184 sudo[62064]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-05T07:15:01.021 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:15:00 smithi184 sudo[62064]: pam_unix(sudo:session): session closed for user root 2024-02-05T07:15:01.353 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62121]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-05T07:15:01.353 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62121]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-05T07:15:01.353 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62121]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-05T07:15:01.353 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62121]: pam_unix(sudo:session): session closed for user root 2024-02-05T07:15:01.611 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62144]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-05T07:15:01.611 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62144]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-05T07:15:01.611 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62144]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-05T07:15:01.611 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62144]: pam_unix(sudo:session): session closed for user root 2024-02-05T07:15:01.867 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:01 smithi184 ceph-mon[29861]: osdmap e21: 3 total, 3 up, 3 in 2024-02-05T07:15:01.868 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:01 smithi184 ceph-mon[41609]: osdmap e21: 3 total, 3 up, 3 in 2024-02-05T07:15:01.868 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62165]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-05T07:15:01.868 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62165]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-05T07:15:01.868 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62165]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-05T07:15:01.868 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62165]: pam_unix(sudo:session): session closed for user root 2024-02-05T07:15:01.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:01 smithi188 ceph-mon[33283]: osdmap e21: 3 total, 3 up, 3 in 2024-02-05T07:15:02.127 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62176]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-05T07:15:02.127 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62176]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-05T07:15:02.127 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62176]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-05T07:15:02.127 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:01 smithi184 sudo[62176]: pam_unix(sudo:session): session closed for user root 2024-02-05T07:15:02.382 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:02 smithi184 sudo[62181]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-05T07:15:02.382 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:02 smithi184 sudo[62181]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-05T07:15:02.382 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:02 smithi184 sudo[62181]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-05T07:15:02.382 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:02 smithi184 sudo[62181]: pam_unix(sudo:session): session closed for user root 2024-02-05T07:15:02.590 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.587+0000 7fb8273e6700 1 -- 172.21.15.184:0/4287094585 >> v1:172.21.15.184:6790/0 conn(0x7fb820109ca0 legacy=0x7fb82010c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:15:02.591 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.587+0000 7fb8273e6700 1 -- 172.21.15.184:0/4287094585 shutdown_connections 2024-02-05T07:15:02.591 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.587+0000 7fb8273e6700 1 -- 172.21.15.184:0/4287094585 >> 172.21.15.184:0/4287094585 conn(0x7fb8200fd0d0 msgr2=0x7fb8200ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:15:02.591 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.587+0000 7fb8273e6700 1 -- 172.21.15.184:0/4287094585 shutdown_connections 2024-02-05T07:15:02.591 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.587+0000 7fb8273e6700 1 -- 172.21.15.184:0/4287094585 wait complete. 2024-02-05T07:15:02.591 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.587+0000 7fb8273e6700 1 Processor -- start 2024-02-05T07:15:02.591 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.587+0000 7fb8273e6700 1 -- start start 2024-02-05T07:15:02.591 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.587+0000 7fb8273e6700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb82010fbb0 con 0x7fb820105f60 2024-02-05T07:15:02.591 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.587+0000 7fb8273e6700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb8200ff4b0 con 0x7fb820101b30 2024-02-05T07:15:02.591 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.587+0000 7fb8273e6700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb8201a6480 con 0x7fb820109ca0 2024-02-05T07:15:02.591 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.587+0000 7fb824981700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fb820105f60 0x7fb82019f610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:40908/0 (socket says 172.21.15.184:40908) 2024-02-05T07:15:02.591 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.587+0000 7fb824981700 1 -- 172.21.15.184:0/1815541589 learned_addr learned my addr 172.21.15.184:0/1815541589 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:15:02.591 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.587+0000 7fb825983700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7fb820109ca0 0x7fb8201a2d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:56138/0 (socket says 172.21.15.184:56138) 2024-02-05T07:15:02.591 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122148789 0 0) 0x7fb8201a6480 con 0x7fb820109ca0 2024-02-05T07:15:02.591 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb80c0035b0 con 0x7fb820109ca0 2024-02-05T07:15:02.591 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854044111 0 0) 0x7fb82010fbb0 con 0x7fb820105f60 2024-02-05T07:15:02.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8201a6480 con 0x7fb820105f60 2024-02-05T07:15:02.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 855632237 0 0) 0x7fb80c0035b0 con 0x7fb820109ca0 2024-02-05T07:15:02.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb82010fbb0 con 0x7fb820109ca0 2024-02-05T07:15:02.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fb8180016f0 con 0x7fb820109ca0 2024-02-05T07:15:02.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1877194836 0 0) 0x7fb8201a6480 con 0x7fb820105f60 2024-02-05T07:15:02.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb80c0035b0 con 0x7fb820105f60 2024-02-05T07:15:02.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fb810001870 con 0x7fb820105f60 2024-02-05T07:15:02.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1440676589 0 0) 0x7fb82010fbb0 con 0x7fb820109ca0 2024-02-05T07:15:02.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 >> v1:172.21.15.188:6789/0 conn(0x7fb820101b30 legacy=0x7fb8200fe900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:15:02.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 >> v1:172.21.15.184:6789/0 conn(0x7fb820105f60 legacy=0x7fb82019f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:15:02.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8201a7620 con 0x7fb820109ca0 2024-02-05T07:15:02.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8273e6700 1 -- 172.21.15.184:0/1815541589 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8201a6670 con 0x7fb820109ca0 2024-02-05T07:15:02.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8273e6700 1 -- 172.21.15.184:0/1815541589 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8201a6b70 con 0x7fb820109ca0 2024-02-05T07:15:02.592 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fb818001960 con 0x7fb820109ca0 2024-02-05T07:15:02.593 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.588+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fb818005220 con 0x7fb820109ca0 2024-02-05T07:15:02.593 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.589+0000 7fb8273e6700 1 -- 172.21.15.184:0/1815541589 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb804005120 con 0x7fb820109ca0 2024-02-05T07:15:02.593 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.590+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 15) v1 ==== 91372+0+0 (unknown 1941537730 0 0) 0x7fb818003b70 con 0x7fb820109ca0 2024-02-05T07:15:02.593 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.590+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(21..21 src has 1..21) v4 ==== 2511+0+0 (unknown 1491488346 0 0) 0x7fb818087df0 con 0x7fb820109ca0 2024-02-05T07:15:02.596 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.595+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fb818052380 con 0x7fb820109ca0 2024-02-05T07:15:02.626 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 sudo[36115]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-05T07:15:02.626 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 sudo[36115]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-05T07:15:02.626 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 sudo[36115]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-05T07:15:02.627 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 sudo[36115]: pam_unix(sudo:session): session closed for user root 2024-02-05T07:15:02.814 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:02.813+0000 7fb8273e6700 1 -- 172.21.15.184:0/1815541589 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb804000b90 con 0x7fb80c06ea90 2024-02-05T07:15:02.900 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[29861]: mgrmap e15: y(active, since 2m), standbys: x 2024-02-05T07:15:02.900 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:15:02.900 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:15:02.900 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:15:02.900 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[29861]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-05T07:15:02.900 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[29861]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-05T07:15:02.900 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:15:02.900 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:15:02.900 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:15:02.900 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[29861]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:02.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[41609]: mgrmap e15: y(active, since 2m), standbys: x 2024-02-05T07:15:02.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:15:02.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:15:02.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:15:02.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[41609]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-05T07:15:02.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[41609]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-05T07:15:02.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:15:02.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:15:02.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:15:02.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:02 smithi184 ceph-mon[41609]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:02.901 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:02 smithi184 sudo[62316]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-05T07:15:02.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 sudo[36118]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-05T07:15:02.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 sudo[36118]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-05T07:15:02.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 sudo[36118]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-05T07:15:02.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 sudo[36118]: pam_unix(sudo:session): session closed for user root 2024-02-05T07:15:02.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 ceph-mon[33283]: mgrmap e15: y(active, since 2m), standbys: x 2024-02-05T07:15:02.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:15:02.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:15:02.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:15:02.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 ceph-mon[33283]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-05T07:15:02.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 ceph-mon[33283]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-05T07:15:02.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:15:03.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:15:03.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:15:03.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:02 smithi188 ceph-mon[33283]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:03.157 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:02 smithi184 sudo[62316]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-05T07:15:03.158 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:02 smithi184 sudo[62316]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-05T07:15:03.158 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:02 smithi184 sudo[62316]: pam_unix(sudo:session): session closed for user root 2024-02-05T07:15:03.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 sudo[62319]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-05T07:15:03.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 sudo[62319]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-05T07:15:03.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 sudo[62319]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-02-05T07:15:03.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 sudo[62319]: pam_unix(sudo:session): session closed for user root 2024-02-05T07:15:03.752 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[29861]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-05T07:15:03.752 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[29861]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-05T07:15:03.752 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:03.752 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:15:03.753 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[29861]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-05T07:15:03.753 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:15:03.753 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:15:03.753 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[29861]: from='client.34202 v1:172.21.15.184:0/1815541589' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:15:03.753 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:15:03.753 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:15:03.753 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:03.753 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[29861]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-05T07:15:03.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[41609]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-05T07:15:03.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[41609]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-05T07:15:03.753 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:03.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:15:03.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[41609]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-05T07:15:03.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:15:03.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:15:03.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[41609]: from='client.34202 v1:172.21.15.184:0/1815541589' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:15:03.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:15:03.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:15:03.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:03.754 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:03 smithi184 ceph-mon[41609]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-05T07:15:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:03 smithi188 ceph-mon[33283]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-05T07:15:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:03 smithi188 ceph-mon[33283]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-05T07:15:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:03 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:03 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:15:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:03 smithi188 ceph-mon[33283]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-05T07:15:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:03 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:15:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:03 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:15:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:03 smithi188 ceph-mon[33283]: from='client.34202 v1:172.21.15.184:0/1815541589' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:15:04.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:03 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:15:04.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:03 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:15:04.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:03 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:04.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:03 smithi188 ceph-mon[33283]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-05T07:15:05.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:05 smithi188 ceph-mon[33283]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:05.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:05 smithi184 ceph-mon[29861]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:05.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:05 smithi184 ceph-mon[41609]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:06.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1680177545' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbd6c528-127a-4a3e-9d2c-7da677ba4d7f"}]: dispatch 2024-02-05T07:15:06.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1680177545' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbd6c528-127a-4a3e-9d2c-7da677ba4d7f"}]': finished 2024-02-05T07:15:06.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:06 smithi188 ceph-mon[33283]: osdmap e22: 4 total, 3 up, 4 in 2024-02-05T07:15:06.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:06 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:06.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3171000918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:15:06.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1680177545' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbd6c528-127a-4a3e-9d2c-7da677ba4d7f"}]: dispatch 2024-02-05T07:15:06.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1680177545' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbd6c528-127a-4a3e-9d2c-7da677ba4d7f"}]': finished 2024-02-05T07:15:06.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:06 smithi184 ceph-mon[41609]: osdmap e22: 4 total, 3 up, 4 in 2024-02-05T07:15:06.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:06 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:06.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3171000918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:15:06.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1680177545' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bbd6c528-127a-4a3e-9d2c-7da677ba4d7f"}]: dispatch 2024-02-05T07:15:06.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1680177545' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bbd6c528-127a-4a3e-9d2c-7da677ba4d7f"}]': finished 2024-02-05T07:15:06.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:06 smithi184 ceph-mon[29861]: osdmap e22: 4 total, 3 up, 4 in 2024-02-05T07:15:06.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:06 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:06.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3171000918' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:15:07.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:07 smithi184 ceph-mon[29861]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:07.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:07 smithi184 ceph-mon[41609]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:07.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:07 smithi188 ceph-mon[33283]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:09.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:09 smithi188 ceph-mon[33283]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:09.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:09 smithi184 ceph-mon[29861]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:09.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:09 smithi184 ceph-mon[41609]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:11.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:11 smithi188 ceph-mon[33283]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:11.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:11 smithi184 ceph-mon[41609]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:11.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:11 smithi184 ceph-mon[29861]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:12.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:12 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-05T07:15:12.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:12 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:12.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:12 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-05T07:15:12.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:12 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:12.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:12 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-05T07:15:12.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:12 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:13.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:13 smithi188 ceph-mon[33283]: Deploying daemon osd.3 on smithi184 2024-02-05T07:15:13.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:13 smithi188 ceph-mon[33283]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:13.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:13 smithi184 ceph-mon[41609]: Deploying daemon osd.3 on smithi184 2024-02-05T07:15:13.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:13 smithi184 ceph-mon[41609]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:13.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:13 smithi184 ceph-mon[29861]: Deploying daemon osd.3 on smithi184 2024-02-05T07:15:13.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:13 smithi184 ceph-mon[29861]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:15.393 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:15 smithi184 ceph-mon[29861]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:15.393 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:15 smithi184 ceph-mon[41609]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:15.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:15 smithi188 ceph-mon[33283]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:17.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:17 smithi188 ceph-mon[33283]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:17.503 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:17 smithi184 ceph-mon[29861]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:17.504 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:17 smithi184 ceph-mon[41609]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:18.746 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:18 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:18.746 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:18 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:18.746 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:18 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:15:18.746 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:18 smithi184 ceph-mon[29861]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:18.747 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:18 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:18.747 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:18 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:18.747 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:18 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:15:18.747 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:18 smithi184 ceph-mon[41609]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:18.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:18 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:18.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:18 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:18.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:18 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:15:18.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:18 smithi188 ceph-mon[33283]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:20.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:20.914+0000 7fb8167fc700 1 -- 172.21.15.184:0/1815541589 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 2820963581) 0x7fb804000b90 con 0x7fb80c06ea90 2024-02-05T07:15:20.916 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 3 on host 'smithi184' 2024-02-05T07:15:20.918 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:20.916+0000 7fb8273e6700 1 -- 172.21.15.184:0/1815541589 >> v1:172.21.15.184:6800/2865218501 conn(0x7fb80c06ea90 legacy=0x7fb80c070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:15:20.918 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:20.916+0000 7fb8273e6700 1 -- 172.21.15.184:0/1815541589 >> v1:172.21.15.184:6790/0 conn(0x7fb820109ca0 legacy=0x7fb8201a2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:15:20.918 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:20.916+0000 7fb8273e6700 1 -- 172.21.15.184:0/1815541589 shutdown_connections 2024-02-05T07:15:20.918 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:20.916+0000 7fb8273e6700 1 -- 172.21.15.184:0/1815541589 >> 172.21.15.184:0/1815541589 conn(0x7fb8200fd0d0 msgr2=0x7fb820108b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:15:20.918 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:20.916+0000 7fb8273e6700 1 -- 172.21.15.184:0/1815541589 shutdown_connections 2024-02-05T07:15:20.918 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:15:20.916+0000 7fb8273e6700 1 -- 172.21.15.184:0/1815541589 wait complete. 2024-02-05T07:15:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:21 smithi188 ceph-mon[33283]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:21 smithi188 ceph-mon[33283]: from='osd.3 v1:172.21.15.184:6813/2068331347' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-05T07:15:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:21 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:21 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:21.517 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:21 smithi184 ceph-mon[29861]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:21.517 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:21 smithi184 ceph-mon[29861]: from='osd.3 v1:172.21.15.184:6813/2068331347' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-05T07:15:21.517 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:21 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:21.518 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:21 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:21.518 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:21 smithi184 ceph-mon[41609]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:21.518 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:21 smithi184 ceph-mon[41609]: from='osd.3 v1:172.21.15.184:6813/2068331347' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-05T07:15:21.518 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:21 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:21.518 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:21 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:21.545 DEBUG:teuthology.orchestra.run.smithi184:osd.3> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.3.service 2024-02-05T07:15:21.547 INFO:tasks.cephadm:Deploying osd.4 on smithi188 with /dev/vg_nvme/lv_4... 2024-02-05T07:15:21.547 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-05T07:15:21.793 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:15:22.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:22 smithi188 ceph-mon[33283]: from='osd.3 v1:172.21.15.184:6813/2068331347' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-05T07:15:22.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:22 smithi188 ceph-mon[33283]: osdmap e23: 4 total, 3 up, 4 in 2024-02-05T07:15:22.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:22 smithi188 ceph-mon[33283]: from='osd.3 v1:172.21.15.184:6813/2068331347' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:15:22.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:22 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:22.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:22 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:22.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:22 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:22.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:22 smithi188 ceph-mon[33283]: from='osd.3 v1:172.21.15.184:6813/2068331347' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-05T07:15:22.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:22 smithi188 ceph-mon[33283]: osdmap e24: 4 total, 3 up, 4 in 2024-02-05T07:15:22.605 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:22 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:22.691 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[29861]: from='osd.3 v1:172.21.15.184:6813/2068331347' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-05T07:15:22.691 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[29861]: osdmap e23: 4 total, 3 up, 4 in 2024-02-05T07:15:22.691 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[29861]: from='osd.3 v1:172.21.15.184:6813/2068331347' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:15:22.691 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:22.691 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:22.691 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:22.692 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[29861]: from='osd.3 v1:172.21.15.184:6813/2068331347' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-05T07:15:22.692 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[29861]: osdmap e24: 4 total, 3 up, 4 in 2024-02-05T07:15:22.692 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:22.692 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[41609]: from='osd.3 v1:172.21.15.184:6813/2068331347' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-05T07:15:22.692 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[41609]: osdmap e23: 4 total, 3 up, 4 in 2024-02-05T07:15:22.692 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[41609]: from='osd.3 v1:172.21.15.184:6813/2068331347' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-05T07:15:22.692 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:22.692 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:22.692 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:22.692 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[41609]: from='osd.3 v1:172.21.15.184:6813/2068331347' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-05T07:15:22.692 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[41609]: osdmap e24: 4 total, 3 up, 4 in 2024-02-05T07:15:22.692 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:22.986 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3[64329]: 2024-02-05T07:15:22.688+0000 7f19f1f5e700 -1 osd.3 0 waiting for initial osdmap 2024-02-05T07:15:22.986 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:15:22 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3[64329]: 2024-02-05T07:15:22.692+0000 7f19e9d50700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-05T07:15:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:23 smithi188 ceph-mon[33283]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:23 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:23 smithi188 ceph-mon[33283]: from='osd.3 v1:172.21.15.184:6813/2068331347' entity='osd.3' 2024-02-05T07:15:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:23 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:23.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:23 smithi184 ceph-mon[29861]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:23.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:23 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:23.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:23 smithi184 ceph-mon[29861]: from='osd.3 v1:172.21.15.184:6813/2068331347' entity='osd.3' 2024-02-05T07:15:23.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:23 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:23.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:23 smithi184 ceph-mon[41609]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:23.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:23 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:23.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:23 smithi184 ceph-mon[41609]: from='osd.3 v1:172.21.15.184:6813/2068331347' entity='osd.3' 2024-02-05T07:15:23.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:23 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:23.732 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-05T07:15:23.732 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-05T07:15:23.732 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-02-05T07:15:23.732 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-02-05T07:15:23.732 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0131092 s, 800 MB/s 2024-02-05T07:15:23.732 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-02-05T07:15:24.345 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:24 smithi188 ceph-mon[33283]: purged_snaps scrub starts 2024-02-05T07:15:24.345 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:24 smithi188 ceph-mon[33283]: purged_snaps scrub ok 2024-02-05T07:15:24.345 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:24 smithi188 ceph-mon[33283]: osd.3 v1:172.21.15.184:6813/2068331347 boot 2024-02-05T07:15:24.345 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:24 smithi188 ceph-mon[33283]: osdmap e25: 4 total, 4 up, 4 in 2024-02-05T07:15:24.345 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:24 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:24.345 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:24 smithi188 ceph-mon[33283]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:24.373 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch daemon add osd smithi188:vg_nvme/lv_4 2024-02-05T07:15:24.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:24 smithi184 ceph-mon[29861]: purged_snaps scrub starts 2024-02-05T07:15:24.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:24 smithi184 ceph-mon[29861]: purged_snaps scrub ok 2024-02-05T07:15:24.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:24 smithi184 ceph-mon[29861]: osd.3 v1:172.21.15.184:6813/2068331347 boot 2024-02-05T07:15:24.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:24 smithi184 ceph-mon[29861]: osdmap e25: 4 total, 4 up, 4 in 2024-02-05T07:15:24.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:24 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:24.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:24 smithi184 ceph-mon[29861]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:24.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:24 smithi184 ceph-mon[41609]: purged_snaps scrub starts 2024-02-05T07:15:24.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:24 smithi184 ceph-mon[41609]: purged_snaps scrub ok 2024-02-05T07:15:24.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:24 smithi184 ceph-mon[41609]: osd.3 v1:172.21.15.184:6813/2068331347 boot 2024-02-05T07:15:24.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:24 smithi184 ceph-mon[41609]: osdmap e25: 4 total, 4 up, 4 in 2024-02-05T07:15:24.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:24 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:15:24.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:24 smithi184 ceph-mon[41609]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-02-05T07:15:24.608 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:15:26.236 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.231+0000 7f6c7b9ed700 1 -- 172.21.15.188:0/2679767381 >> v1:172.21.15.188:6789/0 conn(0x7f6c74104e80 legacy=0x7f6c741072d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:15:26.236 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.231+0000 7f6c7b9ed700 1 -- 172.21.15.188:0/2679767381 shutdown_connections 2024-02-05T07:15:26.236 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.231+0000 7f6c7b9ed700 1 -- 172.21.15.188:0/2679767381 >> 172.21.15.188:0/2679767381 conn(0x7f6c740fc010 msgr2=0x7f6c740fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:15:26.236 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.231+0000 7f6c7b9ed700 1 -- 172.21.15.188:0/2679767381 shutdown_connections 2024-02-05T07:15:26.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.231+0000 7f6c7b9ed700 1 -- 172.21.15.188:0/2679767381 wait complete. 2024-02-05T07:15:26.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.232+0000 7f6c7b9ed700 1 Processor -- start 2024-02-05T07:15:26.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.232+0000 7f6c7b9ed700 1 -- start start 2024-02-05T07:15:26.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.232+0000 7f6c7b9ed700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6c7406afd0 con 0x7f6c74108bc0 2024-02-05T07:15:26.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.232+0000 7f6c7b9ed700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6c741a31e0 con 0x7f6c74100a50 2024-02-05T07:15:26.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.232+0000 7f6c7b9ed700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6c741a43e0 con 0x7f6c74104e80 2024-02-05T07:15:26.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.232+0000 7f6c79789700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f6c74100a50 0x7f6c74199c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47140/0 (socket says 172.21.15.188:47140) 2024-02-05T07:15:26.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.232+0000 7f6c79789700 1 -- 172.21.15.188:0/512304145 learned_addr learned my addr 172.21.15.188:0/512304145 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:15:26.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453271029 0 0) 0x7f6c741a31e0 con 0x7f6c74100a50 2024-02-05T07:15:26.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c600035b0 con 0x7f6c74100a50 2024-02-05T07:15:26.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229118763 0 0) 0x7f6c7406afd0 con 0x7f6c74108bc0 2024-02-05T07:15:26.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c741a31e0 con 0x7f6c74108bc0 2024-02-05T07:15:26.237 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748503553 0 0) 0x7f6c741a43e0 con 0x7f6c74104e80 2024-02-05T07:15:26.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c7406afd0 con 0x7f6c74104e80 2024-02-05T07:15:26.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4272878561 0 0) 0x7f6c600035b0 con 0x7f6c74100a50 2024-02-05T07:15:26.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6c741a43e0 con 0x7f6c74100a50 2024-02-05T07:15:26.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6c68001870 con 0x7f6c74100a50 2024-02-05T07:15:26.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1683858421 0 0) 0x7f6c741a31e0 con 0x7f6c74108bc0 2024-02-05T07:15:26.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6c600035b0 con 0x7f6c74108bc0 2024-02-05T07:15:26.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6c6c001b70 con 0x7f6c74108bc0 2024-02-05T07:15:26.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2101417095 0 0) 0x7f6c7406afd0 con 0x7f6c74104e80 2024-02-05T07:15:26.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6c741a31e0 con 0x7f6c74104e80 2024-02-05T07:15:26.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6c70001900 con 0x7f6c74104e80 2024-02-05T07:15:26.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3520925700 0 0) 0x7f6c741a43e0 con 0x7f6c74100a50 2024-02-05T07:15:26.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 >> v1:172.21.15.184:6790/0 conn(0x7f6c74104e80 legacy=0x7f6c7419d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:15:26.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 >> v1:172.21.15.184:6789/0 conn(0x7f6c74108bc0 legacy=0x7f6c741a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:15:26.238 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c741a55e0 con 0x7f6c74100a50 2024-02-05T07:15:26.239 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c7b9ed700 1 -- 172.21.15.188:0/512304145 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c741a2230 con 0x7f6c74100a50 2024-02-05T07:15:26.239 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c7b9ed700 1 -- 172.21.15.188:0/512304145 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c741a2730 con 0x7f6c74100a50 2024-02-05T07:15:26.239 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f6c68003b30 con 0x7f6c74100a50 2024-02-05T07:15:26.239 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.233+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6c68005c30 con 0x7f6c74100a50 2024-02-05T07:15:26.239 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.234+0000 7f6c7b9ed700 1 -- 172.21.15.188:0/512304145 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c58005150 con 0x7f6c74100a50 2024-02-05T07:15:26.239 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.235+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 15) v1 ==== 91372+0+0 (unknown 1941537730 0 0) 0x7f6c680036a0 con 0x7f6c74100a50 2024-02-05T07:15:26.239 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.235+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 2803+0+0 (unknown 1108702423 0 0) 0x7f6c68087920 con 0x7f6c74100a50 2024-02-05T07:15:26.241 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.240+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f6c68051dc0 con 0x7f6c74100a50 2024-02-05T07:15:26.445 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:26.443+0000 7f6c7b9ed700 1 -- 172.21.15.188:0/512304145 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f6c58000bc0 con 0x7f6c6006e940 2024-02-05T07:15:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: osdmap e26: 4 total, 4 up, 4 in 2024-02-05T07:15:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: Detected new or changed devices on smithi184 2024-02-05T07:15:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: Adjusting osd_memory_target on smithi184 to 4016M 2024-02-05T07:15:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:26.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:26.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:26.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:26.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:15:26.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:26.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:26.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:26.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:26 smithi188 ceph-mon[33283]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:26.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: osdmap e26: 4 total, 4 up, 4 in 2024-02-05T07:15:26.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: Detected new or changed devices on smithi184 2024-02-05T07:15:26.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: Adjusting osd_memory_target on smithi184 to 4016M 2024-02-05T07:15:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:15:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:26.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:26.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[29861]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: osdmap e26: 4 total, 4 up, 4 in 2024-02-05T07:15:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: Detected new or changed devices on smithi184 2024-02-05T07:15:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: Adjusting osd_memory_target on smithi184 to 4016M 2024-02-05T07:15:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:26.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:26.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:26.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:15:26.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:26.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:26.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:26.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:26 smithi184 ceph-mon[41609]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:27.593 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:27 smithi188 ceph-mon[33283]: from='client.24223 v1:172.21.15.188:0/512304145' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:15:27.593 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:27 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:15:27.593 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:27 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:15:27.593 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:27 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:27.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:27 smithi184 ceph-mon[29861]: from='client.24223 v1:172.21.15.188:0/512304145' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:15:27.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:27 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:15:27.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:27 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:15:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:27 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:27.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:27 smithi184 ceph-mon[41609]: from='client.24223 v1:172.21.15.188:0/512304145' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:15:27.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:15:27.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:15:27.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:27 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:28 smithi188 ceph-mon[33283]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:28.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:28 smithi184 ceph-mon[29861]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:28.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:28 smithi184 ceph-mon[41609]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.188:0/768329032' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6d7e5ec-413d-445b-ab87-a6c924832a26"}]: dispatch 2024-02-05T07:15:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:30 smithi188 ceph-mon[33283]: from='client.24229 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6d7e5ec-413d-445b-ab87-a6c924832a26"}]: dispatch 2024-02-05T07:15:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:30 smithi188 ceph-mon[33283]: from='client.24229 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6d7e5ec-413d-445b-ab87-a6c924832a26"}]': finished 2024-02-05T07:15:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:30 smithi188 ceph-mon[33283]: osdmap e27: 5 total, 4 up, 5 in 2024-02-05T07:15:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:30 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:15:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.188:0/4247576020' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:15:30.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.188:0/768329032' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6d7e5ec-413d-445b-ab87-a6c924832a26"}]: dispatch 2024-02-05T07:15:30.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:30 smithi184 ceph-mon[29861]: from='client.24229 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6d7e5ec-413d-445b-ab87-a6c924832a26"}]: dispatch 2024-02-05T07:15:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:30 smithi184 ceph-mon[29861]: from='client.24229 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6d7e5ec-413d-445b-ab87-a6c924832a26"}]': finished 2024-02-05T07:15:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:30 smithi184 ceph-mon[29861]: osdmap e27: 5 total, 4 up, 5 in 2024-02-05T07:15:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:30 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:15:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.188:0/4247576020' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:15:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.188:0/768329032' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6d7e5ec-413d-445b-ab87-a6c924832a26"}]: dispatch 2024-02-05T07:15:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:30 smithi184 ceph-mon[41609]: from='client.24229 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6d7e5ec-413d-445b-ab87-a6c924832a26"}]: dispatch 2024-02-05T07:15:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:30 smithi184 ceph-mon[41609]: from='client.24229 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6d7e5ec-413d-445b-ab87-a6c924832a26"}]': finished 2024-02-05T07:15:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:30 smithi184 ceph-mon[41609]: osdmap e27: 5 total, 4 up, 5 in 2024-02-05T07:15:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:30 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:15:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.188:0/4247576020' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:15:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:31 smithi188 ceph-mon[33283]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:31.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:31 smithi184 ceph-mon[29861]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:31.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:31 smithi184 ceph-mon[41609]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:33.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:33 smithi188 ceph-mon[33283]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:33.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:33 smithi184 ceph-mon[29861]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:33.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:33 smithi184 ceph-mon[41609]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:35 smithi188 ceph-mon[33283]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:35.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:35 smithi184 ceph-mon[29861]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:35 smithi184 ceph-mon[41609]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:36.465 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:36 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-05T07:15:36.466 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:36 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:36.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:36 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-05T07:15:36.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:36 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:36.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:36 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-05T07:15:36.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:36 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:37.177 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:37 smithi188 ceph-mon[33283]: Deploying daemon osd.4 on smithi188 2024-02-05T07:15:37.177 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:37 smithi188 ceph-mon[33283]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:37.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:37 smithi184 ceph-mon[29861]: Deploying daemon osd.4 on smithi188 2024-02-05T07:15:37.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:37 smithi184 ceph-mon[29861]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:37.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:37 smithi184 ceph-mon[41609]: Deploying daemon osd.4 on smithi188 2024-02-05T07:15:37.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:37 smithi184 ceph-mon[41609]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:39.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:39 smithi188 ceph-mon[33283]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:39.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:39 smithi184 ceph-mon[29861]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:39.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:39 smithi184 ceph-mon[41609]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:41.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:41 smithi188 ceph-mon[33283]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:41 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:41 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:41 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:15:41.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:41 smithi184 ceph-mon[29861]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:41.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:41 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:41 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:41 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:15:41.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:41 smithi184 ceph-mon[41609]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:41.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:41 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:41.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:41 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:41.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:41 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:15:43.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:43 smithi188 ceph-mon[33283]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:43.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:43 smithi184 ceph-mon[29861]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:43.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:43 smithi184 ceph-mon[41609]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:44.985 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:44 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:44.985 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:44 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:44.985 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:44 smithi188 ceph-mon[33283]: from='osd.4 v1:172.21.15.188:6800/3630742885' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-05T07:15:44.985 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:44 smithi188 ceph-mon[33283]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-05T07:15:44.985 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:44 smithi188 ceph-mon[33283]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:44.985 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:44 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:44.986 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:44 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:44.986 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:44 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:45.059 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:45.057+0000 7f6c667fc700 1 -- 172.21.15.188:0/512304145 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 2670598623) 0x7f6c58000bc0 con 0x7f6c6006e940 2024-02-05T07:15:45.059 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 4 on host 'smithi188' 2024-02-05T07:15:45.061 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:45.059+0000 7f6c7b9ed700 1 -- 172.21.15.188:0/512304145 >> v1:172.21.15.184:6800/2865218501 conn(0x7f6c6006e940 legacy=0x7f6c60070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:15:45.061 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:45.059+0000 7f6c7b9ed700 1 -- 172.21.15.188:0/512304145 >> v1:172.21.15.188:6789/0 conn(0x7f6c74100a50 legacy=0x7f6c74199c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:15:45.061 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:45.059+0000 7f6c7b9ed700 1 -- 172.21.15.188:0/512304145 shutdown_connections 2024-02-05T07:15:45.061 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:45.059+0000 7f6c7b9ed700 1 -- 172.21.15.188:0/512304145 >> 172.21.15.188:0/512304145 conn(0x7f6c740fc010 msgr2=0x7f6c741072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:15:45.061 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:45.059+0000 7f6c7b9ed700 1 -- 172.21.15.188:0/512304145 shutdown_connections 2024-02-05T07:15:45.061 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:45.059+0000 7f6c7b9ed700 1 -- 172.21.15.188:0/512304145 wait complete. 2024-02-05T07:15:45.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:45.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:45.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[29861]: from='osd.4 v1:172.21.15.188:6800/3630742885' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-05T07:15:45.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[29861]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-05T07:15:45.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[29861]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:45.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:45.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:45.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:45.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:45.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:45.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[41609]: from='osd.4 v1:172.21.15.188:6800/3630742885' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-05T07:15:45.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[41609]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-05T07:15:45.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[41609]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:45.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:45.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:45.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:44 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:45.710 DEBUG:teuthology.orchestra.run.smithi188:osd.4> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.4.service 2024-02-05T07:15:45.712 INFO:tasks.cephadm:Deploying osd.5 on smithi188 with /dev/vg_nvme/lv_3... 2024-02-05T07:15:45.712 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-05T07:15:45.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:45 smithi188 ceph-mon[33283]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-05T07:15:45.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:45 smithi188 ceph-mon[33283]: from='osd.4 v1:172.21.15.188:6800/3630742885' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:15:45.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:45 smithi188 ceph-mon[33283]: osdmap e28: 5 total, 4 up, 5 in 2024-02-05T07:15:45.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:45 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:15:45.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:45 smithi188 ceph-mon[33283]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:15:45.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:45 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:46.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:45 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:46.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:45 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:15:46.000 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:15:45 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4[38737]: 2024-02-05T07:15:45.808+0000 7f02ffd4e700 -1 osd.4 0 waiting for initial osdmap 2024-02-05T07:15:46.000 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:15:45 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4[38737]: 2024-02-05T07:15:45.818+0000 7f02fbb48700 -1 osd.4 29 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-05T07:15:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[29861]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-05T07:15:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[29861]: from='osd.4 v1:172.21.15.188:6800/3630742885' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:15:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[29861]: osdmap e28: 5 total, 4 up, 5 in 2024-02-05T07:15:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:15:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[29861]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:15:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:15:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[41609]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-05T07:15:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[41609]: from='osd.4 v1:172.21.15.188:6800/3630742885' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:15:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[41609]: osdmap e28: 5 total, 4 up, 5 in 2024-02-05T07:15:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:15:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[41609]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:15:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:45 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:15:46.516 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:15:46.895 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:46 smithi188 ceph-mon[33283]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-02-05T07:15:46.895 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:46 smithi188 ceph-mon[33283]: osdmap e29: 5 total, 4 up, 5 in 2024-02-05T07:15:46.895 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:46 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:15:46.895 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:46 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:15:46.895 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:46 smithi188 ceph-mon[33283]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:47.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:46 smithi184 ceph-mon[29861]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-02-05T07:15:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:46 smithi184 ceph-mon[29861]: osdmap e29: 5 total, 4 up, 5 in 2024-02-05T07:15:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:46 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:15:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:46 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:15:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:46 smithi184 ceph-mon[29861]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:46 smithi184 ceph-mon[41609]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-02-05T07:15:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:46 smithi184 ceph-mon[41609]: osdmap e29: 5 total, 4 up, 5 in 2024-02-05T07:15:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:46 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:15:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:46 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:15:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:46 smithi184 ceph-mon[41609]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-05T07:15:48.102 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:47 smithi188 ceph-mon[33283]: purged_snaps scrub starts 2024-02-05T07:15:48.103 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:47 smithi188 ceph-mon[33283]: purged_snaps scrub ok 2024-02-05T07:15:48.103 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:47 smithi188 ceph-mon[33283]: osd.4 v1:172.21.15.188:6800/3630742885 boot 2024-02-05T07:15:48.103 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:47 smithi188 ceph-mon[33283]: osdmap e30: 5 total, 5 up, 5 in 2024-02-05T07:15:48.103 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:47 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:15:48.103 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:47 smithi188 ceph-mon[33283]: osdmap e31: 5 total, 5 up, 5 in 2024-02-05T07:15:48.124 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:47 smithi184 ceph-mon[29861]: purged_snaps scrub starts 2024-02-05T07:15:48.124 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:47 smithi184 ceph-mon[29861]: purged_snaps scrub ok 2024-02-05T07:15:48.124 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:47 smithi184 ceph-mon[29861]: osd.4 v1:172.21.15.188:6800/3630742885 boot 2024-02-05T07:15:48.124 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:47 smithi184 ceph-mon[29861]: osdmap e30: 5 total, 5 up, 5 in 2024-02-05T07:15:48.124 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:47 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:15:48.124 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:47 smithi184 ceph-mon[29861]: osdmap e31: 5 total, 5 up, 5 in 2024-02-05T07:15:48.125 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:47 smithi184 ceph-mon[41609]: purged_snaps scrub starts 2024-02-05T07:15:48.125 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:47 smithi184 ceph-mon[41609]: purged_snaps scrub ok 2024-02-05T07:15:48.125 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:47 smithi184 ceph-mon[41609]: osd.4 v1:172.21.15.188:6800/3630742885 boot 2024-02-05T07:15:48.125 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:47 smithi184 ceph-mon[41609]: osdmap e30: 5 total, 5 up, 5 in 2024-02-05T07:15:48.125 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:47 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:15:48.125 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:47 smithi184 ceph-mon[41609]: osdmap e31: 5 total, 5 up, 5 in 2024-02-05T07:15:49.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:48 smithi184 ceph-mon[29861]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:15:49.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:48 smithi184 ceph-mon[29861]: osdmap e32: 5 total, 5 up, 5 in 2024-02-05T07:15:49.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:48 smithi184 ceph-mon[41609]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:15:49.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:48 smithi184 ceph-mon[41609]: osdmap e32: 5 total, 5 up, 5 in 2024-02-05T07:15:49.066 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:48 smithi188 ceph-mon[33283]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:15:49.067 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:48 smithi188 ceph-mon[33283]: osdmap e32: 5 total, 5 up, 5 in 2024-02-05T07:15:49.905 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-05T07:15:49.905 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-05T07:15:49.905 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-02-05T07:15:49.905 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-02-05T07:15:49.905 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111028 s, 944 MB/s 2024-02-05T07:15:49.906 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-02-05T07:15:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:50 smithi188 ceph-mon[33283]: Detected new or changed devices on smithi188 2024-02-05T07:15:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:50 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:50 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:50 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:50 smithi188 ceph-mon[33283]: Adjusting osd_memory_target on smithi188 to 17088M 2024-02-05T07:15:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:50 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:50 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:50.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:50 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:50.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:50 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:50.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:50 smithi188 ceph-mon[33283]: osdmap e33: 5 total, 5 up, 5 in 2024-02-05T07:15:50.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[29861]: Detected new or changed devices on smithi188 2024-02-05T07:15:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[29861]: Adjusting osd_memory_target on smithi188 to 17088M 2024-02-05T07:15:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[29861]: osdmap e33: 5 total, 5 up, 5 in 2024-02-05T07:15:50.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[41609]: Detected new or changed devices on smithi188 2024-02-05T07:15:50.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:50.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:50.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:15:50.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[41609]: Adjusting osd_memory_target on smithi188 to 17088M 2024-02-05T07:15:50.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:50.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:50.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:15:50.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:15:50.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:50 smithi184 ceph-mon[41609]: osdmap e33: 5 total, 5 up, 5 in 2024-02-05T07:15:50.544 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch daemon add osd smithi188:vg_nvme/lv_3 2024-02-05T07:15:50.781 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:15:51.461 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:51 smithi188 ceph-mon[33283]: osdmap e34: 5 total, 5 up, 5 in 2024-02-05T07:15:51.461 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:51 smithi188 ceph-mon[33283]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:15:51.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:51 smithi184 ceph-mon[29861]: osdmap e34: 5 total, 5 up, 5 in 2024-02-05T07:15:51.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:51 smithi184 ceph-mon[29861]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:15:51.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:51 smithi184 ceph-mon[41609]: osdmap e34: 5 total, 5 up, 5 in 2024-02-05T07:15:51.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:51 smithi184 ceph-mon[41609]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:15:52.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.293+0000 7f49692fe700 1 -- 172.21.15.188:0/3546579962 >> v1:172.21.15.188:6789/0 conn(0x7f4964106150 legacy=0x7f4964108540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:15:52.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.293+0000 7f49692fe700 1 -- 172.21.15.188:0/3546579962 shutdown_connections 2024-02-05T07:15:52.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.293+0000 7f49692fe700 1 -- 172.21.15.188:0/3546579962 >> 172.21.15.188:0/3546579962 conn(0x7f49640fbfb0 msgr2=0x7f49640fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:15:52.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.293+0000 7f49692fe700 1 -- 172.21.15.188:0/3546579962 shutdown_connections 2024-02-05T07:15:52.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.293+0000 7f49692fe700 1 -- 172.21.15.188:0/3546579962 wait complete. 2024-02-05T07:15:52.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.293+0000 7f49692fe700 1 Processor -- start 2024-02-05T07:15:52.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.293+0000 7f49692fe700 1 -- start start 2024-02-05T07:15:52.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f49692fe700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4964110db0 con 0x7f4964109c60 2024-02-05T07:15:52.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f49692fe700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4964197ba0 con 0x7f4964102640 2024-02-05T07:15:52.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f49692fe700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f49641a4340 con 0x7f4964106150 2024-02-05T07:15:52.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f4962ffd700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f4964102640 0x7f4964196ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:43784/0 (socket says 172.21.15.188:43784) 2024-02-05T07:15:52.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f4962ffd700 1 -- 172.21.15.188:0/3410679594 learned_addr learned my addr 172.21.15.188:0/3410679594 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:15:52.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150052639 0 0) 0x7f4964197ba0 con 0x7f4964102640 2024-02-05T07:15:52.297 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49500035b0 con 0x7f4964102640 2024-02-05T07:15:52.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92732308 0 0) 0x7f49641a4340 con 0x7f4964106150 2024-02-05T07:15:52.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4964197ba0 con 0x7f4964106150 2024-02-05T07:15:52.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271444224 0 0) 0x7f4964110db0 con 0x7f4964109c60 2024-02-05T07:15:52.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49641a4340 con 0x7f4964109c60 2024-02-05T07:15:52.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 295191053 0 0) 0x7f49500035b0 con 0x7f4964102640 2024-02-05T07:15:52.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4964110db0 con 0x7f4964102640 2024-02-05T07:15:52.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f4954001c30 con 0x7f4964102640 2024-02-05T07:15:52.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3516483069 0 0) 0x7f4964110db0 con 0x7f4964102640 2024-02-05T07:15:52.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 >> v1:172.21.15.184:6790/0 conn(0x7f4964106150 legacy=0x7f496419d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:15:52.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 >> v1:172.21.15.184:6789/0 conn(0x7f4964109c60 legacy=0x7f49641a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:15:52.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49641a54e0 con 0x7f4964102640 2024-02-05T07:15:52.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f49692fe700 1 -- 172.21.15.188:0/3410679594 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49641a4530 con 0x7f4964102640 2024-02-05T07:15:52.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f49692fe700 1 -- 172.21.15.188:0/3410679594 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f49641a4a30 con 0x7f4964102640 2024-02-05T07:15:52.298 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.294+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f4954001fe0 con 0x7f4964102640 2024-02-05T07:15:52.299 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.295+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f4954005fc0 con 0x7f4964102640 2024-02-05T07:15:52.299 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.295+0000 7f49692fe700 1 -- 172.21.15.188:0/3410679594 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4944005150 con 0x7f4964102640 2024-02-05T07:15:52.299 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.296+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 15) v1 ==== 91372+0+0 (unknown 1941537730 0 0) 0x7f4954003cd0 con 0x7f4964102640 2024-02-05T07:15:52.299 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.296+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(34..34 src has 1..34) v4 ==== 3205+0+0 (unknown 48399828 0 0) 0x7f4954087e80 con 0x7f4964102640 2024-02-05T07:15:52.303 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.301+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f4954052290 con 0x7f4964102640 2024-02-05T07:15:52.504 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:15:52.501+0000 7f49692fe700 1 -- 172.21.15.188:0/3410679594 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4944000bc0 con 0x7f495006e320 2024-02-05T07:15:53.359 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:53 smithi188 ceph-mon[33283]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:15:53.359 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:53 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:15:53.359 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:53 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:15:53.359 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:53 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:53.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:53 smithi184 ceph-mon[29861]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:15:53.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:53 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:15:53.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:53 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:15:53.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:53 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:53.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:53 smithi184 ceph-mon[41609]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:15:53.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:53 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:15:53.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:53 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:15:53.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:53 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:15:54.402 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:54 smithi188 ceph-mon[33283]: from='client.24250 v1:172.21.15.188:0/3410679594' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:15:54.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:54 smithi184 ceph-mon[29861]: from='client.24250 v1:172.21.15.188:0/3410679594' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:15:54.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:54 smithi184 ceph-mon[41609]: from='client.24250 v1:172.21.15.188:0/3410679594' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:15:55.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:55 smithi188 ceph-mon[33283]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-05T07:15:55.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:55 smithi184 ceph-mon[29861]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-05T07:15:55.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:55 smithi184 ceph-mon[41609]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-05T07:15:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:56 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.188:0/1625506239' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcc242b3-3f4a-4f09-83f3-5d8e6afb8a2e"}]: dispatch 2024-02-05T07:15:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:56 smithi188 ceph-mon[33283]: from='client.24256 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcc242b3-3f4a-4f09-83f3-5d8e6afb8a2e"}]: dispatch 2024-02-05T07:15:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:56 smithi188 ceph-mon[33283]: from='client.24256 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcc242b3-3f4a-4f09-83f3-5d8e6afb8a2e"}]': finished 2024-02-05T07:15:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:56 smithi188 ceph-mon[33283]: osdmap e35: 6 total, 5 up, 6 in 2024-02-05T07:15:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:56 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:15:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:56 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.188:0/1828782649' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:15:56.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:56 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.188:0/1625506239' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcc242b3-3f4a-4f09-83f3-5d8e6afb8a2e"}]: dispatch 2024-02-05T07:15:56.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:56 smithi184 ceph-mon[29861]: from='client.24256 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcc242b3-3f4a-4f09-83f3-5d8e6afb8a2e"}]: dispatch 2024-02-05T07:15:56.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:56 smithi184 ceph-mon[29861]: from='client.24256 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcc242b3-3f4a-4f09-83f3-5d8e6afb8a2e"}]': finished 2024-02-05T07:15:56.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:56 smithi184 ceph-mon[29861]: osdmap e35: 6 total, 5 up, 6 in 2024-02-05T07:15:56.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:56 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:15:56.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:56 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.188:0/1828782649' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:15:56.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:56 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.188:0/1625506239' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcc242b3-3f4a-4f09-83f3-5d8e6afb8a2e"}]: dispatch 2024-02-05T07:15:56.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:56 smithi184 ceph-mon[41609]: from='client.24256 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dcc242b3-3f4a-4f09-83f3-5d8e6afb8a2e"}]: dispatch 2024-02-05T07:15:56.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:56 smithi184 ceph-mon[41609]: from='client.24256 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dcc242b3-3f4a-4f09-83f3-5d8e6afb8a2e"}]': finished 2024-02-05T07:15:56.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:56 smithi184 ceph-mon[41609]: osdmap e35: 6 total, 5 up, 6 in 2024-02-05T07:15:56.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:56 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:15:56.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:56 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.188:0/1828782649' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:15:57.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:57 smithi188 ceph-mon[33283]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-02-05T07:15:57.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:57 smithi184 ceph-mon[29861]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-02-05T07:15:57.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:57 smithi184 ceph-mon[41609]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-02-05T07:15:59.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:15:59 smithi188 ceph-mon[33283]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-05T07:15:59.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:15:59 smithi184 ceph-mon[29861]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-05T07:15:59.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:15:59 smithi184 ceph-mon[41609]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-05T07:16:01.477 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:01 smithi188 ceph-mon[33283]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-05T07:16:01.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:01 smithi184 ceph-mon[29861]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-05T07:16:01.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:01 smithi184 ceph-mon[41609]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-05T07:16:02.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-05T07:16:02.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:02.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-05T07:16:02.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:02.546 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-05T07:16:02.546 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:03.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:03 smithi188 ceph-mon[33283]: Deploying daemon osd.5 on smithi188 2024-02-05T07:16:03.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:03 smithi188 ceph-mon[33283]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-05T07:16:03.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:03 smithi184 ceph-mon[29861]: Deploying daemon osd.5 on smithi188 2024-02-05T07:16:03.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:03 smithi184 ceph-mon[29861]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-05T07:16:03.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:03 smithi184 ceph-mon[41609]: Deploying daemon osd.5 on smithi188 2024-02-05T07:16:03.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:03 smithi184 ceph-mon[41609]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-05T07:16:05.423 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:05 smithi188 ceph-mon[33283]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:16:05.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:05 smithi184 ceph-mon[29861]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:16:05.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:05 smithi184 ceph-mon[41609]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:16:07.409 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:07 smithi188 ceph-mon[33283]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:16:07.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:07 smithi184 ceph-mon[29861]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:16:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:07 smithi184 ceph-mon[41609]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:16:08.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:08 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:08.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:08 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:08.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:08 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:16:08.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:08 smithi188 ceph-mon[33283]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:16:09.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:08 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:09.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:08 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:09.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:08 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:16:09.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:08 smithi184 ceph-mon[29861]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:16:09.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:08 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:09.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:08 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:09.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:08 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:16:09.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:08 smithi184 ceph-mon[41609]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:16:11.311 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:11 smithi188 ceph-mon[33283]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:16:11.311 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:11 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:11.311 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:11 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:11.311 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:11 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:11.311 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:11 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:16:11.311 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:11 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:11.311 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:11 smithi188 ceph-mon[33283]: from='osd.5 v1:172.21.15.188:6804/52728079' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-05T07:16:11.312 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:11 smithi188 ceph-mon[33283]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-05T07:16:11.369 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:11.366+0000 7f495bfff700 1 -- 172.21.15.188:0/3410679594 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 3275487083) 0x7f4944000bc0 con 0x7f495006e320 2024-02-05T07:16:11.369 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 5 on host 'smithi188' 2024-02-05T07:16:11.371 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:11.368+0000 7f49692fe700 1 -- 172.21.15.188:0/3410679594 >> v1:172.21.15.184:6800/2865218501 conn(0x7f495006e320 legacy=0x7f49500707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:16:11.371 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:11.368+0000 7f49692fe700 1 -- 172.21.15.188:0/3410679594 >> v1:172.21.15.188:6789/0 conn(0x7f4964102640 legacy=0x7f4964196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:16:11.371 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:11.369+0000 7f49692fe700 1 -- 172.21.15.188:0/3410679594 shutdown_connections 2024-02-05T07:16:11.371 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:11.369+0000 7f49692fe700 1 -- 172.21.15.188:0/3410679594 >> 172.21.15.188:0/3410679594 conn(0x7f49640fbfb0 msgr2=0x7f496410c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:16:11.371 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:11.369+0000 7f49692fe700 1 -- 172.21.15.188:0/3410679594 shutdown_connections 2024-02-05T07:16:11.371 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:11.369+0000 7f49692fe700 1 -- 172.21.15.188:0/3410679594 wait complete. 2024-02-05T07:16:11.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[29861]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:16:11.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:11.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:11.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:11.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:16:11.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:11.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[29861]: from='osd.5 v1:172.21.15.188:6804/52728079' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-05T07:16:11.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[29861]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-05T07:16:11.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[41609]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:16:11.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:11.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:11.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:11.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:16:11.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:11.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[41609]: from='osd.5 v1:172.21.15.188:6804/52728079' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-05T07:16:11.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:11 smithi184 ceph-mon[41609]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-05T07:16:12.005 DEBUG:teuthology.orchestra.run.smithi188:osd.5> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.5.service 2024-02-05T07:16:12.007 INFO:tasks.cephadm:Deploying osd.6 on smithi188 with /dev/vg_nvme/lv_2... 2024-02-05T07:16:12.007 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-05T07:16:12.560 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:12 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:12.560 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:12 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:12.560 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:12 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:16:12.560 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:12 smithi188 ceph-mon[33283]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-05T07:16:12.560 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:12 smithi188 ceph-mon[33283]: from='osd.5 v1:172.21.15.188:6804/52728079' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:16:12.560 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:12 smithi188 ceph-mon[33283]: osdmap e36: 6 total, 5 up, 6 in 2024-02-05T07:16:12.560 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:12 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:16:12.560 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:12 smithi188 ceph-mon[33283]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:16:12.560 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:12 smithi188 ceph-mon[33283]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:16:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:16:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[41609]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-05T07:16:12.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[41609]: from='osd.5 v1:172.21.15.188:6804/52728079' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:16:12.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[41609]: osdmap e36: 6 total, 5 up, 6 in 2024-02-05T07:16:12.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:16:12.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[41609]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:16:12.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[41609]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:16:12.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:12.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:12.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:16:12.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[29861]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-05T07:16:12.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[29861]: from='osd.5 v1:172.21.15.188:6804/52728079' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:16:12.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[29861]: osdmap e36: 6 total, 5 up, 6 in 2024-02-05T07:16:12.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:16:12.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[29861]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:16:12.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:12 smithi184 ceph-mon[29861]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-05T07:16:12.801 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:16:13.155 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:16:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:16:12.969+0000 7f7cc93fb700 -1 osd.5 0 waiting for initial osdmap 2024-02-05T07:16:13.155 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:16:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:16:12.972+0000 7f7cc09ec700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-05T07:16:13.682 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:13 smithi188 ceph-mon[33283]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-02-05T07:16:13.682 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:13 smithi188 ceph-mon[33283]: osdmap e37: 6 total, 5 up, 6 in 2024-02-05T07:16:13.682 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:13 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:16:13.682 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:13 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:16:13.682 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:13 smithi188 ceph-mon[33283]: from='osd.5 ' entity='osd.5' 2024-02-05T07:16:14.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:13 smithi184 ceph-mon[29861]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-02-05T07:16:14.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:13 smithi184 ceph-mon[29861]: osdmap e37: 6 total, 5 up, 6 in 2024-02-05T07:16:14.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:13 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:16:14.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:13 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:16:14.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:13 smithi184 ceph-mon[29861]: from='osd.5 ' entity='osd.5' 2024-02-05T07:16:14.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:13 smithi184 ceph-mon[41609]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-02-05T07:16:14.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:13 smithi184 ceph-mon[41609]: osdmap e37: 6 total, 5 up, 6 in 2024-02-05T07:16:14.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:13 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:16:14.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:13 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:16:14.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:13 smithi184 ceph-mon[41609]: from='osd.5 ' entity='osd.5' 2024-02-05T07:16:14.798 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:14 smithi188 ceph-mon[33283]: purged_snaps scrub starts 2024-02-05T07:16:14.799 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:14 smithi188 ceph-mon[33283]: purged_snaps scrub ok 2024-02-05T07:16:14.799 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:14 smithi188 ceph-mon[33283]: osd.5 v1:172.21.15.188:6804/52728079 boot 2024-02-05T07:16:14.799 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:14 smithi188 ceph-mon[33283]: osdmap e38: 6 total, 6 up, 6 in 2024-02-05T07:16:14.799 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:14 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:16:14.799 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:14 smithi188 ceph-mon[33283]: osdmap e39: 6 total, 6 up, 6 in 2024-02-05T07:16:14.799 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:14 smithi188 ceph-mon[33283]: pgmap v134: 1 pgs: 1 unknown; 577 KiB data, 477 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:15.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:14 smithi184 ceph-mon[29861]: purged_snaps scrub starts 2024-02-05T07:16:15.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:14 smithi184 ceph-mon[29861]: purged_snaps scrub ok 2024-02-05T07:16:15.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:14 smithi184 ceph-mon[29861]: osd.5 v1:172.21.15.188:6804/52728079 boot 2024-02-05T07:16:15.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:14 smithi184 ceph-mon[29861]: osdmap e38: 6 total, 6 up, 6 in 2024-02-05T07:16:15.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:14 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:16:15.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:14 smithi184 ceph-mon[29861]: osdmap e39: 6 total, 6 up, 6 in 2024-02-05T07:16:15.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:14 smithi184 ceph-mon[29861]: pgmap v134: 1 pgs: 1 unknown; 577 KiB data, 477 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:15.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:14 smithi184 ceph-mon[41609]: purged_snaps scrub starts 2024-02-05T07:16:15.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:14 smithi184 ceph-mon[41609]: purged_snaps scrub ok 2024-02-05T07:16:15.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:14 smithi184 ceph-mon[41609]: osd.5 v1:172.21.15.188:6804/52728079 boot 2024-02-05T07:16:15.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:14 smithi184 ceph-mon[41609]: osdmap e38: 6 total, 6 up, 6 in 2024-02-05T07:16:15.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:14 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:16:15.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:14 smithi184 ceph-mon[41609]: osdmap e39: 6 total, 6 up, 6 in 2024-02-05T07:16:15.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:14 smithi184 ceph-mon[41609]: pgmap v134: 1 pgs: 1 unknown; 577 KiB data, 477 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:15.868 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-05T07:16:15.868 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-05T07:16:15.868 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-02-05T07:16:15.869 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-02-05T07:16:15.869 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0124379 s, 843 MB/s 2024-02-05T07:16:15.869 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-02-05T07:16:16.443 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:16 smithi188 ceph-mon[33283]: osdmap e40: 6 total, 6 up, 6 in 2024-02-05T07:16:16.443 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:16 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:16.443 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:16 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:16.443 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:16 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:16:16.443 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:16 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:16:16.443 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:16 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:16.443 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:16 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:16.443 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:16 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:16:16.444 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:16 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:16.469 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch daemon add osd smithi188:vg_nvme/lv_2 2024-02-05T07:16:16.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[41609]: osdmap e40: 6 total, 6 up, 6 in 2024-02-05T07:16:16.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:16.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:16.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:16:16.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:16:16.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:16.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:16.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:16:16.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[29861]: osdmap e40: 6 total, 6 up, 6 in 2024-02-05T07:16:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:16:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:16:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:16.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:16.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:16:16.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:16 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:16.703 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:16:17.449 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:17 smithi188 ceph-mon[33283]: Detected new or changed devices on smithi188 2024-02-05T07:16:17.449 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:17 smithi188 ceph-mon[33283]: Adjusting osd_memory_target on smithi188 to 8544M 2024-02-05T07:16:17.449 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:17 smithi188 ceph-mon[33283]: osdmap e41: 6 total, 6 up, 6 in 2024-02-05T07:16:17.449 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:17 smithi188 ceph-mon[33283]: pgmap v137: 1 pgs: 1 unknown; 577 KiB data, 477 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:17.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:17 smithi184 ceph-mon[29861]: Detected new or changed devices on smithi188 2024-02-05T07:16:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:17 smithi184 ceph-mon[29861]: Adjusting osd_memory_target on smithi188 to 8544M 2024-02-05T07:16:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:17 smithi184 ceph-mon[29861]: osdmap e41: 6 total, 6 up, 6 in 2024-02-05T07:16:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:17 smithi184 ceph-mon[29861]: pgmap v137: 1 pgs: 1 unknown; 577 KiB data, 477 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:17.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:17 smithi184 ceph-mon[41609]: Detected new or changed devices on smithi188 2024-02-05T07:16:17.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:17 smithi184 ceph-mon[41609]: Adjusting osd_memory_target on smithi188 to 8544M 2024-02-05T07:16:17.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:17 smithi184 ceph-mon[41609]: osdmap e41: 6 total, 6 up, 6 in 2024-02-05T07:16:17.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:17 smithi184 ceph-mon[41609]: pgmap v137: 1 pgs: 1 unknown; 577 KiB data, 477 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:18.284 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.280+0000 7f960e3fc700 1 -- 172.21.15.188:0/3680483532 >> v1:172.21.15.188:6789/0 conn(0x7f9608101b30 legacy=0x7f9608101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:16:18.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.280+0000 7f960e3fc700 1 -- 172.21.15.188:0/3680483532 shutdown_connections 2024-02-05T07:16:18.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.280+0000 7f960e3fc700 1 -- 172.21.15.188:0/3680483532 >> 172.21.15.188:0/3680483532 conn(0x7f96080fd0d0 msgr2=0x7f96080ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:16:18.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.280+0000 7f960e3fc700 1 -- 172.21.15.188:0/3680483532 shutdown_connections 2024-02-05T07:16:18.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.280+0000 7f960e3fc700 1 -- 172.21.15.188:0/3680483532 wait complete. 2024-02-05T07:16:18.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.281+0000 7f960e3fc700 1 Processor -- start 2024-02-05T07:16:18.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.281+0000 7f960e3fc700 1 -- start start 2024-02-05T07:16:18.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.281+0000 7f960e3fc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f96081a41d0 con 0x7f9608101b30 2024-02-05T07:16:18.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.281+0000 7f960e3fc700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f96081a53d0 con 0x7f9608109ca0 2024-02-05T07:16:18.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.281+0000 7f960e3fc700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f96081a65d0 con 0x7f9608105f60 2024-02-05T07:16:18.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.281+0000 7f960c999700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f9608109ca0 0x7f96081a28d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:47388/0 (socket says 172.21.15.188:47388) 2024-02-05T07:16:18.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.281+0000 7f960c999700 1 -- 172.21.15.188:0/1018595877 learned_addr learned my addr 172.21.15.188:0/1018595877 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:16:18.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.281+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715991951 0 0) 0x7f96081a53d0 con 0x7f9608109ca0 2024-02-05T07:16:18.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95f40035b0 con 0x7f9608109ca0 2024-02-05T07:16:18.285 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378457392 0 0) 0x7f96081a41d0 con 0x7f9608101b30 2024-02-05T07:16:18.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96081a53d0 con 0x7f9608101b30 2024-02-05T07:16:18.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462240776 0 0) 0x7f96081a65d0 con 0x7f9608105f60 2024-02-05T07:16:18.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96081a41d0 con 0x7f9608105f60 2024-02-05T07:16:18.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1208209381 0 0) 0x7f95f40035b0 con 0x7f9608109ca0 2024-02-05T07:16:18.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f96081a65d0 con 0x7f9608109ca0 2024-02-05T07:16:18.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9600001ba0 con 0x7f9608109ca0 2024-02-05T07:16:18.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3285333617 0 0) 0x7f96081a53d0 con 0x7f9608101b30 2024-02-05T07:16:18.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f95f40035b0 con 0x7f9608101b30 2024-02-05T07:16:18.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f95f00044c0 con 0x7f9608101b30 2024-02-05T07:16:18.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4078182992 0 0) 0x7f96081a41d0 con 0x7f9608105f60 2024-02-05T07:16:18.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f96081a53d0 con 0x7f9608105f60 2024-02-05T07:16:18.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f95f80017f0 con 0x7f9608105f60 2024-02-05T07:16:18.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3768596287 0 0) 0x7f96081a65d0 con 0x7f9608109ca0 2024-02-05T07:16:18.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 >> v1:172.21.15.184:6790/0 conn(0x7f9608105f60 legacy=0x7f960819efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:16:18.286 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 >> v1:172.21.15.184:6789/0 conn(0x7f9608101b30 legacy=0x7f96080759e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:16:18.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96081a77d0 con 0x7f9608109ca0 2024-02-05T07:16:18.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f960e3fc700 1 -- 172.21.15.188:0/1018595877 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96081a43c0 con 0x7f9608109ca0 2024-02-05T07:16:18.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f960e3fc700 1 -- 172.21.15.188:0/1018595877 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f96081a48c0 con 0x7f9608109ca0 2024-02-05T07:16:18.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f9600003eb0 con 0x7f9608109ca0 2024-02-05T07:16:18.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.282+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9600005eb0 con 0x7f9608109ca0 2024-02-05T07:16:18.287 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.283+0000 7f960e3fc700 1 -- 172.21.15.188:0/1018595877 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e8005150 con 0x7f9608109ca0 2024-02-05T07:16:18.288 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.284+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 15) v1 ==== 91372+0+0 (unknown 1941537730 0 0) 0x7f9600003a20 con 0x7f9608109ca0 2024-02-05T07:16:18.288 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.284+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(42..42 src has 1..42) v4 ==== 3497+0+0 (unknown 1750581831 0 0) 0x7f9600087fd0 con 0x7f9608109ca0 2024-02-05T07:16:18.290 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.288+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f96000521e0 con 0x7f9608109ca0 2024-02-05T07:16:18.490 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:18.488+0000 7f960e3fc700 1 -- 172.21.15.188:0/1018595877 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f95e8000bc0 con 0x7f95f406e990 2024-02-05T07:16:18.491 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:18 smithi188 ceph-mon[33283]: osdmap e42: 6 total, 6 up, 6 in 2024-02-05T07:16:18.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:18 smithi184 ceph-mon[29861]: osdmap e42: 6 total, 6 up, 6 in 2024-02-05T07:16:18.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:18 smithi184 ceph-mon[41609]: osdmap e42: 6 total, 6 up, 6 in 2024-02-05T07:16:19.406 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:19 smithi188 ceph-mon[33283]: pgmap v139: 1 pgs: 1 unknown; 577 KiB data, 478 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:19.406 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:16:19.406 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:16:19.406 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:19.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:19 smithi184 ceph-mon[41609]: pgmap v139: 1 pgs: 1 unknown; 577 KiB data, 478 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:19.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:19 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:16:19.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:19 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:16:19.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:19 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:19.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:19 smithi184 ceph-mon[29861]: pgmap v139: 1 pgs: 1 unknown; 577 KiB data, 478 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:19.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:19 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:16:19.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:19 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:16:19.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:19 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:20.382 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:20 smithi188 ceph-mon[33283]: from='client.24277 v1:172.21.15.188:0/1018595877' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:16:20.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:20 smithi184 ceph-mon[29861]: from='client.24277 v1:172.21.15.188:0/1018595877' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:16:20.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:20 smithi184 ceph-mon[41609]: from='client.24277 v1:172.21.15.188:0/1018595877' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:16:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:21 smithi188 ceph-mon[33283]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-05T07:16:21.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:21 smithi184 ceph-mon[29861]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-05T07:16:21.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:21 smithi184 ceph-mon[41609]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-05T07:16:22.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.188:0/3826616310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a53c7687-7dd7-4cf9-9a1c-5644b6474991"}]: dispatch 2024-02-05T07:16:22.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:22 smithi188 ceph-mon[33283]: from='client.24283 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a53c7687-7dd7-4cf9-9a1c-5644b6474991"}]: dispatch 2024-02-05T07:16:22.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:22 smithi188 ceph-mon[33283]: from='client.24283 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a53c7687-7dd7-4cf9-9a1c-5644b6474991"}]': finished 2024-02-05T07:16:22.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:22 smithi188 ceph-mon[33283]: osdmap e43: 7 total, 6 up, 7 in 2024-02-05T07:16:22.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:22 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:16:22.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.188:0/3115563536' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:16:22.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.188:0/3826616310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a53c7687-7dd7-4cf9-9a1c-5644b6474991"}]: dispatch 2024-02-05T07:16:22.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:22 smithi184 ceph-mon[41609]: from='client.24283 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a53c7687-7dd7-4cf9-9a1c-5644b6474991"}]: dispatch 2024-02-05T07:16:22.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:22 smithi184 ceph-mon[41609]: from='client.24283 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a53c7687-7dd7-4cf9-9a1c-5644b6474991"}]': finished 2024-02-05T07:16:22.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:22 smithi184 ceph-mon[41609]: osdmap e43: 7 total, 6 up, 7 in 2024-02-05T07:16:22.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:22 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:16:22.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.188:0/3115563536' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:16:22.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.188:0/3826616310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a53c7687-7dd7-4cf9-9a1c-5644b6474991"}]: dispatch 2024-02-05T07:16:22.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:22 smithi184 ceph-mon[29861]: from='client.24283 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a53c7687-7dd7-4cf9-9a1c-5644b6474991"}]: dispatch 2024-02-05T07:16:22.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:22 smithi184 ceph-mon[29861]: from='client.24283 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a53c7687-7dd7-4cf9-9a1c-5644b6474991"}]': finished 2024-02-05T07:16:22.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:22 smithi184 ceph-mon[29861]: osdmap e43: 7 total, 6 up, 7 in 2024-02-05T07:16:22.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:22 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:16:22.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.188:0/3115563536' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:16:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:23 smithi188 ceph-mon[33283]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-05T07:16:23.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:23 smithi184 ceph-mon[29861]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-05T07:16:23.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:23 smithi184 ceph-mon[41609]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-05T07:16:25.414 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:25 smithi188 ceph-mon[33283]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-05T07:16:25.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:25 smithi184 ceph-mon[29861]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-05T07:16:25.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:25 smithi184 ceph-mon[41609]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-05T07:16:27.397 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:27 smithi188 ceph-mon[33283]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-02-05T07:16:27.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:27 smithi184 ceph-mon[41609]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-02-05T07:16:27.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:27 smithi184 ceph-mon[29861]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-02-05T07:16:28.504 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:28 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-05T07:16:28.504 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:28 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:28.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:28 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-05T07:16:28.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:28 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:28.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:28 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-05T07:16:28.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:28 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:29.337 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:29 smithi188 ceph-mon[33283]: Deploying daemon osd.6 on smithi188 2024-02-05T07:16:29.338 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:29 smithi188 ceph-mon[33283]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-05T07:16:29.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:29 smithi184 ceph-mon[29861]: Deploying daemon osd.6 on smithi188 2024-02-05T07:16:29.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:29 smithi184 ceph-mon[29861]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-05T07:16:29.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:29 smithi184 ceph-mon[41609]: Deploying daemon osd.6 on smithi188 2024-02-05T07:16:29.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:29 smithi184 ceph-mon[41609]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-05T07:16:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:31 smithi188 ceph-mon[33283]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:31.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:31 smithi184 ceph-mon[29861]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:31.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:31 smithi184 ceph-mon[41609]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:33.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:33 smithi188 ceph-mon[33283]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:33.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:33 smithi184 ceph-mon[29861]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:33.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:33 smithi184 ceph-mon[41609]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:34.435 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:34 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:34.435 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:34 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:34.435 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:34 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:16:34.435 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:34 smithi188 ceph-mon[33283]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:34.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:34 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:34.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:34 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:34 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:16:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:34 smithi184 ceph-mon[29861]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:34.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:34 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:34.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:34 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:34.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:34 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:16:34.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:34 smithi184 ceph-mon[41609]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:37.204 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:37.202+0000 7f96057fa700 1 -- 172.21.15.188:0/1018595877 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 654689463) 0x7f95e8000bc0 con 0x7f95f406e990 2024-02-05T07:16:37.205 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 6 on host 'smithi188' 2024-02-05T07:16:37.207 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:37.205+0000 7f960e3fc700 1 -- 172.21.15.188:0/1018595877 >> v1:172.21.15.184:6800/2865218501 conn(0x7f95f406e990 legacy=0x7f95f4070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:16:37.207 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:37.205+0000 7f960e3fc700 1 -- 172.21.15.188:0/1018595877 >> v1:172.21.15.188:6789/0 conn(0x7f9608109ca0 legacy=0x7f96081a28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:16:37.207 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:37.205+0000 7f960e3fc700 1 -- 172.21.15.188:0/1018595877 shutdown_connections 2024-02-05T07:16:37.207 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:37.205+0000 7f960e3fc700 1 -- 172.21.15.188:0/1018595877 >> 172.21.15.188:0/1018595877 conn(0x7f96080fd0d0 msgr2=0x7f96080ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:16:37.207 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:37.205+0000 7f960e3fc700 1 -- 172.21.15.188:0/1018595877 shutdown_connections 2024-02-05T07:16:37.207 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:37.205+0000 7f960e3fc700 1 -- 172.21.15.188:0/1018595877 wait complete. 2024-02-05T07:16:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:37 smithi188 ceph-mon[33283]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:37 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:37 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:37 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:37 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:16:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:37 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:37 smithi188 ceph-mon[33283]: from='osd.6 v1:172.21.15.188:6808/2094972647' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-05T07:16:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:37 smithi188 ceph-mon[33283]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-05T07:16:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:37 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:37 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:37 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:16:37.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[41609]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:37.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:16:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[41609]: from='osd.6 v1:172.21.15.188:6808/2094972647' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-05T07:16:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[41609]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-05T07:16:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:16:37.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[29861]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:37.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:37.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:37.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:37.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:16:37.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:37.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[29861]: from='osd.6 v1:172.21.15.188:6808/2094972647' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-05T07:16:37.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[29861]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-05T07:16:37.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:37.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:37.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:37 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:16:37.816 DEBUG:teuthology.orchestra.run.smithi188:osd.6> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.6.service 2024-02-05T07:16:37.819 INFO:tasks.cephadm:Deploying osd.7 on smithi188 with /dev/vg_nvme/lv_1... 2024-02-05T07:16:37.819 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-05T07:16:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:38 smithi188 ceph-mon[33283]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-05T07:16:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:38 smithi188 ceph-mon[33283]: osdmap e44: 7 total, 6 up, 7 in 2024-02-05T07:16:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:38 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:16:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:38 smithi188 ceph-mon[33283]: from='osd.6 v1:172.21.15.188:6808/2094972647' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:16:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:38 smithi188 ceph-mon[33283]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:16:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:38 smithi188 ceph-mon[33283]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:38.500 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:16:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:16:38.375+0000 7f1dbbfbb700 -1 osd.6 0 waiting for initial osdmap 2024-02-05T07:16:38.500 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:16:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:16:38.380+0000 7f1db7db5700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-05T07:16:38.608 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:16:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:38 smithi184 ceph-mon[29861]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-05T07:16:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:38 smithi184 ceph-mon[29861]: osdmap e44: 7 total, 6 up, 7 in 2024-02-05T07:16:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:38 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:16:38.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:38 smithi184 ceph-mon[29861]: from='osd.6 v1:172.21.15.188:6808/2094972647' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:16:38.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:38 smithi184 ceph-mon[29861]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:16:38.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:38 smithi184 ceph-mon[29861]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:38.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:38 smithi184 ceph-mon[41609]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-05T07:16:38.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:38 smithi184 ceph-mon[41609]: osdmap e44: 7 total, 6 up, 7 in 2024-02-05T07:16:38.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:38 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:16:38.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:38 smithi184 ceph-mon[41609]: from='osd.6 v1:172.21.15.188:6808/2094972647' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:16:38.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:38 smithi184 ceph-mon[41609]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:16:38.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:38 smithi184 ceph-mon[41609]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-05T07:16:39.625 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:39 smithi188 ceph-mon[33283]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-02-05T07:16:39.625 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:39 smithi188 ceph-mon[33283]: osdmap e45: 7 total, 6 up, 7 in 2024-02-05T07:16:39.625 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:39 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:16:39.625 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:39 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:16:39.625 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:39 smithi188 ceph-mon[33283]: osd.6 v1:172.21.15.188:6808/2094972647 boot 2024-02-05T07:16:39.625 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:39 smithi188 ceph-mon[33283]: osdmap e46: 7 total, 7 up, 7 in 2024-02-05T07:16:39.625 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:39 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:16:39.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:39 smithi184 ceph-mon[29861]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-02-05T07:16:39.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:39 smithi184 ceph-mon[29861]: osdmap e45: 7 total, 6 up, 7 in 2024-02-05T07:16:39.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:39 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:16:39.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:39 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:16:39.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:39 smithi184 ceph-mon[29861]: osd.6 v1:172.21.15.188:6808/2094972647 boot 2024-02-05T07:16:39.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:39 smithi184 ceph-mon[29861]: osdmap e46: 7 total, 7 up, 7 in 2024-02-05T07:16:39.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:39 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:16:39.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:39 smithi184 ceph-mon[41609]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-02-05T07:16:39.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:39 smithi184 ceph-mon[41609]: osdmap e45: 7 total, 6 up, 7 in 2024-02-05T07:16:39.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:39 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:16:39.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:39 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:16:39.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:39 smithi184 ceph-mon[41609]: osd.6 v1:172.21.15.188:6808/2094972647 boot 2024-02-05T07:16:39.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:39 smithi184 ceph-mon[41609]: osdmap e46: 7 total, 7 up, 7 in 2024-02-05T07:16:39.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:39 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:16:40.528 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:40 smithi188 ceph-mon[33283]: purged_snaps scrub starts 2024-02-05T07:16:40.528 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:40 smithi188 ceph-mon[33283]: purged_snaps scrub ok 2024-02-05T07:16:40.528 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:40 smithi188 ceph-mon[33283]: osdmap e47: 7 total, 7 up, 7 in 2024-02-05T07:16:40.528 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:40 smithi188 ceph-mon[33283]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:16:40.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:40 smithi184 ceph-mon[29861]: purged_snaps scrub starts 2024-02-05T07:16:40.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:40 smithi184 ceph-mon[29861]: purged_snaps scrub ok 2024-02-05T07:16:40.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:40 smithi184 ceph-mon[29861]: osdmap e47: 7 total, 7 up, 7 in 2024-02-05T07:16:40.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:40 smithi184 ceph-mon[29861]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:16:40.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:40 smithi184 ceph-mon[41609]: purged_snaps scrub starts 2024-02-05T07:16:40.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:40 smithi184 ceph-mon[41609]: purged_snaps scrub ok 2024-02-05T07:16:40.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:40 smithi184 ceph-mon[41609]: osdmap e47: 7 total, 7 up, 7 in 2024-02-05T07:16:40.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:40 smithi184 ceph-mon[41609]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:16:41.362 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-05T07:16:41.363 INFO:teuthology.orchestra.run.smithi188.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-05T07:16:41.363 INFO:teuthology.orchestra.run.smithi188.stderr: stderr: 10+0 records in 2024-02-05T07:16:41.363 INFO:teuthology.orchestra.run.smithi188.stderr:10+0 records out 2024-02-05T07:16:41.363 INFO:teuthology.orchestra.run.smithi188.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0124863 s, 840 MB/s 2024-02-05T07:16:41.363 INFO:teuthology.orchestra.run.smithi188.stderr:--> Zapping successful for: 2024-02-05T07:16:42.139 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch daemon add osd smithi188:vg_nvme/lv_1 2024-02-05T07:16:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:42 smithi188 ceph-mon[33283]: osdmap e48: 7 total, 7 up, 7 in 2024-02-05T07:16:42.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:42 smithi184 ceph-mon[29861]: osdmap e48: 7 total, 7 up, 7 in 2024-02-05T07:16:42.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:42 smithi184 ceph-mon[41609]: osdmap e48: 7 total, 7 up, 7 in 2024-02-05T07:16:42.710 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:16:43.446 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:43 smithi188 ceph-mon[33283]: osdmap e49: 7 total, 7 up, 7 in 2024-02-05T07:16:43.446 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:43 smithi188 ceph-mon[33283]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:16:43.446 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:43 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:43.446 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:43 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:43.446 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:43 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:16:43.446 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:43 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:16:43.446 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:43 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:16:43.446 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:43 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:43.447 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:43 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:43.447 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:43 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:16:43.447 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:43 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:43.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[29861]: osdmap e49: 7 total, 7 up, 7 in 2024-02-05T07:16:43.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[29861]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:16:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:16:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:16:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:16:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:16:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:43.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[41609]: osdmap e49: 7 total, 7 up, 7 in 2024-02-05T07:16:43.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[41609]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:16:43.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:43.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:43.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:16:43.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:16:43.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:16:43.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:43.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:43.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:16:43.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:43 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:44.258 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:44 smithi188 ceph-mon[33283]: Detected new or changed devices on smithi188 2024-02-05T07:16:44.258 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:44 smithi188 ceph-mon[33283]: Adjusting osd_memory_target on smithi188 to 5696M 2024-02-05T07:16:44.258 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:44 smithi188 ceph-mon[33283]: osdmap e50: 7 total, 7 up, 7 in 2024-02-05T07:16:44.290 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.286+0000 7fc032fbf700 1 -- 172.21.15.188:0/3019340319 >> v1:172.21.15.188:6789/0 conn(0x7fc02c100a10 legacy=0x7fc02c100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:16:44.290 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.286+0000 7fc032fbf700 1 -- 172.21.15.188:0/3019340319 shutdown_connections 2024-02-05T07:16:44.290 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.286+0000 7fc032fbf700 1 -- 172.21.15.188:0/3019340319 >> 172.21.15.188:0/3019340319 conn(0x7fc02c0fbfb0 msgr2=0x7fc02c0fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:16:44.290 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.286+0000 7fc032fbf700 1 -- 172.21.15.188:0/3019340319 shutdown_connections 2024-02-05T07:16:44.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.286+0000 7fc032fbf700 1 -- 172.21.15.188:0/3019340319 wait complete. 2024-02-05T07:16:44.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc032fbf700 1 Processor -- start 2024-02-05T07:16:44.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc032fbf700 1 -- start start 2024-02-05T07:16:44.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc032fbf700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc02c199fc0 con 0x7fc02c108b80 2024-02-05T07:16:44.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc032fbf700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc02c1a5400 con 0x7fc02c100a10 2024-02-05T07:16:44.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc032fbf700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc02c1a65a0 con 0x7fc02c104e40 2024-02-05T07:16:44.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc030d5b700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fc02c100a10 0x7fc02c199400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:53526/0 (socket says 172.21.15.188:53526) 2024-02-05T07:16:44.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc030d5b700 1 -- 172.21.15.188:0/617688106 learned_addr learned my addr 172.21.15.188:0/617688106 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:16:44.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755669437 0 0) 0x7fc02c1a5400 con 0x7fc02c100a10 2024-02-05T07:16:44.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0180035b0 con 0x7fc02c100a10 2024-02-05T07:16:44.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400052249 0 0) 0x7fc02c199fc0 con 0x7fc02c108b80 2024-02-05T07:16:44.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc02c1a5400 con 0x7fc02c108b80 2024-02-05T07:16:44.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748057530 0 0) 0x7fc02c1a65a0 con 0x7fc02c104e40 2024-02-05T07:16:44.291 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc02c199fc0 con 0x7fc02c104e40 2024-02-05T07:16:44.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3194856091 0 0) 0x7fc0180035b0 con 0x7fc02c100a10 2024-02-05T07:16:44.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc02c1a65a0 con 0x7fc02c100a10 2024-02-05T07:16:44.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fc01c001c40 con 0x7fc02c100a10 2024-02-05T07:16:44.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1508091497 0 0) 0x7fc02c1a5400 con 0x7fc02c108b80 2024-02-05T07:16:44.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc0180035b0 con 0x7fc02c108b80 2024-02-05T07:16:44.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.287+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3422800498 0 0) 0x7fc02c1a65a0 con 0x7fc02c100a10 2024-02-05T07:16:44.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.288+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 >> v1:172.21.15.184:6790/0 conn(0x7fc02c104e40 legacy=0x7fc02c19f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:16:44.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.288+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 >> v1:172.21.15.184:6789/0 conn(0x7fc02c108b80 legacy=0x7fc02c1a2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:16:44.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.288+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc02c1a7740 con 0x7fc02c100a10 2024-02-05T07:16:44.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.288+0000 7fc032fbf700 1 -- 172.21.15.188:0/617688106 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc02c1a6730 con 0x7fc02c100a10 2024-02-05T07:16:44.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.288+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fc01c001f50 con 0x7fc02c100a10 2024-02-05T07:16:44.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.288+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fc01c005530 con 0x7fc02c100a10 2024-02-05T07:16:44.292 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.288+0000 7fc032fbf700 1 -- 172.21.15.188:0/617688106 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc02c1a6c30 con 0x7fc02c100a10 2024-02-05T07:16:44.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.289+0000 7fc032fbf700 1 -- 172.21.15.188:0/617688106 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc02c068610 con 0x7fc02c100a10 2024-02-05T07:16:44.293 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.289+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 15) v1 ==== 91372+0+0 (unknown 1941537730 0 0) 0x7fc01c005770 con 0x7fc02c100a10 2024-02-05T07:16:44.294 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.290+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(50..50 src has 1..50) v4 ==== 3789+0+0 (unknown 2410563027 0 0) 0x7fc01c0886c0 con 0x7fc02c100a10 2024-02-05T07:16:44.296 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.294+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fc01c0528b0 con 0x7fc02c100a10 2024-02-05T07:16:44.497 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:16:44.495+0000 7fc032fbf700 1 -- 172.21.15.188:0/617688106 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc02c069e20 con 0x7fc01806e6a0 2024-02-05T07:16:44.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:44 smithi184 ceph-mon[29861]: Detected new or changed devices on smithi188 2024-02-05T07:16:44.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:44 smithi184 ceph-mon[29861]: Adjusting osd_memory_target on smithi188 to 5696M 2024-02-05T07:16:44.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:44 smithi184 ceph-mon[29861]: osdmap e50: 7 total, 7 up, 7 in 2024-02-05T07:16:44.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:44 smithi184 ceph-mon[41609]: Detected new or changed devices on smithi188 2024-02-05T07:16:44.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:44 smithi184 ceph-mon[41609]: Adjusting osd_memory_target on smithi188 to 5696M 2024-02-05T07:16:44.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:44 smithi184 ceph-mon[41609]: osdmap e50: 7 total, 7 up, 7 in 2024-02-05T07:16:45.361 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:45 smithi188 ceph-mon[33283]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:16:45.361 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:45 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:16:45.361 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:45 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:16:45.361 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:45 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:45.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:45 smithi184 ceph-mon[29861]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:16:45.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:16:45.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:16:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:45 smithi184 ceph-mon[41609]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:16:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:45 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-05T07:16:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:45 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-05T07:16:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:45 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:46.367 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:46 smithi188 ceph-mon[33283]: from='client.24304 v1:172.21.15.188:0/617688106' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:16:46.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:46 smithi184 ceph-mon[29861]: from='client.24304 v1:172.21.15.188:0/617688106' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:16:46.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:46 smithi184 ceph-mon[41609]: from='client.24304 v1:172.21.15.188:0/617688106' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi188:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:16:47.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:47 smithi188 ceph-mon[33283]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-05T07:16:47.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:47 smithi184 ceph-mon[29861]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-05T07:16:47.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:47 smithi184 ceph-mon[41609]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-05T07:16:48.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:48 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.188:0/825757911' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c353d532-f620-43b7-95b9-df50228eef01"}]: dispatch 2024-02-05T07:16:48.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:48 smithi188 ceph-mon[33283]: from='client.24310 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c353d532-f620-43b7-95b9-df50228eef01"}]: dispatch 2024-02-05T07:16:48.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:48 smithi188 ceph-mon[33283]: from='client.24310 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c353d532-f620-43b7-95b9-df50228eef01"}]': finished 2024-02-05T07:16:48.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:48 smithi188 ceph-mon[33283]: osdmap e51: 8 total, 7 up, 8 in 2024-02-05T07:16:48.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:48 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:16:48.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:48 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.188:0/45183261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:16:48.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:48 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.188:0/825757911' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c353d532-f620-43b7-95b9-df50228eef01"}]: dispatch 2024-02-05T07:16:48.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:48 smithi184 ceph-mon[29861]: from='client.24310 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c353d532-f620-43b7-95b9-df50228eef01"}]: dispatch 2024-02-05T07:16:48.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:48 smithi184 ceph-mon[29861]: from='client.24310 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c353d532-f620-43b7-95b9-df50228eef01"}]': finished 2024-02-05T07:16:48.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:48 smithi184 ceph-mon[29861]: osdmap e51: 8 total, 7 up, 8 in 2024-02-05T07:16:48.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:48 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:16:48.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:48 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.188:0/45183261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:16:48.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:48 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.188:0/825757911' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c353d532-f620-43b7-95b9-df50228eef01"}]: dispatch 2024-02-05T07:16:48.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:48 smithi184 ceph-mon[41609]: from='client.24310 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c353d532-f620-43b7-95b9-df50228eef01"}]: dispatch 2024-02-05T07:16:48.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:48 smithi184 ceph-mon[41609]: from='client.24310 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c353d532-f620-43b7-95b9-df50228eef01"}]': finished 2024-02-05T07:16:48.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:48 smithi184 ceph-mon[41609]: osdmap e51: 8 total, 7 up, 8 in 2024-02-05T07:16:48.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:48 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:16:48.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:48 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.188:0/45183261' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-05T07:16:49.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:49 smithi188 ceph-mon[33283]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-05T07:16:49.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:49 smithi184 ceph-mon[29861]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-05T07:16:49.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:49 smithi184 ceph-mon[41609]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-05T07:16:51.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:51 smithi188 ceph-mon[33283]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-05T07:16:51.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:51 smithi184 ceph-mon[29861]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-05T07:16:51.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:51 smithi184 ceph-mon[41609]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-05T07:16:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:53 smithi188 ceph-mon[33283]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-02-05T07:16:53.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:53 smithi184 ceph-mon[29861]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-02-05T07:16:53.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:53 smithi184 ceph-mon[41609]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-02-05T07:16:54.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:54 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-05T07:16:54.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:54 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:54.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:54 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-05T07:16:54.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:54 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:54.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:54 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-05T07:16:54.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:54 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:16:55.294 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:55 smithi188 ceph-mon[33283]: Deploying daemon osd.7 on smithi188 2024-02-05T07:16:55.294 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:55 smithi188 ceph-mon[33283]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-05T07:16:55.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:55 smithi184 ceph-mon[29861]: Deploying daemon osd.7 on smithi188 2024-02-05T07:16:55.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:55 smithi184 ceph-mon[29861]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-05T07:16:55.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:55 smithi184 ceph-mon[41609]: Deploying daemon osd.7 on smithi188 2024-02-05T07:16:55.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:55 smithi184 ceph-mon[41609]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-05T07:16:57.428 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:57 smithi188 ceph-mon[33283]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:16:57.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:57 smithi184 ceph-mon[29861]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:16:57.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:57 smithi184 ceph-mon[41609]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:16:59.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:59 smithi188 ceph-mon[33283]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:16:59.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:59 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:59.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:59 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:59.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:16:59 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:16:59.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:59 smithi184 ceph-mon[29861]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:16:59.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:59 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:59.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:59 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:59.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:16:59 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:16:59.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:59 smithi184 ceph-mon[41609]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:16:59.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:59 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:59.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:59 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:16:59.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:16:59 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:01 smithi188 ceph-mon[33283]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:17:01.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:01 smithi184 ceph-mon[29861]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:17:01.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:01 smithi184 ceph-mon[41609]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:17:02.810 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:02.808+0000 7fc029ffb700 1 -- 172.21.15.188:0/617688106 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 2064656899) 0x7fc02c069e20 con 0x7fc01806e6a0 2024-02-05T07:17:02.810 INFO:teuthology.orchestra.run.smithi188.stdout:Created osd(s) 7 on host 'smithi188' 2024-02-05T07:17:02.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:02.810+0000 7fc032fbf700 1 -- 172.21.15.188:0/617688106 >> v1:172.21.15.184:6800/2865218501 conn(0x7fc01806e6a0 legacy=0x7fc018070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:02.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:02.810+0000 7fc032fbf700 1 -- 172.21.15.188:0/617688106 >> v1:172.21.15.188:6789/0 conn(0x7fc02c100a10 legacy=0x7fc02c199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:02.812 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:02.810+0000 7fc032fbf700 1 -- 172.21.15.188:0/617688106 shutdown_connections 2024-02-05T07:17:02.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:02.810+0000 7fc032fbf700 1 -- 172.21.15.188:0/617688106 >> 172.21.15.188:0/617688106 conn(0x7fc02c0fbfb0 msgr2=0x7fc02c069710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:02.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:02.810+0000 7fc032fbf700 1 -- 172.21.15.188:0/617688106 shutdown_connections 2024-02-05T07:17:02.813 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:02.810+0000 7fc032fbf700 1 -- 172.21.15.188:0/617688106 wait complete. 2024-02-05T07:17:03.110 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:03.110 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:03.110 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:02 smithi188 ceph-mon[33283]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:17:03.110 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:02 smithi188 ceph-mon[33283]: from='osd.7 v1:172.21.15.188:6812/949787136' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-05T07:17:03.110 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:02 smithi188 ceph-mon[33283]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-05T07:17:03.110 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:03.110 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:17:03.110 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:03.110 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:03.111 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:03.111 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:02 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:03.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[29861]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:17:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[29861]: from='osd.7 v1:172.21.15.188:6812/949787136' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-05T07:17:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[29861]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-05T07:17:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:17:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:03.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[41609]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:17:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[41609]: from='osd.7 v1:172.21.15.188:6812/949787136' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-05T07:17:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[41609]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-05T07:17:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:17:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:02 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:03.430 DEBUG:teuthology.orchestra.run.smithi188:osd.7> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.7.service 2024-02-05T07:17:03.433 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-02-05T07:17:03.433 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph osd stat -f json 2024-02-05T07:17:03.686 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:17:04.054 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:03 smithi184 ceph-mon[29861]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-05T07:17:04.055 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:03 smithi184 ceph-mon[29861]: osdmap e52: 8 total, 7 up, 8 in 2024-02-05T07:17:04.055 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:03 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:04.055 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:03 smithi184 ceph-mon[29861]: from='osd.7 v1:172.21.15.188:6812/949787136' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:17:04.055 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:03 smithi184 ceph-mon[29861]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:17:04.055 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:03 smithi184 ceph-mon[41609]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-05T07:17:04.055 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:03 smithi184 ceph-mon[41609]: osdmap e52: 8 total, 7 up, 8 in 2024-02-05T07:17:04.055 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:03 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:04.055 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:03 smithi184 ceph-mon[41609]: from='osd.7 v1:172.21.15.188:6812/949787136' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:17:04.055 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:03 smithi184 ceph-mon[41609]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:17:04.242 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:03 smithi188 ceph-mon[33283]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-05T07:17:04.242 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:03 smithi188 ceph-mon[33283]: osdmap e52: 8 total, 7 up, 8 in 2024-02-05T07:17:04.242 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:03 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:04.242 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:03 smithi188 ceph-mon[33283]: from='osd.7 v1:172.21.15.188:6812/949787136' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:17:04.242 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:03 smithi188 ceph-mon[33283]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]: dispatch 2024-02-05T07:17:04.499 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:17:04 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:17:04.333+0000 7f4d6e54f700 -1 osd.7 0 waiting for initial osdmap 2024-02-05T07:17:04.499 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:17:04 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:17:04.340+0000 7f4d66341700 -1 osd.7 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-05T07:17:05.105 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[29861]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-02-05T07:17:05.105 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[29861]: osdmap e53: 8 total, 7 up, 8 in 2024-02-05T07:17:05.105 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:05.105 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:05.106 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[29861]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:17:05.106 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[29861]: osdmap e54: 8 total, 7 up, 8 in 2024-02-05T07:17:05.106 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:05.106 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[29861]: from='osd.7 ' entity='osd.7' 2024-02-05T07:17:05.106 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[41609]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-02-05T07:17:05.106 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[41609]: osdmap e53: 8 total, 7 up, 8 in 2024-02-05T07:17:05.106 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:05.106 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:05.106 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[41609]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:17:05.106 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[41609]: osdmap e54: 8 total, 7 up, 8 in 2024-02-05T07:17:05.106 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:05.106 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:04 smithi184 ceph-mon[41609]: from='osd.7 ' entity='osd.7' 2024-02-05T07:17:05.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:04 smithi188 ceph-mon[33283]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi188", "root=default"]}]': finished 2024-02-05T07:17:05.204 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:04 smithi188 ceph-mon[33283]: osdmap e53: 8 total, 7 up, 8 in 2024-02-05T07:17:05.205 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:04 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:05.205 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:04 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:05.205 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:04 smithi188 ceph-mon[33283]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2024-02-05T07:17:05.205 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:04 smithi188 ceph-mon[33283]: osdmap e54: 8 total, 7 up, 8 in 2024-02-05T07:17:05.205 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:04 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:05.205 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:04 smithi188 ceph-mon[33283]: from='osd.7 ' entity='osd.7' 2024-02-05T07:17:05.346 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.341+0000 7f15507be700 1 -- 172.21.15.184:0/2882110188 >> v1:172.21.15.184:6789/0 conn(0x7f15480ffde0 legacy=0x7f1548100200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:05.346 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.341+0000 7f15507be700 1 -- 172.21.15.184:0/2882110188 shutdown_connections 2024-02-05T07:17:05.346 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.341+0000 7f15507be700 1 -- 172.21.15.184:0/2882110188 >> 172.21.15.184:0/2882110188 conn(0x7f15480fb740 msgr2=0x7f15480fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:05.346 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.341+0000 7f15507be700 1 -- 172.21.15.184:0/2882110188 shutdown_connections 2024-02-05T07:17:05.346 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.341+0000 7f15507be700 1 -- 172.21.15.184:0/2882110188 wait complete. 2024-02-05T07:17:05.347 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f15507be700 1 Processor -- start 2024-02-05T07:17:05.347 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f15507be700 1 -- start start 2024-02-05T07:17:05.347 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f15507be700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f1548109160 con 0x7f1548105ff0 2024-02-05T07:17:05.347 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f15507be700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f15481a5190 con 0x7f1548109c50 2024-02-05T07:17:05.347 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f15507be700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f15481a6330 con 0x7f15480ffde0 2024-02-05T07:17:05.347 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f154e55a700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f15480ffde0 0x7f15481086d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:59032/0 (socket says 172.21.15.184:59032) 2024-02-05T07:17:05.347 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f154e55a700 1 -- 172.21.15.184:0/1870990749 learned_addr learned my addr 172.21.15.184:0/1870990749 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:17:05.347 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1709373821 0 0) 0x7f1548109160 con 0x7f1548105ff0 2024-02-05T07:17:05.347 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15340035b0 con 0x7f1548105ff0 2024-02-05T07:17:05.347 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424184739 0 0) 0x7f15481a6330 con 0x7f15480ffde0 2024-02-05T07:17:05.347 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1548109160 con 0x7f15480ffde0 2024-02-05T07:17:05.347 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184908008 0 0) 0x7f15481a5190 con 0x7f1548109c50 2024-02-05T07:17:05.347 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15481a6330 con 0x7f1548109c50 2024-02-05T07:17:05.348 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1091673261 0 0) 0x7f15340035b0 con 0x7f1548105ff0 2024-02-05T07:17:05.348 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f15481a5190 con 0x7f1548105ff0 2024-02-05T07:17:05.348 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f15440019f0 con 0x7f1548105ff0 2024-02-05T07:17:05.348 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1736792361 0 0) 0x7f1548109160 con 0x7f15480ffde0 2024-02-05T07:17:05.348 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f15340035b0 con 0x7f15480ffde0 2024-02-05T07:17:05.348 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3010334677 0 0) 0x7f15481a6330 con 0x7f1548109c50 2024-02-05T07:17:05.348 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.342+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f1548109160 con 0x7f1548109c50 2024-02-05T07:17:05.348 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.343+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f15380043a0 con 0x7f15480ffde0 2024-02-05T07:17:05.348 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.343+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f1540001b30 con 0x7f1548109c50 2024-02-05T07:17:05.348 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.343+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1307340879 0 0) 0x7f15481a5190 con 0x7f1548105ff0 2024-02-05T07:17:05.348 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.343+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 >> v1:172.21.15.184:6790/0 conn(0x7f15480ffde0 legacy=0x7f15481086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:05.348 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.343+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 >> v1:172.21.15.188:6789/0 conn(0x7f1548109c50 legacy=0x7f15481a2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:05.348 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.343+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15481a74d0 con 0x7f1548105ff0 2024-02-05T07:17:05.348 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.343+0000 7f15507be700 1 -- 172.21.15.184:0/1870990749 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15481a41e0 con 0x7f1548105ff0 2024-02-05T07:17:05.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.343+0000 7f15507be700 1 -- 172.21.15.184:0/1870990749 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f15481a46e0 con 0x7f1548105ff0 2024-02-05T07:17:05.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.343+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f1544003b10 con 0x7f1548105ff0 2024-02-05T07:17:05.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.343+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f15440049a0 con 0x7f1548105ff0 2024-02-05T07:17:05.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.344+0000 7f15507be700 1 -- 172.21.15.184:0/1870990749 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152c005150 con 0x7f1548105ff0 2024-02-05T07:17:05.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.344+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 15) v1 ==== 91372+0+0 (unknown 1941537730 0 0) 0x7f1544003680 con 0x7f1548105ff0 2024-02-05T07:17:05.349 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.345+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(55..55 src has 1..55) v4 ==== 4114+0+0 (unknown 1585052426 0 0) 0x7f1544086cd0 con 0x7f1548105ff0 2024-02-05T07:17:05.351 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.349+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f1544050c70 con 0x7f1548105ff0 2024-02-05T07:17:05.547 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.545+0000 7f15507be700 1 -- 172.21.15.184:0/1870990749 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f152c005400 con 0x7f1548105ff0 2024-02-05T07:17:05.547 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.545+0000 7f153f7fe700 1 -- 172.21.15.184:0/1870990749 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v55) v1 ==== 74+0+130 (unknown 171817225 0 2908971889) 0x7f1544052ba0 con 0x7f1548105ff0 2024-02-05T07:17:05.547 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:17:05.549 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.547+0000 7f15507be700 1 -- 172.21.15.184:0/1870990749 >> v1:172.21.15.184:6800/2865218501 conn(0x7f153406ec10 legacy=0x7f15340710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:05.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.547+0000 7f15507be700 1 -- 172.21.15.184:0/1870990749 >> v1:172.21.15.184:6789/0 conn(0x7f1548105ff0 legacy=0x7f154819f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:05.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.547+0000 7f15507be700 1 -- 172.21.15.184:0/1870990749 shutdown_connections 2024-02-05T07:17:05.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.547+0000 7f15507be700 1 -- 172.21.15.184:0/1870990749 >> 172.21.15.184:0/1870990749 conn(0x7f15480fb740 msgr2=0x7f15481040b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:05.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.547+0000 7f15507be700 1 -- 172.21.15.184:0/1870990749 shutdown_connections 2024-02-05T07:17:05.550 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:05.548+0000 7f15507be700 1 -- 172.21.15.184:0/1870990749 wait complete. 2024-02-05T07:17:05.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:05 smithi188 ceph-mon[33283]: purged_snaps scrub starts 2024-02-05T07:17:05.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:05 smithi188 ceph-mon[33283]: purged_snaps scrub ok 2024-02-05T07:17:05.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:05 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:05.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:05 smithi188 ceph-mon[33283]: osd.7 v1:172.21.15.188:6812/949787136 boot 2024-02-05T07:17:05.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:05 smithi188 ceph-mon[33283]: osdmap e55: 8 total, 8 up, 8 in 2024-02-05T07:17:05.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:05 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:05.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1870990749' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-05T07:17:06.125 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:05 smithi184 ceph-mon[29861]: purged_snaps scrub starts 2024-02-05T07:17:06.126 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:05 smithi184 ceph-mon[29861]: purged_snaps scrub ok 2024-02-05T07:17:06.126 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:05 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:06.126 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:05 smithi184 ceph-mon[29861]: osd.7 v1:172.21.15.188:6812/949787136 boot 2024-02-05T07:17:06.126 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:05 smithi184 ceph-mon[29861]: osdmap e55: 8 total, 8 up, 8 in 2024-02-05T07:17:06.126 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:05 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:06.126 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1870990749' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-05T07:17:06.126 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:05 smithi184 ceph-mon[41609]: purged_snaps scrub starts 2024-02-05T07:17:06.126 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:05 smithi184 ceph-mon[41609]: purged_snaps scrub ok 2024-02-05T07:17:06.127 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:05 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:06.127 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:05 smithi184 ceph-mon[41609]: osd.7 v1:172.21.15.188:6812/949787136 boot 2024-02-05T07:17:06.127 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:05 smithi184 ceph-mon[41609]: osdmap e55: 8 total, 8 up, 8 in 2024-02-05T07:17:06.127 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:05 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:06.127 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1870990749' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-05T07:17:06.127 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":55,"num_osds":8,"num_up_osds":8,"osd_up_since":1707117425,"num_in_osds":8,"osd_in_since":1707117407,"num_remapped_pgs":1} 2024-02-05T07:17:06.128 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph osd dump --format=json 2024-02-05T07:17:06.367 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:17:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:06 smithi188 ceph-mon[33283]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:17:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:06 smithi188 ceph-mon[33283]: osdmap e56: 8 total, 8 up, 8 in 2024-02-05T07:17:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:06 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:06 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:06 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:17:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:06 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:17:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:06 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:17:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:06 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:17:07.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:06 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:07.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:06 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:07.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:06 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:17:07.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:06 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:07.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[29861]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:17:07.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[29861]: osdmap e56: 8 total, 8 up, 8 in 2024-02-05T07:17:07.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:17:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:17:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:17:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:17:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:17:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:07.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[41609]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:17:07.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[41609]: osdmap e56: 8 total, 8 up, 8 in 2024-02-05T07:17:07.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:07.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:07.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:17:07.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:17:07.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:17:07.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:17:07.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:07.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:07.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:17:07.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:06 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:08.114 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:07 smithi184 ceph-mon[29861]: Detected new or changed devices on smithi188 2024-02-05T07:17:08.115 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:07 smithi184 ceph-mon[29861]: Adjusting osd_memory_target on smithi188 to 4272M 2024-02-05T07:17:08.115 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:07 smithi184 ceph-mon[29861]: osdmap e57: 8 total, 8 up, 8 in 2024-02-05T07:17:08.115 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:07 smithi184 ceph-mon[41609]: Detected new or changed devices on smithi188 2024-02-05T07:17:08.115 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:07 smithi184 ceph-mon[41609]: Adjusting osd_memory_target on smithi188 to 4272M 2024-02-05T07:17:08.115 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:07 smithi184 ceph-mon[41609]: osdmap e57: 8 total, 8 up, 8 in 2024-02-05T07:17:08.118 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.104+0000 7f0c0c502700 1 -- 172.21.15.184:0/2924272654 >> v1:172.21.15.184:6790/0 conn(0x7f0c0410d440 legacy=0x7f0c0410f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:08.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.104+0000 7f0c0c502700 1 -- 172.21.15.184:0/2924272654 shutdown_connections 2024-02-05T07:17:08.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.104+0000 7f0c0c502700 1 -- 172.21.15.184:0/2924272654 >> 172.21.15.184:0/2924272654 conn(0x7f0c040fc4d0 msgr2=0x7f0c040fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:08.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.104+0000 7f0c0c502700 1 -- 172.21.15.184:0/2924272654 shutdown_connections 2024-02-05T07:17:08.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.104+0000 7f0c0c502700 1 -- 172.21.15.184:0/2924272654 wait complete. 2024-02-05T07:17:08.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0c0c502700 1 Processor -- start 2024-02-05T07:17:08.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0c0c502700 1 -- start start 2024-02-05T07:17:08.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0c0c502700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0c041a58e0 con 0x7f0c041069c0 2024-02-05T07:17:08.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0c0c502700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0c041a6ac0 con 0x7f0c04109870 2024-02-05T07:17:08.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0c0c502700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0c041a7cc0 con 0x7f0c0410d440 2024-02-05T07:17:08.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0c0aa9f700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f0c0410d440 0x7f0c041a3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:36332/0 (socket says 172.21.15.184:36332) 2024-02-05T07:17:08.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0c0a29e700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f0c041069c0 0x7f0c0410cb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:53474/0 (socket says 172.21.15.184:53474) 2024-02-05T07:17:08.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0c0aa9f700 1 -- 172.21.15.184:0/163703790 learned_addr learned my addr 172.21.15.184:0/163703790 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:17:08.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 665301964 0 0) 0x7f0c041a58e0 con 0x7f0c041069c0 2024-02-05T07:17:08.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bf00035b0 con 0x7f0c041069c0 2024-02-05T07:17:08.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281831270 0 0) 0x7f0c041a7cc0 con 0x7f0c0410d440 2024-02-05T07:17:08.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c041a58e0 con 0x7f0c0410d440 2024-02-05T07:17:08.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1608834051 0 0) 0x7f0c041a6ac0 con 0x7f0c04109870 2024-02-05T07:17:08.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c041a7cc0 con 0x7f0c04109870 2024-02-05T07:17:08.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2394434308 0 0) 0x7f0bf00035b0 con 0x7f0c041069c0 2024-02-05T07:17:08.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0c041a6ac0 con 0x7f0c041069c0 2024-02-05T07:17:08.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.105+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3098868446 0 0) 0x7f0c041a58e0 con 0x7f0c0410d440 2024-02-05T07:17:08.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.106+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0bf00035b0 con 0x7f0c0410d440 2024-02-05T07:17:08.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.106+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f0bf4001850 con 0x7f0c041069c0 2024-02-05T07:17:08.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.106+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f0bfc0047b0 con 0x7f0c0410d440 2024-02-05T07:17:08.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.106+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3477127502 0 0) 0x7f0c041a7cc0 con 0x7f0c04109870 2024-02-05T07:17:08.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.106+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0c041a58e0 con 0x7f0c04109870 2024-02-05T07:17:08.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.106+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f0c000017b0 con 0x7f0c04109870 2024-02-05T07:17:08.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.106+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2616980164 0 0) 0x7f0c041a6ac0 con 0x7f0c041069c0 2024-02-05T07:17:08.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.106+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 >> v1:172.21.15.184:6790/0 conn(0x7f0c0410d440 legacy=0x7f0c041a3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:08.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.106+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 >> v1:172.21.15.188:6789/0 conn(0x7f0c04109870 legacy=0x7f0c041a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:08.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.106+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c041a8ec0 con 0x7f0c041069c0 2024-02-05T07:17:08.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.106+0000 7f0c0c502700 1 -- 172.21.15.184:0/163703790 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c041a7eb0 con 0x7f0c041069c0 2024-02-05T07:17:08.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.106+0000 7f0c0c502700 1 -- 172.21.15.184:0/163703790 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c041a8330 con 0x7f0c041069c0 2024-02-05T07:17:08.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.106+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f0bf4001d70 con 0x7f0c041069c0 2024-02-05T07:17:08.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.106+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f0bf4005b10 con 0x7f0c041069c0 2024-02-05T07:17:08.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.107+0000 7f0c0c502700 1 -- 172.21.15.184:0/163703790 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be8005120 con 0x7f0c041069c0 2024-02-05T07:17:08.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.107+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 15) v1 ==== 91372+0+0 (unknown 1941537730 0 0) 0x7f0bf4003680 con 0x7f0c041069c0 2024-02-05T07:17:08.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.108+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(57..57 src has 1..57) v4 ==== 4110+0+0 (unknown 1275851797 0 0) 0x7f0bf4087d70 con 0x7f0c041069c0 2024-02-05T07:17:08.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.112+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f0bf4051af0 con 0x7f0c041069c0 2024-02-05T07:17:08.155 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:07 smithi188 ceph-mon[33283]: Detected new or changed devices on smithi188 2024-02-05T07:17:08.155 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:07 smithi188 ceph-mon[33283]: Adjusting osd_memory_target on smithi188 to 4272M 2024-02-05T07:17:08.155 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:07 smithi188 ceph-mon[33283]: osdmap e57: 8 total, 8 up, 8 in 2024-02-05T07:17:08.309 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.307+0000 7f0c0c502700 1 -- 172.21.15.184:0/163703790 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0be80053d0 con 0x7f0c041069c0 2024-02-05T07:17:08.310 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.308+0000 7f0bfb7fe700 1 -- 172.21.15.184:0/163703790 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+11526 (unknown 2626357731 0 456759815) 0x7f0bf4053bf0 con 0x7f0c041069c0 2024-02-05T07:17:08.310 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:17:08.310 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":58,"fsid":"ae38c7f2-c3f5-11ee-95b6-87774f69a715","created":"2024-02-05T07:11:44.147297+0000","modified":"2024-02-05T07:17:08.280309+0000","last_up_change":"2024-02-05T07:17:05.272039+0000","last_in_change":"2024-02-05T07:16:47.187382+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-05T07:14:58.475517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55bd1041-d85f-429b-842b-f0ad482a2b35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6801","nonce":2828935930}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6802","nonce":2828935930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6804","nonce":2828935930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6803","nonce":2828935930}]},"public_addr":"172.21.15.184:6801/2828935930","cluster_addr":"172.21.15.184:6802/2828935930","heartbeat_back_addr":"172.21.15.184:6804/2828935930","heartbeat_front_addr":"172.21.15.184:6803/2828935930","state":["exists","up"]},{"osd":1,"uuid":"6f44c46f-e055-4522-a4bc-452f92e923af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6805","nonce":1083118002}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6806","nonce":1083118002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6808","nonce":1083118002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6807","nonce":1083118002}]},"public_addr":"172.21.15.184:6805/1083118002","cluster_addr":"172.21.15.184:6806/1083118002","heartbeat_back_addr":"172.21.15.184:6808/1083118002","heartbeat_front_addr":"172.21.15.184:6807/1083118002","state":["exists","up"]},{"osd":2,"uuid":"16e61e10-2c70-4ae2-ac6f-871d6d08a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6809","nonce":2153385925}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6810","nonce":2153385925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6812","nonce":2153385925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6811","nonce":2153385925}]},"public_addr":"172.21.15.184:6809/2153385925","cluster_addr":"172.21.15.184:6810/2153385925","heartbeat_back_addr":"172.21.15.184:6812/2153385925","heartbeat_front_addr":"172.21.15.184:6811/2153385925","state":["exists","up"]},{"osd":3,"uuid":"bbd6c528-127a-4a3e-9d2c-7da677ba4d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6813","nonce":2068331347}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6814","nonce":2068331347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6816","nonce":2068331347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6815","nonce":2068331347}]},"public_addr":"172.21.15.184:6813/2068331347","cluster_addr":"172.21.15.184:6814/2068331347","heartbeat_back_addr":"172.21.15.184:6816/2068331347","heartbeat_front_addr":"172.21.15.184:6815/2068331347","state":["exists","up"]},{"osd":4,"uuid":"a6d7e5ec-413d-445b-ab87-a6c924832a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6800","nonce":3630742885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6801","nonce":3630742885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6803","nonce":3630742885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6802","nonce":3630742885}]},"public_addr":"172.21.15.188:6800/3630742885","cluster_addr":"172.21.15.188:6801/3630742885","heartbeat_back_addr":"172.21.15.188:6803/3630742885","heartbeat_front_addr":"172.21.15.188:6802/3630742885","state":["exists","up"]},{"osd":5,"uuid":"dcc242b3-3f4a-4f09-83f3-5d8e6afb8a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6804","nonce":52728079}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6805","nonce":52728079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6807","nonce":52728079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6806","nonce":52728079}]},"public_addr":"172.21.15.188:6804/52728079","cluster_addr":"172.21.15.188:6805/52728079","heartbeat_back_addr":"172.21.15.188:6807/52728079","heartbeat_front_addr":"172.21.15.188:6806/52728079","state":["exists","up"]},{"osd":6,"uuid":"a53c7687-7dd7-4cf9-9a1c-5644b6474991","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6808","nonce":2094972647}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6809","nonce":2094972647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6811","nonce":2094972647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6810","nonce":2094972647}]},"public_addr":"172.21.15.188:6808/2094972647","cluster_addr":"172.21.15.188:6809/2094972647","heartbeat_back_addr":"172.21.15.188:6811/2094972647","heartbeat_front_addr":"172.21.15.188:6810/2094972647","state":["exists","up"]},{"osd":7,"uuid":"c353d532-f620-43b7-95b9-df50228eef01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6812","nonce":949787136}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6813","nonce":949787136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6815","nonce":949787136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6814","nonce":949787136}]},"public_addr":"172.21.15.188:6812/949787136","cluster_addr":"172.21.15.188:6813/949787136","heartbeat_back_addr":"172.21.15.188:6815/949787136","heartbeat_front_addr":"172.21.15.188:6814/949787136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:14:04.725385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:14:30.353209+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:14:56.068658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:15:21.668821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:15:45.127188+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:16:11.789995+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:16:37.456483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:17:03.186929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6800/2693451489":"2024-02-06T07:12:44.148742+0000","172.21.15.184:0/2200977126":"2024-02-06T07:12:44.148742+0000","172.21.15.184:0/2330160689":"2024-02-06T07:12:16.981827+0000","172.21.15.184:6800/668972809":"2024-02-06T07:12:16.981827+0000","172.21.15.184:0/884148618":"2024-02-06T07:12:16.981827+0000","172.21.15.184:0/221157509":"2024-02-06T07:12:44.148742+0000","172.21.15.184:0/1076320344":"2024-02-06T07:12:16.981827+0000","172.21.15.184:0/2023523197":"2024-02-06T07:12:44.148742+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-05T07:17:08.312 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.310+0000 7f0c0c502700 1 -- 172.21.15.184:0/163703790 >> v1:172.21.15.184:6800/2865218501 conn(0x7f0bf006ec40 legacy=0x7f0bf0071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:08.312 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.310+0000 7f0c0c502700 1 -- 172.21.15.184:0/163703790 >> v1:172.21.15.184:6789/0 conn(0x7f0c041069c0 legacy=0x7f0c0410cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:08.312 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.310+0000 7f0c0c502700 1 -- 172.21.15.184:0/163703790 shutdown_connections 2024-02-05T07:17:08.312 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.310+0000 7f0c0c502700 1 -- 172.21.15.184:0/163703790 >> 172.21.15.184:0/163703790 conn(0x7f0c040fc4d0 msgr2=0x7f0c040fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:08.312 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.310+0000 7f0c0c502700 1 -- 172.21.15.184:0/163703790 shutdown_connections 2024-02-05T07:17:08.313 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:08.310+0000 7f0c0c502700 1 -- 172.21.15.184:0/163703790 wait complete. 2024-02-05T07:17:09.024 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:08 smithi184 ceph-mon[29861]: pgmap v179: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-05T07:17:09.024 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:08 smithi184 ceph-mon[29861]: osdmap e58: 8 total, 8 up, 8 in 2024-02-05T07:17:09.024 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/163703790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-05T07:17:09.025 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:08 smithi184 ceph-mon[41609]: pgmap v179: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-05T07:17:09.025 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:08 smithi184 ceph-mon[41609]: osdmap e58: 8 total, 8 up, 8 in 2024-02-05T07:17:09.025 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/163703790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-05T07:17:09.029 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-05T07:14:58.475517+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-05T07:17:09.029 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-02-05T07:17:09.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:08 smithi188 ceph-mon[33283]: pgmap v179: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-05T07:17:09.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:08 smithi188 ceph-mon[33283]: osdmap e58: 8 total, 8 up, 8 in 2024-02-05T07:17:09.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/163703790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-05T07:17:09.281 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:17:10.481 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:10 smithi184 ceph-mon[29861]: osdmap e59: 8 total, 8 up, 8 in 2024-02-05T07:17:10.481 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:10 smithi184 ceph-mon[29861]: pgmap v182: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-05T07:17:10.481 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:10 smithi184 ceph-mon[41609]: osdmap e59: 8 total, 8 up, 8 in 2024-02-05T07:17:10.482 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:10 smithi184 ceph-mon[41609]: pgmap v182: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-05T07:17:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:10 smithi188 ceph-mon[33283]: osdmap e59: 8 total, 8 up, 8 in 2024-02-05T07:17:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:10 smithi188 ceph-mon[33283]: pgmap v182: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-05T07:17:11.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.010+0000 7f6acb7b3700 1 -- 172.21.15.184:0/1664674186 >> v1:172.21.15.184:6789/0 conn(0x7f6ac410aa90 legacy=0x7f6ac410ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:11.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.010+0000 7f6acb7b3700 1 -- 172.21.15.184:0/1664674186 shutdown_connections 2024-02-05T07:17:11.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.010+0000 7f6acb7b3700 1 -- 172.21.15.184:0/1664674186 >> 172.21.15.184:0/1664674186 conn(0x7f6ac40fc4b0 msgr2=0x7f6ac40fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:11.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.011+0000 7f6acb7b3700 1 -- 172.21.15.184:0/1664674186 shutdown_connections 2024-02-05T07:17:11.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.011+0000 7f6acb7b3700 1 -- 172.21.15.184:0/1664674186 wait complete. 2024-02-05T07:17:11.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.011+0000 7f6acb7b3700 1 Processor -- start 2024-02-05T07:17:11.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.011+0000 7f6acb7b3700 1 -- start start 2024-02-05T07:17:11.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.011+0000 7f6acb7b3700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6ac41a8b90 con 0x7f6ac410e5a0 2024-02-05T07:17:11.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.011+0000 7f6acb7b3700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6ac41a9d70 con 0x7f6ac410aa90 2024-02-05T07:17:11.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.011+0000 7f6acb7b3700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6ac41aaf70 con 0x7f6ac4102c80 2024-02-05T07:17:11.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.011+0000 7f6ac954f700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f6ac4102c80 0x7f6ac410a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:36350/0 (socket says 172.21.15.184:36350) 2024-02-05T07:17:11.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.011+0000 7f6ac954f700 1 -- 172.21.15.184:0/1734802202 learned_addr learned my addr 172.21.15.184:0/1734802202 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:17:11.016 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3114214180 0 0) 0x7f6ac41aaf70 con 0x7f6ac4102c80 2024-02-05T07:17:11.016 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab00035b0 con 0x7f6ac4102c80 2024-02-05T07:17:11.016 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2029953209 0 0) 0x7f6ac41a8b90 con 0x7f6ac410e5a0 2024-02-05T07:17:11.016 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac41aaf70 con 0x7f6ac410e5a0 2024-02-05T07:17:11.016 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920063826 0 0) 0x7f6ac41a9d70 con 0x7f6ac410aa90 2024-02-05T07:17:11.016 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac41a8b90 con 0x7f6ac410aa90 2024-02-05T07:17:11.017 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 67385970 0 0) 0x7f6ab00035b0 con 0x7f6ac4102c80 2024-02-05T07:17:11.017 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6ac41a9d70 con 0x7f6ac4102c80 2024-02-05T07:17:11.017 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6ac0001970 con 0x7f6ac4102c80 2024-02-05T07:17:11.017 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 453432783 0 0) 0x7f6ac41aaf70 con 0x7f6ac410e5a0 2024-02-05T07:17:11.017 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6ab00035b0 con 0x7f6ac410e5a0 2024-02-05T07:17:11.017 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6abc001b70 con 0x7f6ac410e5a0 2024-02-05T07:17:11.017 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3641496645 0 0) 0x7f6ac41a8b90 con 0x7f6ac410aa90 2024-02-05T07:17:11.017 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6ac41aaf70 con 0x7f6ac410aa90 2024-02-05T07:17:11.017 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6ab4004430 con 0x7f6ac410aa90 2024-02-05T07:17:11.017 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3129412048 0 0) 0x7f6ac41a9d70 con 0x7f6ac4102c80 2024-02-05T07:17:11.017 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 >> v1:172.21.15.188:6789/0 conn(0x7f6ac410aa90 legacy=0x7f6ac41a3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:11.017 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 >> v1:172.21.15.184:6789/0 conn(0x7f6ac410e5a0 legacy=0x7f6ac41a73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:11.018 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac41ac170 con 0x7f6ac4102c80 2024-02-05T07:17:11.018 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6acb7b3700 1 -- 172.21.15.184:0/1734802202 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac41a8d80 con 0x7f6ac4102c80 2024-02-05T07:17:11.018 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6acb7b3700 1 -- 172.21.15.184:0/1734802202 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac41a9200 con 0x7f6ac4102c80 2024-02-05T07:17:11.018 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f6ac0001c40 con 0x7f6ac4102c80 2024-02-05T07:17:11.018 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.012+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6ac0005c60 con 0x7f6ac4102c80 2024-02-05T07:17:11.018 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.013+0000 7f6acb7b3700 1 -- 172.21.15.184:0/1734802202 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa8005120 con 0x7f6ac4102c80 2024-02-05T07:17:11.018 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.014+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 15) v1 ==== 91372+0+0 (unknown 1941537730 0 0) 0x7f6ac001c2c0 con 0x7f6ac4102c80 2024-02-05T07:17:11.018 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.014+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(59..59 src has 1..59) v4 ==== 4081+0+0 (unknown 4172090614 0 0) 0x7f6ac0087f90 con 0x7f6ac4102c80 2024-02-05T07:17:11.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.019+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f6ac0051f50 con 0x7f6ac4102c80 2024-02-05T07:17:11.214 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.212+0000 7f6acb7b3700 1 -- 172.21.15.184:0/1734802202 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6aa8005950 con 0x7f6ac4102c80 2024-02-05T07:17:11.214 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.212+0000 7f6aba7fc700 1 -- 172.21.15.184:0/1734802202 <== mon.2 v1:172.21.15.184:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (unknown 4013917427 0 2170607528) 0x7f6ac0053e80 con 0x7f6ac4102c80 2024-02-05T07:17:11.215 INFO:teuthology.orchestra.run.smithi184.stdout:pg_num: 1 2024-02-05T07:17:11.216 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.214+0000 7f6acb7b3700 1 -- 172.21.15.184:0/1734802202 >> v1:172.21.15.184:6800/2865218501 conn(0x7f6ab006ea10 legacy=0x7f6ab0070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:11.216 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.214+0000 7f6acb7b3700 1 -- 172.21.15.184:0/1734802202 >> v1:172.21.15.184:6790/0 conn(0x7f6ac4102c80 legacy=0x7f6ac410a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:11.217 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.214+0000 7f6acb7b3700 1 -- 172.21.15.184:0/1734802202 shutdown_connections 2024-02-05T07:17:11.217 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.214+0000 7f6acb7b3700 1 -- 172.21.15.184:0/1734802202 >> 172.21.15.184:0/1734802202 conn(0x7f6ac40fc4b0 msgr2=0x7f6ac40fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:11.217 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.214+0000 7f6acb7b3700 1 -- 172.21.15.184:0/1734802202 shutdown_connections 2024-02-05T07:17:11.217 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:11.215+0000 7f6acb7b3700 1 -- 172.21.15.184:0/1734802202 wait complete. 2024-02-05T07:17:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1734802202' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-05T07:17:11.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1734802202' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-05T07:17:11.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1734802202' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-05T07:17:11.993 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi184 2024-02-05T07:17:11.993 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch apply rgw foo.a --placement '1;smithi184=foo.a' 2024-02-05T07:17:12.244 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:17:12.644 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:12 smithi188 ceph-mon[33283]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-02-05T07:17:12.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:12 smithi184 ceph-mon[29861]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-02-05T07:17:12.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:12 smithi184 ceph-mon[41609]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 97 KiB/s, 0 objects/s recovering 2024-02-05T07:17:13.782 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.779+0000 7f6d35590700 1 -- 172.21.15.188:0/540216062 >> v1:172.21.15.188:6789/0 conn(0x7f6d30109c80 legacy=0x7f6d3010c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:13.782 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.779+0000 7f6d35590700 1 -- 172.21.15.188:0/540216062 shutdown_connections 2024-02-05T07:17:13.782 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.779+0000 7f6d35590700 1 -- 172.21.15.188:0/540216062 >> 172.21.15.188:0/540216062 conn(0x7f6d300fd090 msgr2=0x7f6d300ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:13.782 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.779+0000 7f6d35590700 1 -- 172.21.15.188:0/540216062 shutdown_connections 2024-02-05T07:17:13.782 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.779+0000 7f6d35590700 1 -- 172.21.15.188:0/540216062 wait complete. 2024-02-05T07:17:13.783 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.780+0000 7f6d35590700 1 Processor -- start 2024-02-05T07:17:13.783 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.780+0000 7f6d35590700 1 -- start start 2024-02-05T07:17:13.783 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.780+0000 7f6d35590700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6d30110d90 con 0x7f6d30101b10 2024-02-05T07:17:13.783 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.780+0000 7f6d35590700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6d30197a80 con 0x7f6d30109c80 2024-02-05T07:17:13.783 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.780+0000 7f6d35590700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6d301a4220 con 0x7f6d30105f40 2024-02-05T07:17:13.783 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.780+0000 7f6d2f7fe700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f6d30109c80 0x7f6d301a0ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:57696/0 (socket says 172.21.15.188:57696) 2024-02-05T07:17:13.783 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.780+0000 7f6d2f7fe700 1 -- 172.21.15.188:0/1679319654 learned_addr learned my addr 172.21.15.188:0/1679319654 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:17:13.785 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.780+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3012318862 0 0) 0x7f6d30197a80 con 0x7f6d30109c80 2024-02-05T07:17:13.785 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.780+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d180035b0 con 0x7f6d30109c80 2024-02-05T07:17:13.785 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417338292 0 0) 0x7f6d301a4220 con 0x7f6d30105f40 2024-02-05T07:17:13.785 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d30197a80 con 0x7f6d30105f40 2024-02-05T07:17:13.785 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2548891934 0 0) 0x7f6d30110d90 con 0x7f6d30101b10 2024-02-05T07:17:13.785 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d301a4220 con 0x7f6d30101b10 2024-02-05T07:17:13.785 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3942935312 0 0) 0x7f6d180035b0 con 0x7f6d30109c80 2024-02-05T07:17:13.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6d30110d90 con 0x7f6d30109c80 2024-02-05T07:17:13.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6d280017b0 con 0x7f6d30109c80 2024-02-05T07:17:13.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4014370183 0 0) 0x7f6d30197a80 con 0x7f6d30105f40 2024-02-05T07:17:13.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6d180035b0 con 0x7f6d30105f40 2024-02-05T07:17:13.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6d24001830 con 0x7f6d30105f40 2024-02-05T07:17:13.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1642790400 0 0) 0x7f6d301a4220 con 0x7f6d30101b10 2024-02-05T07:17:13.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f6d30197a80 con 0x7f6d30101b10 2024-02-05T07:17:13.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6d200017b0 con 0x7f6d30101b10 2024-02-05T07:17:13.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1226944054 0 0) 0x7f6d30110d90 con 0x7f6d30109c80 2024-02-05T07:17:13.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 >> v1:172.21.15.184:6790/0 conn(0x7f6d30105f40 legacy=0x7f6d3019d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:13.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 >> v1:172.21.15.184:6789/0 conn(0x7f6d30101b10 legacy=0x7f6d30196ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:13.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d301a53c0 con 0x7f6d30109c80 2024-02-05T07:17:13.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d35590700 1 -- 172.21.15.188:0/1679319654 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d301a4410 con 0x7f6d30109c80 2024-02-05T07:17:13.786 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d35590700 1 -- 172.21.15.188:0/1679319654 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d301a4910 con 0x7f6d30109c80 2024-02-05T07:17:13.787 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f6d28001a60 con 0x7f6d30109c80 2024-02-05T07:17:13.787 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.781+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6d28005330 con 0x7f6d30109c80 2024-02-05T07:17:13.787 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.782+0000 7f6d35590700 1 -- 172.21.15.188:0/1679319654 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1c005120 con 0x7f6d30109c80 2024-02-05T07:17:13.787 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.782+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 15) v1 ==== 91372+0+0 (unknown 1941537730 0 0) 0x7f6d28005550 con 0x7f6d30109c80 2024-02-05T07:17:13.787 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.783+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(59..59 src has 1..59) v4 ==== 4081+0+0 (unknown 4172090614 0 0) 0x7f6d28088560 con 0x7f6d30109c80 2024-02-05T07:17:13.789 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.788+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f6d28052600 con 0x7f6d30109c80 2024-02-05T07:17:13.991 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.989+0000 7f6d35590700 1 -- 172.21.15.188:0/1679319654 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi184=foo.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f6d1c000b90 con 0x7f6d1806e9c0 2024-02-05T07:17:13.998 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.996+0000 7f6d17fff700 1 -- 172.21.15.188:0/1679319654 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+30 (unknown 0 0 1123153589) 0x7f6d1c000b90 con 0x7f6d1806e9c0 2024-02-05T07:17:13.998 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled rgw.foo.a update... 2024-02-05T07:17:14.000 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.998+0000 7f6d35590700 1 -- 172.21.15.188:0/1679319654 >> v1:172.21.15.184:6800/2865218501 conn(0x7f6d1806e9c0 legacy=0x7f6d18070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:14.000 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.998+0000 7f6d35590700 1 -- 172.21.15.188:0/1679319654 >> v1:172.21.15.188:6789/0 conn(0x7f6d30109c80 legacy=0x7f6d301a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:14.000 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.998+0000 7f6d35590700 1 -- 172.21.15.188:0/1679319654 shutdown_connections 2024-02-05T07:17:14.000 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.998+0000 7f6d35590700 1 -- 172.21.15.188:0/1679319654 >> 172.21.15.188:0/1679319654 conn(0x7f6d300fd090 msgr2=0x7f6d30108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:14.000 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.998+0000 7f6d35590700 1 -- 172.21.15.188:0/1679319654 shutdown_connections 2024-02-05T07:17:14.000 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:13.998+0000 7f6d35590700 1 -- 172.21.15.188:0/1679319654 wait complete. 2024-02-05T07:17:14.589 DEBUG:teuthology.orchestra.run.smithi184:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@rgw.foo.a.service 2024-02-05T07:17:14.592 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi188 2024-02-05T07:17:14.592 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph osd pool create datapool 3 3 replicated 2024-02-05T07:17:14.827 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:17:15.241 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:14 smithi188 ceph-mon[33283]: from='client.24349 v1:172.21.15.188:0/1679319654' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi184=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:15.241 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:14 smithi188 ceph-mon[33283]: Saving service rgw.foo.a spec with placement smithi184=foo.a;count:1 2024-02-05T07:17:15.241 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:14 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:15.241 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:14 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:15.241 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:14 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:15.241 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:14 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:17:15.241 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:14 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:15.242 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:14 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-05T07:17:15.242 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:14 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-05T07:17:15.242 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:14 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:15.242 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:14 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:15.242 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:14 smithi188 ceph-mon[33283]: Deploying daemon rgw.foo.a on smithi184 2024-02-05T07:17:15.242 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:14 smithi188 ceph-mon[33283]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-02-05T07:17:15.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[29861]: from='client.24349 v1:172.21.15.188:0/1679319654' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi184=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:15.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[29861]: Saving service rgw.foo.a spec with placement smithi184=foo.a;count:1 2024-02-05T07:17:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:17:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-05T07:17:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-05T07:17:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[29861]: Deploying daemon rgw.foo.a on smithi184 2024-02-05T07:17:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[29861]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-02-05T07:17:15.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[41609]: from='client.24349 v1:172.21.15.188:0/1679319654' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi184=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[41609]: Saving service rgw.foo.a spec with placement smithi184=foo.a;count:1 2024-02-05T07:17:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:17:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-05T07:17:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-05T07:17:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[41609]: Deploying daemon rgw.foo.a on smithi184 2024-02-05T07:17:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:14 smithi184 ceph-mon[41609]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-02-05T07:17:16.271 INFO:journalctl@ceph.rgw.foo.a.smithi184.stdout:Feb 05 07:17:16 smithi184 systemd[1]: Starting Ceph rgw.foo.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:17:16.325 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.320+0000 7f9f35e1c700 1 -- 172.21.15.188:0/2028247671 >> v1:172.21.15.188:6789/0 conn(0x7f9f301001d0 legacy=0x7f9f301005f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:16.325 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.320+0000 7f9f35e1c700 1 -- 172.21.15.188:0/2028247671 shutdown_connections 2024-02-05T07:17:16.325 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.320+0000 7f9f35e1c700 1 -- 172.21.15.188:0/2028247671 >> 172.21.15.188:0/2028247671 conn(0x7f9f300fb790 msgr2=0x7f9f300fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:16.325 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.320+0000 7f9f35e1c700 1 -- 172.21.15.188:0/2028247671 shutdown_connections 2024-02-05T07:17:16.325 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.320+0000 7f9f35e1c700 1 -- 172.21.15.188:0/2028247671 wait complete. 2024-02-05T07:17:16.325 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.321+0000 7f9f35e1c700 1 Processor -- start 2024-02-05T07:17:16.325 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.321+0000 7f9f35e1c700 1 -- start start 2024-02-05T07:17:16.325 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.321+0000 7f9f35e1c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9f30197a90 con 0x7f9f30108340 2024-02-05T07:17:16.326 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.321+0000 7f9f35e1c700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9f301a3280 con 0x7f9f301001d0 2024-02-05T07:17:16.326 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.321+0000 7f9f35e1c700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9f301a4420 con 0x7f9f30104600 2024-02-05T07:17:16.326 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.321+0000 7f9f2f7fe700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f9f301001d0 0x7f9f30196f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:57712/0 (socket says 172.21.15.188:57712) 2024-02-05T07:17:16.326 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.321+0000 7f9f2f7fe700 1 -- 172.21.15.188:0/3442847765 learned_addr learned my addr 172.21.15.188:0/3442847765 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:17:16.326 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672341491 0 0) 0x7f9f301a3280 con 0x7f9f301001d0 2024-02-05T07:17:16.326 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f180046c0 con 0x7f9f301001d0 2024-02-05T07:17:16.326 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889728592 0 0) 0x7f9f30197a90 con 0x7f9f30108340 2024-02-05T07:17:16.326 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f301a3280 con 0x7f9f30108340 2024-02-05T07:17:16.326 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680599039 0 0) 0x7f9f301a4420 con 0x7f9f30104600 2024-02-05T07:17:16.326 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f30197a90 con 0x7f9f30104600 2024-02-05T07:17:16.326 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2084095537 0 0) 0x7f9f180046c0 con 0x7f9f301001d0 2024-02-05T07:17:16.326 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9f301a4420 con 0x7f9f301001d0 2024-02-05T07:17:16.326 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9f200018c0 con 0x7f9f301001d0 2024-02-05T07:17:16.326 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4127818860 0 0) 0x7f9f301a3280 con 0x7f9f30108340 2024-02-05T07:17:16.327 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9f180046c0 con 0x7f9f30108340 2024-02-05T07:17:16.327 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9f28001b70 con 0x7f9f30108340 2024-02-05T07:17:16.327 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2449469576 0 0) 0x7f9f30197a90 con 0x7f9f30104600 2024-02-05T07:17:16.327 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9f301a3280 con 0x7f9f30104600 2024-02-05T07:17:16.327 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9f24001720 con 0x7f9f30104600 2024-02-05T07:17:16.327 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4073563493 0 0) 0x7f9f301a4420 con 0x7f9f301001d0 2024-02-05T07:17:16.327 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 >> v1:172.21.15.184:6790/0 conn(0x7f9f30104600 legacy=0x7f9f3019d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:16.327 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 >> v1:172.21.15.184:6789/0 conn(0x7f9f30108340 legacy=0x7f9f301a0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:16.327 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f301a55c0 con 0x7f9f301001d0 2024-02-05T07:17:16.327 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f35e1c700 1 -- 172.21.15.188:0/3442847765 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f301a2270 con 0x7f9f301001d0 2024-02-05T07:17:16.327 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f35e1c700 1 -- 172.21.15.188:0/3442847765 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f301a2770 con 0x7f9f301001d0 2024-02-05T07:17:16.327 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f9f20001bd0 con 0x7f9f301001d0 2024-02-05T07:17:16.327 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.322+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9f200050f0 con 0x7f9f301001d0 2024-02-05T07:17:16.328 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.323+0000 7f9f35e1c700 1 -- 172.21.15.188:0/3442847765 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1c005120 con 0x7f9f301001d0 2024-02-05T07:17:16.328 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.324+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 15) v1 ==== 91372+0+0 (unknown 1941537730 0 0) 0x7f9f20005250 con 0x7f9f301001d0 2024-02-05T07:17:16.328 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.324+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(59..59 src has 1..59) v4 ==== 4081+0+0 (unknown 4172090614 0 0) 0x7f9f200881d0 con 0x7f9f301001d0 2024-02-05T07:17:16.330 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.329+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f9f20052270 con 0x7f9f301001d0 2024-02-05T07:17:16.526 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:16.523+0000 7f9f35e1c700 1 -- 172.21.15.188:0/3442847765 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) v1 -- 0x7f9f1c005950 con 0x7f9f301001d0 2024-02-05T07:17:16.634 INFO:journalctl@ceph.rgw.foo.a.smithi184.stdout:Feb 05 07:17:16 smithi184 podman[69287]: 2024-02-05 07:17:16.281992751 +0000 UTC m=+0.017832437 image pull 8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0 2024-02-05T07:17:16.634 INFO:journalctl@ceph.rgw.foo.a.smithi184.stdout:Feb 05 07:17:16 smithi184 podman[69287]: 2024-02-05 07:17:16.399820816 +0000 UTC m=+0.135660504 container create d7f70fe8f46338e69850a7b5d67ce829e9662b7a951e6017ed668faa8a92bb5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-rgw-foo-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-05T07:17:16.634 INFO:journalctl@ceph.rgw.foo.a.smithi184.stdout:Feb 05 07:17:16 smithi184 podman[69287]: 2024-02-05 07:17:16.627225132 +0000 UTC m=+0.363064784 container init d7f70fe8f46338e69850a7b5d67ce829e9662b7a951e6017ed668faa8a92bb5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-rgw-foo-a, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-05T07:17:16.634 INFO:journalctl@ceph.rgw.foo.a.smithi184.stdout:Feb 05 07:17:16 smithi184 podman[69287]: 2024-02-05 07:17:16.632684038 +0000 UTC m=+0.368523694 container start d7f70fe8f46338e69850a7b5d67ce829e9662b7a951e6017ed668faa8a92bb5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-rgw-foo-a, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-05T07:17:17.021 INFO:journalctl@ceph.rgw.foo.a.smithi184.stdout:Feb 05 07:17:16 smithi184 bash[69287]: d7f70fe8f46338e69850a7b5d67ce829e9662b7a951e6017ed668faa8a92bb5a 2024-02-05T07:17:17.021 INFO:journalctl@ceph.rgw.foo.a.smithi184.stdout:Feb 05 07:17:16 smithi184 systemd[1]: Started Ceph rgw.foo.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:17:17.269 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:17.266+0000 7f9f2cff9700 1 -- 172.21.15.188:0/3442847765 <== mon.1 v1:172.21.15.188:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'datapool' created v60) v1 ==== 160+0+0 (unknown 701681216 0 0) 0x7f9f200541a0 con 0x7f9f301001d0 2024-02-05T07:17:17.273 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:17.271+0000 7f9f35e1c700 1 -- 172.21.15.188:0/3442847765 >> v1:172.21.15.184:6800/2865218501 conn(0x7f9f1806e960 legacy=0x7f9f18070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:17.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:17.271+0000 7f9f35e1c700 1 -- 172.21.15.188:0/3442847765 >> v1:172.21.15.188:6789/0 conn(0x7f9f301001d0 legacy=0x7f9f30196f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:17.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:17.271+0000 7f9f35e1c700 1 -- 172.21.15.188:0/3442847765 shutdown_connections 2024-02-05T07:17:17.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:17.271+0000 7f9f35e1c700 1 -- 172.21.15.188:0/3442847765 >> 172.21.15.188:0/3442847765 conn(0x7f9f300fb790 msgr2=0x7f9f30107200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:17.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:17.271+0000 7f9f35e1c700 1 -- 172.21.15.188:0/3442847765 shutdown_connections 2024-02-05T07:17:17.275 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:17.271+0000 7f9f35e1c700 1 -- 172.21.15.188:0/3442847765 wait complete. 2024-02-05T07:17:17.275 INFO:teuthology.orchestra.run.smithi188.stderr:pool 'datapool' created 2024-02-05T07:17:17.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[29861]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:17:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.188:0/3442847765' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-05T07:17:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[29861]: from='client.24355 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-05T07:17:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:17.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[41609]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:17:17.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.188:0/3442847765' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-05T07:17:17.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[41609]: from='client.24355 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-05T07:17:17.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:17.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:17.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:17.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:17.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:17.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:17 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:17.576 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:17 smithi188 ceph-mon[33283]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:17:17.576 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.188:0/3442847765' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-05T07:17:17.576 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:17 smithi188 ceph-mon[33283]: from='client.24355 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-05T07:17:17.576 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:17 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:17.576 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:17 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:17.576 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:17 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:17.576 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:17 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:17.576 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:17 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:17.576 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:17 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:17.908 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- rbd pool init datapool 2024-02-05T07:17:18.145 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:17:18.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:18 smithi184 ceph-mon[29861]: Saving service rgw.foo.a spec with placement smithi184=foo.a;count:1 2024-02-05T07:17:18.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:18 smithi184 ceph-mon[29861]: from='client.24355 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-05T07:17:18.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:18 smithi184 ceph-mon[29861]: osdmap e60: 8 total, 8 up, 8 in 2024-02-05T07:17:18.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2493231606' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-05T07:17:18.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:18 smithi184 ceph-mon[29861]: from='client.34361 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-05T07:17:18.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:18 smithi184 ceph-mon[41609]: Saving service rgw.foo.a spec with placement smithi184=foo.a;count:1 2024-02-05T07:17:18.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:18 smithi184 ceph-mon[41609]: from='client.24355 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-05T07:17:18.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:18 smithi184 ceph-mon[41609]: osdmap e60: 8 total, 8 up, 8 in 2024-02-05T07:17:18.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2493231606' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-05T07:17:18.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:18 smithi184 ceph-mon[41609]: from='client.34361 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-05T07:17:18.554 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:18 smithi188 ceph-mon[33283]: Saving service rgw.foo.a spec with placement smithi184=foo.a;count:1 2024-02-05T07:17:18.554 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:18 smithi188 ceph-mon[33283]: from='client.24355 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-05T07:17:18.555 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:18 smithi188 ceph-mon[33283]: osdmap e60: 8 total, 8 up, 8 in 2024-02-05T07:17:18.555 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2493231606' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-05T07:17:18.555 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:18 smithi188 ceph-mon[33283]: from='client.34361 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-05T07:17:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:19 smithi188 ceph-mon[33283]: pgmap v187: 36 pgs: 7 creating+peering, 1 active+clean, 28 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:17:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:19 smithi188 ceph-mon[33283]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:17:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:19 smithi188 ceph-mon[33283]: from='client.34361 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-05T07:17:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:19 smithi188 ceph-mon[33283]: osdmap e61: 8 total, 8 up, 8 in 2024-02-05T07:17:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:19.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:17:19.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:19 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:19.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[29861]: pgmap v187: 36 pgs: 7 creating+peering, 1 active+clean, 28 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:17:19.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[29861]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:17:19.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[29861]: from='client.34361 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-05T07:17:19.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[29861]: osdmap e61: 8 total, 8 up, 8 in 2024-02-05T07:17:19.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:19.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:19.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:19.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:17:19.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[41609]: pgmap v187: 36 pgs: 7 creating+peering, 1 active+clean, 28 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:17:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[41609]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:17:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[41609]: from='client.34361 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-05T07:17:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[41609]: osdmap e61: 8 total, 8 up, 8 in 2024-02-05T07:17:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:17:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:19 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:20.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[41609]: Checking dashboard <-> RGW credentials 2024-02-05T07:17:20.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[41609]: osdmap e62: 8 total, 8 up, 8 in 2024-02-05T07:17:20.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/255485076' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-05T07:17:20.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3583993287' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-05T07:17:20.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[41609]: from='client.34370 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-05T07:17:20.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[41609]: from='client.34400 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-05T07:17:20.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.188:0/2743248752' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-02-05T07:17:20.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[41609]: from='client.24409 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-02-05T07:17:20.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[29861]: Checking dashboard <-> RGW credentials 2024-02-05T07:17:20.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[29861]: osdmap e62: 8 total, 8 up, 8 in 2024-02-05T07:17:20.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/255485076' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-05T07:17:20.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3583993287' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-05T07:17:20.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[29861]: from='client.34370 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-05T07:17:20.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[29861]: from='client.34400 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-05T07:17:20.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.188:0/2743248752' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-02-05T07:17:20.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:20 smithi184 ceph-mon[29861]: from='client.24409 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-02-05T07:17:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:20 smithi188 ceph-mon[33283]: Checking dashboard <-> RGW credentials 2024-02-05T07:17:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:20 smithi188 ceph-mon[33283]: osdmap e62: 8 total, 8 up, 8 in 2024-02-05T07:17:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/255485076' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-05T07:17:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3583993287' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-05T07:17:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:20 smithi188 ceph-mon[33283]: from='client.34370 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-05T07:17:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:20 smithi188 ceph-mon[33283]: from='client.34400 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-05T07:17:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.188:0/2743248752' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-02-05T07:17:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:20 smithi188 ceph-mon[33283]: from='client.24409 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-02-05T07:17:21.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:21 smithi188 ceph-mon[33283]: pgmap v190: 68 pgs: 10 creating+peering, 18 active+clean, 40 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 170 B/s wr, 0 op/s 2024-02-05T07:17:21.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:21 smithi188 ceph-mon[33283]: from='client.34370 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-05T07:17:21.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:21 smithi188 ceph-mon[33283]: from='client.34400 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-05T07:17:21.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:21 smithi188 ceph-mon[33283]: from='client.24409 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-02-05T07:17:21.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:21 smithi188 ceph-mon[33283]: osdmap e63: 8 total, 8 up, 8 in 2024-02-05T07:17:21.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:21 smithi184 ceph-mon[29861]: pgmap v190: 68 pgs: 10 creating+peering, 18 active+clean, 40 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 170 B/s wr, 0 op/s 2024-02-05T07:17:21.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:21 smithi184 ceph-mon[29861]: from='client.34370 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-05T07:17:21.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:21 smithi184 ceph-mon[29861]: from='client.34400 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-05T07:17:21.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:21 smithi184 ceph-mon[29861]: from='client.24409 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-02-05T07:17:21.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:21 smithi184 ceph-mon[29861]: osdmap e63: 8 total, 8 up, 8 in 2024-02-05T07:17:21.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:21 smithi184 ceph-mon[41609]: pgmap v190: 68 pgs: 10 creating+peering, 18 active+clean, 40 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 170 B/s wr, 0 op/s 2024-02-05T07:17:21.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:21 smithi184 ceph-mon[41609]: from='client.34370 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-05T07:17:21.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:21 smithi184 ceph-mon[41609]: from='client.34400 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-05T07:17:21.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:21 smithi184 ceph-mon[41609]: from='client.24409 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-02-05T07:17:21.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:21 smithi184 ceph-mon[41609]: osdmap e63: 8 total, 8 up, 8 in 2024-02-05T07:17:22.640 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:22 smithi188 ceph-mon[33283]: osdmap e64: 8 total, 8 up, 8 in 2024-02-05T07:17:22.641 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3583993287' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-05T07:17:22.641 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/255485076' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-05T07:17:22.641 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:22 smithi188 ceph-mon[33283]: from='client.34400 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-05T07:17:22.641 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:22 smithi188 ceph-mon[33283]: from='client.34370 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-05T07:17:22.641 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:22 smithi188 ceph-mon[33283]: pgmap v193: 100 pgs: 14 creating+peering, 38 active+clean, 48 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-05T07:17:22.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:22 smithi184 ceph-mon[29861]: osdmap e64: 8 total, 8 up, 8 in 2024-02-05T07:17:22.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3583993287' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-05T07:17:22.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/255485076' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-05T07:17:22.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:22 smithi184 ceph-mon[29861]: from='client.34400 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-05T07:17:22.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:22 smithi184 ceph-mon[29861]: from='client.34370 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-05T07:17:22.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:22 smithi184 ceph-mon[29861]: pgmap v193: 100 pgs: 14 creating+peering, 38 active+clean, 48 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-05T07:17:22.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:22 smithi184 ceph-mon[41609]: osdmap e64: 8 total, 8 up, 8 in 2024-02-05T07:17:22.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3583993287' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-05T07:17:22.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/255485076' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-05T07:17:22.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:22 smithi184 ceph-mon[41609]: from='client.34400 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-05T07:17:22.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:22 smithi184 ceph-mon[41609]: from='client.34370 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-05T07:17:22.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:22 smithi184 ceph-mon[41609]: pgmap v193: 100 pgs: 14 creating+peering, 38 active+clean, 48 unknown; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-05T07:17:22.966 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch apply iscsi datapool admin admin --trusted_ip_list 172.21.15.188 --placement '1;smithi188=iscsi.a' 2024-02-05T07:17:23.211 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:17:23.569 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:23 smithi188 ceph-mon[33283]: from='client.34400 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-05T07:17:23.569 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:23 smithi188 ceph-mon[33283]: from='client.34370 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-05T07:17:23.569 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:23 smithi188 ceph-mon[33283]: osdmap e65: 8 total, 8 up, 8 in 2024-02-05T07:17:23.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:23 smithi184 ceph-mon[29861]: from='client.34400 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-05T07:17:23.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:23 smithi184 ceph-mon[29861]: from='client.34370 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-05T07:17:23.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:23 smithi184 ceph-mon[29861]: osdmap e65: 8 total, 8 up, 8 in 2024-02-05T07:17:23.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:23 smithi184 ceph-mon[41609]: from='client.34400 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-05T07:17:23.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:23 smithi184 ceph-mon[41609]: from='client.34370 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-05T07:17:23.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:23 smithi184 ceph-mon[41609]: osdmap e65: 8 total, 8 up, 8 in 2024-02-05T07:17:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:24 smithi188 ceph-mon[33283]: osdmap e66: 8 total, 8 up, 8 in 2024-02-05T07:17:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/255485076' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-05T07:17:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3583993287' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-05T07:17:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:24 smithi188 ceph-mon[33283]: from='client.34370 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-05T07:17:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:24 smithi188 ceph-mon[33283]: from='client.34400 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-05T07:17:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:24 smithi188 ceph-mon[33283]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:17:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:24 smithi188 ceph-mon[33283]: pgmap v196: 132 pgs: 11 creating+peering, 75 active+clean, 46 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-02-05T07:17:24.747 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.743+0000 7fe9983c9700 1 -- 172.21.15.188:0/2946579487 >> v1:172.21.15.188:6789/0 conn(0x7fe990109c30 legacy=0x7fe99010c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:24.747 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.743+0000 7fe9983c9700 1 -- 172.21.15.188:0/2946579487 shutdown_connections 2024-02-05T07:17:24.747 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.743+0000 7fe9983c9700 1 -- 172.21.15.188:0/2946579487 >> 172.21.15.188:0/2946579487 conn(0x7fe9900fbfb0 msgr2=0x7fe9900fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:24.747 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.743+0000 7fe9983c9700 1 -- 172.21.15.188:0/2946579487 shutdown_connections 2024-02-05T07:17:24.747 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.743+0000 7fe9983c9700 1 -- 172.21.15.188:0/2946579487 wait complete. 2024-02-05T07:17:24.748 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.743+0000 7fe9983c9700 1 Processor -- start 2024-02-05T07:17:24.748 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.743+0000 7fe9983c9700 1 -- start start 2024-02-05T07:17:24.748 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.743+0000 7fe9983c9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe990197950 con 0x7fe990102580 2024-02-05T07:17:24.748 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9983c9700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe9901a3140 con 0x7fe990106090 2024-02-05T07:17:24.748 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9983c9700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe9901a42e0 con 0x7fe990109c30 2024-02-05T07:17:24.748 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe995964700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fe990106090 0x7fe99019d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:39362/0 (socket says 172.21.15.188:39362) 2024-02-05T07:17:24.748 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe995964700 1 -- 172.21.15.188:0/197262489 learned_addr learned my addr 172.21.15.188:0/197262489 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:17:24.748 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274014468 0 0) 0x7fe9901a3140 con 0x7fe990106090 2024-02-05T07:17:24.748 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe97c0035b0 con 0x7fe990106090 2024-02-05T07:17:24.748 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3642992528 0 0) 0x7fe990197950 con 0x7fe990102580 2024-02-05T07:17:24.748 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9901a3140 con 0x7fe990102580 2024-02-05T07:17:24.748 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208270463 0 0) 0x7fe9901a42e0 con 0x7fe990109c30 2024-02-05T07:17:24.749 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe990197950 con 0x7fe990109c30 2024-02-05T07:17:24.749 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 397204143 0 0) 0x7fe97c0035b0 con 0x7fe990106090 2024-02-05T07:17:24.749 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe9901a42e0 con 0x7fe990106090 2024-02-05T07:17:24.749 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fe980001910 con 0x7fe990106090 2024-02-05T07:17:24.749 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1239487580 0 0) 0x7fe9901a3140 con 0x7fe990102580 2024-02-05T07:17:24.749 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe97c0035b0 con 0x7fe990102580 2024-02-05T07:17:24.749 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fe98c001870 con 0x7fe990102580 2024-02-05T07:17:24.749 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3260116638 0 0) 0x7fe990197950 con 0x7fe990109c30 2024-02-05T07:17:24.749 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe9901a3140 con 0x7fe990109c30 2024-02-05T07:17:24.749 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fe988004830 con 0x7fe990109c30 2024-02-05T07:17:24.749 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1112987994 0 0) 0x7fe9901a42e0 con 0x7fe990106090 2024-02-05T07:17:24.749 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 >> v1:172.21.15.184:6790/0 conn(0x7fe990109c30 legacy=0x7fe9901a0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:24.749 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 >> v1:172.21.15.184:6789/0 conn(0x7fe990102580 legacy=0x7fe990196e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:24.749 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9901a5480 con 0x7fe990106090 2024-02-05T07:17:24.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9983c9700 1 -- 172.21.15.188:0/197262489 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9901a2190 con 0x7fe990106090 2024-02-05T07:17:24.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9983c9700 1 -- 172.21.15.188:0/197262489 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9901a2690 con 0x7fe990106090 2024-02-05T07:17:24.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.744+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fe980003b30 con 0x7fe990106090 2024-02-05T07:17:24.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.745+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fe980005bb0 con 0x7fe990106090 2024-02-05T07:17:24.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.745+0000 7fe9983c9700 1 -- 172.21.15.188:0/197262489 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe974005150 con 0x7fe990106090 2024-02-05T07:17:24.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.746+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 15) v1 ==== 91372+0+0 (unknown 1941537730 0 0) 0x7fe9800036a0 con 0x7fe990106090 2024-02-05T07:17:24.750 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.746+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(67..67 src has 1..67) v4 ==== 5926+0+0 (unknown 2977457923 0 0) 0x7fe9800885e0 con 0x7fe990106090 2024-02-05T07:17:24.753 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.751+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fe980051f50 con 0x7fe990106090 2024-02-05T07:17:24.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:24 smithi184 ceph-mon[29861]: osdmap e66: 8 total, 8 up, 8 in 2024-02-05T07:17:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/255485076' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-05T07:17:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3583993287' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-05T07:17:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:24 smithi184 ceph-mon[29861]: from='client.34370 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-05T07:17:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:24 smithi184 ceph-mon[29861]: from='client.34400 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-05T07:17:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:24 smithi184 ceph-mon[29861]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:17:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:24 smithi184 ceph-mon[29861]: pgmap v196: 132 pgs: 11 creating+peering, 75 active+clean, 46 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-02-05T07:17:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:24 smithi184 ceph-mon[41609]: osdmap e66: 8 total, 8 up, 8 in 2024-02-05T07:17:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/255485076' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-05T07:17:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3583993287' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-05T07:17:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:24 smithi184 ceph-mon[41609]: from='client.34370 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-05T07:17:24.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:24 smithi184 ceph-mon[41609]: from='client.34400 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-05T07:17:24.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:24 smithi184 ceph-mon[41609]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:17:24.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:24 smithi184 ceph-mon[41609]: pgmap v196: 132 pgs: 11 creating+peering, 75 active+clean, 46 unknown; 578 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 4.0 KiB/s rd, 2.0 KiB/s wr, 6 op/s 2024-02-05T07:17:24.956 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.954+0000 7fe9983c9700 1 -- 172.21.15.188:0/197262489 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.188", "placement": "1;smithi188=iscsi.a", "target": ["mon-mgr", ""]}) v1 -- 0x7fe974000c90 con 0x7fe97c06e990 2024-02-05T07:17:24.964 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.962+0000 7fe9877fe700 1 -- 172.21.15.188:0/197262489 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (unknown 0 0 803663096) 0x7fe974000c90 con 0x7fe97c06e990 2024-02-05T07:17:24.964 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled iscsi.datapool update... 2024-02-05T07:17:24.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.964+0000 7fe9983c9700 1 -- 172.21.15.188:0/197262489 >> v1:172.21.15.184:6800/2865218501 conn(0x7fe97c06e990 legacy=0x7fe97c070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:24.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.964+0000 7fe9983c9700 1 -- 172.21.15.188:0/197262489 >> v1:172.21.15.188:6789/0 conn(0x7fe990106090 legacy=0x7fe99019d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:24.966 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.964+0000 7fe9983c9700 1 -- 172.21.15.188:0/197262489 shutdown_connections 2024-02-05T07:17:24.967 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.964+0000 7fe9983c9700 1 -- 172.21.15.188:0/197262489 >> 172.21.15.188:0/197262489 conn(0x7fe9900fbfb0 msgr2=0x7fe99010c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:24.967 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.964+0000 7fe9983c9700 1 -- 172.21.15.188:0/197262489 shutdown_connections 2024-02-05T07:17:24.967 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:24.964+0000 7fe9983c9700 1 -- 172.21.15.188:0/197262489 wait complete. 2024-02-05T07:17:25.623 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:25 smithi188 ceph-mon[33283]: from='client.34370 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-05T07:17:25.623 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:25 smithi188 ceph-mon[33283]: from='client.34400 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-05T07:17:25.624 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:25 smithi188 ceph-mon[33283]: osdmap e67: 8 total, 8 up, 8 in 2024-02-05T07:17:25.624 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/255485076' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-05T07:17:25.624 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:25 smithi188 ceph-mon[33283]: from='client.34370 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-05T07:17:25.624 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3583993287' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-05T07:17:25.624 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:25 smithi188 ceph-mon[33283]: from='client.34400 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-05T07:17:25.624 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:25 smithi188 ceph-mon[33283]: from='client.24415 v1:172.21.15.188:0/197262489' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.188", "placement": "1;smithi188=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:25.624 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:25 smithi188 ceph-mon[33283]: Saving service iscsi.datapool spec with placement smithi188=iscsi.a;count:1 2024-02-05T07:17:25.624 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:25 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:25.624 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:25 smithi188 ceph-mon[33283]: from='client.34370 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-05T07:17:25.655 INFO:tasks.cephadm:Distributing iscsi-gateway.cfg... 2024-02-05T07:17:25.655 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:17:25.655 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-02-05T07:17:25.683 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[29861]: from='client.34370 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-05T07:17:25.683 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[29861]: from='client.34400 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-05T07:17:25.683 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[29861]: osdmap e67: 8 total, 8 up, 8 in 2024-02-05T07:17:25.684 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/255485076' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-05T07:17:25.684 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[29861]: from='client.34370 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-05T07:17:25.684 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3583993287' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-05T07:17:25.684 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[29861]: from='client.34400 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-05T07:17:25.684 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[29861]: from='client.24415 v1:172.21.15.188:0/197262489' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.188", "placement": "1;smithi188=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:25.684 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[29861]: Saving service iscsi.datapool spec with placement smithi188=iscsi.a;count:1 2024-02-05T07:17:25.684 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:25.684 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[29861]: from='client.34370 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-05T07:17:25.684 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[41609]: from='client.34370 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-05T07:17:25.684 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[41609]: from='client.34400 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-05T07:17:25.685 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[41609]: osdmap e67: 8 total, 8 up, 8 in 2024-02-05T07:17:25.685 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/255485076' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-05T07:17:25.685 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[41609]: from='client.34370 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-05T07:17:25.685 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3583993287' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-05T07:17:25.685 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[41609]: from='client.34400 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-05T07:17:25.685 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[41609]: from='client.24415 v1:172.21.15.188:0/197262489' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.188", "placement": "1;smithi188=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:25.685 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[41609]: Saving service iscsi.datapool spec with placement smithi188=iscsi.a;count:1 2024-02-05T07:17:25.685 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:25.685 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:25 smithi184 ceph-mon[41609]: from='client.34370 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-05T07:17:25.687 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-05T07:17:25.687 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-02-05T07:17:25.716 DEBUG:teuthology.orchestra.run.smithi188:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@iscsi.iscsi.a.service 2024-02-05T07:17:25.759 INFO:tasks.cephadm:Adding prometheus.a on smithi188 2024-02-05T07:17:25.759 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch apply prometheus '1;smithi188=a' 2024-02-05T07:17:26.049 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:17:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:26 smithi188 ceph-mon[33283]: from='client.34400 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-05T07:17:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:26 smithi188 ceph-mon[33283]: osdmap e68: 8 total, 8 up, 8 in 2024-02-05T07:17:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-05T07:17:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-05T07:17:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:26 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:26 smithi188 ceph-mon[33283]: Deploying daemon iscsi.iscsi.a on smithi188 2024-02-05T07:17:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:26 smithi188 ceph-mon[33283]: pgmap v199: 132 pgs: 15 creating+peering, 102 active+clean, 15 unknown; 579 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-02-05T07:17:26.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[29861]: from='client.34400 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-05T07:17:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[29861]: osdmap e68: 8 total, 8 up, 8 in 2024-02-05T07:17:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-05T07:17:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-05T07:17:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[29861]: Deploying daemon iscsi.iscsi.a on smithi188 2024-02-05T07:17:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[29861]: pgmap v199: 132 pgs: 15 creating+peering, 102 active+clean, 15 unknown; 579 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-02-05T07:17:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[41609]: from='client.34400 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-05T07:17:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[41609]: osdmap e68: 8 total, 8 up, 8 in 2024-02-05T07:17:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-05T07:17:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-05T07:17:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[41609]: Deploying daemon iscsi.iscsi.a on smithi188 2024-02-05T07:17:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:26 smithi184 ceph-mon[41609]: pgmap v199: 132 pgs: 15 creating+peering, 102 active+clean, 15 unknown; 579 KiB data, 225 MiB used, 715 GiB / 715 GiB avail; 4.2 KiB/s rd, 2.0 KiB/s wr, 7 op/s 2024-02-05T07:17:27.610 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:27 smithi188 ceph-mon[33283]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-05T07:17:27.610 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:27 smithi188 ceph-mon[33283]: Cluster is now healthy 2024-02-05T07:17:27.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:27 smithi184 ceph-mon[29861]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-05T07:17:27.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:27 smithi184 ceph-mon[29861]: Cluster is now healthy 2024-02-05T07:17:27.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:27 smithi184 ceph-mon[41609]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-05T07:17:27.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:27 smithi184 ceph-mon[41609]: Cluster is now healthy 2024-02-05T07:17:28.649 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:28 smithi188 ceph-mon[33283]: pgmap v200: 132 pgs: 11 creating+peering, 118 active+clean, 3 unknown; 580 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 3.9 KiB/s wr, 89 op/s 2024-02-05T07:17:28.651 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.646+0000 7eff91813700 1 -- 172.21.15.188:0/3793870394 >> v1:172.21.15.188:6789/0 conn(0x7eff8c101b10 legacy=0x7eff8c101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:28.651 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.646+0000 7eff91813700 1 -- 172.21.15.188:0/3793870394 shutdown_connections 2024-02-05T07:17:28.651 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.646+0000 7eff91813700 1 -- 172.21.15.188:0/3793870394 >> 172.21.15.188:0/3793870394 conn(0x7eff8c0fd0d0 msgr2=0x7eff8c0ff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:28.651 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.646+0000 7eff91813700 1 -- 172.21.15.188:0/3793870394 shutdown_connections 2024-02-05T07:17:28.651 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.646+0000 7eff91813700 1 -- 172.21.15.188:0/3793870394 wait complete. 2024-02-05T07:17:28.651 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.647+0000 7eff91813700 1 Processor -- start 2024-02-05T07:17:28.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.647+0000 7eff91813700 1 -- start start 2024-02-05T07:17:28.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.647+0000 7eff91813700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7eff8c1979a0 con 0x7eff8c101b10 2024-02-05T07:17:28.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.647+0000 7eff91813700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7eff8c1a3190 con 0x7eff8c109c80 2024-02-05T07:17:28.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.647+0000 7eff91813700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7eff8c1a4330 con 0x7eff8c105f40 2024-02-05T07:17:28.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.647+0000 7eff8b7fe700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7eff8c109c80 0x7eff8c1a0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:39380/0 (socket says 172.21.15.188:39380) 2024-02-05T07:17:28.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.647+0000 7eff8b7fe700 1 -- 172.21.15.188:0/863602754 learned_addr learned my addr 172.21.15.188:0/863602754 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:17:28.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.647+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491543304 0 0) 0x7eff8c1a3190 con 0x7eff8c109c80 2024-02-05T07:17:28.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.647+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff740035b0 con 0x7eff8c109c80 2024-02-05T07:17:28.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.647+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914709373 0 0) 0x7eff8c1a4330 con 0x7eff8c105f40 2024-02-05T07:17:28.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff8c1a3190 con 0x7eff8c105f40 2024-02-05T07:17:28.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2706186812 0 0) 0x7eff8c1979a0 con 0x7eff8c101b10 2024-02-05T07:17:28.652 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff8c1a4330 con 0x7eff8c101b10 2024-02-05T07:17:28.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4294285208 0 0) 0x7eff740035b0 con 0x7eff8c109c80 2024-02-05T07:17:28.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7eff8c1979a0 con 0x7eff8c109c80 2024-02-05T07:17:28.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7eff84001c10 con 0x7eff8c109c80 2024-02-05T07:17:28.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1444706891 0 0) 0x7eff8c1a3190 con 0x7eff8c105f40 2024-02-05T07:17:28.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7eff740035b0 con 0x7eff8c105f40 2024-02-05T07:17:28.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7eff7c001830 con 0x7eff8c105f40 2024-02-05T07:17:28.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2513802176 0 0) 0x7eff8c1a4330 con 0x7eff8c101b10 2024-02-05T07:17:28.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7eff8c1a3190 con 0x7eff8c101b10 2024-02-05T07:17:28.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7eff800044b0 con 0x7eff8c101b10 2024-02-05T07:17:28.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1267712235 0 0) 0x7eff8c1979a0 con 0x7eff8c109c80 2024-02-05T07:17:28.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 >> v1:172.21.15.184:6790/0 conn(0x7eff8c105f40 legacy=0x7eff8c19d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:28.653 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 >> v1:172.21.15.184:6789/0 conn(0x7eff8c101b10 legacy=0x7eff8c196e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:28.654 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c1a54d0 con 0x7eff8c109c80 2024-02-05T07:17:28.654 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff91813700 1 -- 172.21.15.188:0/863602754 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8c1a4520 con 0x7eff8c109c80 2024-02-05T07:17:28.654 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff91813700 1 -- 172.21.15.188:0/863602754 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8c1a4a20 con 0x7eff8c109c80 2024-02-05T07:17:28.654 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7eff84003eb0 con 0x7eff8c109c80 2024-02-05T07:17:28.654 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.648+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7eff84005ff0 con 0x7eff8c109c80 2024-02-05T07:17:28.654 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.649+0000 7eff91813700 1 -- 172.21.15.188:0/863602754 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff78005150 con 0x7eff8c109c80 2024-02-05T07:17:28.654 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.650+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 15) v1 ==== 91372+0+0 (unknown 1941537730 0 0) 0x7eff8401c650 con 0x7eff8c109c80 2024-02-05T07:17:28.654 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.650+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(68..68 src has 1..68) v4 ==== 5942+0+0 (unknown 3326990810 0 0) 0x7eff84088a70 con 0x7eff8c109c80 2024-02-05T07:17:28.657 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.655+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7eff840522f0 con 0x7eff8c109c80 2024-02-05T07:17:28.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:28 smithi184 ceph-mon[29861]: pgmap v200: 132 pgs: 11 creating+peering, 118 active+clean, 3 unknown; 580 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 3.9 KiB/s wr, 89 op/s 2024-02-05T07:17:28.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:28 smithi184 ceph-mon[41609]: pgmap v200: 132 pgs: 11 creating+peering, 118 active+clean, 3 unknown; 580 KiB data, 226 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 3.9 KiB/s wr, 89 op/s 2024-02-05T07:17:28.871 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.869+0000 7eff91813700 1 -- 172.21.15.188:0/863602754 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi188=a", "target": ["mon-mgr", ""]}) v1 -- 0x7eff78000bc0 con 0x7eff7406e9e0 2024-02-05T07:17:28.879 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.877+0000 7eff90811700 1 -- 172.21.15.188:0/863602754 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (unknown 0 0 1342662408) 0x7eff78000bc0 con 0x7eff7406e9e0 2024-02-05T07:17:28.879 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled prometheus update... 2024-02-05T07:17:28.881 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.879+0000 7eff91813700 1 -- 172.21.15.188:0/863602754 >> v1:172.21.15.184:6800/2865218501 conn(0x7eff7406e9e0 legacy=0x7eff74070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:28.881 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.879+0000 7eff91813700 1 -- 172.21.15.188:0/863602754 >> v1:172.21.15.188:6789/0 conn(0x7eff8c109c80 legacy=0x7eff8c1a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:28.882 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.879+0000 7eff91813700 1 -- 172.21.15.188:0/863602754 shutdown_connections 2024-02-05T07:17:28.882 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.879+0000 7eff91813700 1 -- 172.21.15.188:0/863602754 >> 172.21.15.188:0/863602754 conn(0x7eff8c0fd0d0 msgr2=0x7eff8c0ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:28.882 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.879+0000 7eff91813700 1 -- 172.21.15.188:0/863602754 shutdown_connections 2024-02-05T07:17:28.882 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:28.880+0000 7eff91813700 1 -- 172.21.15.188:0/863602754 wait complete. 2024-02-05T07:17:29.871 DEBUG:teuthology.orchestra.run.smithi188:prometheus.a> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@prometheus.a.service 2024-02-05T07:17:29.873 INFO:tasks.cephadm:Adding node-exporter.a on smithi184 2024-02-05T07:17:29.873 INFO:tasks.cephadm:Adding node-exporter.b on smithi188 2024-02-05T07:17:29.873 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch apply node-exporter '2;smithi184=a;smithi188=b' 2024-02-05T07:17:30.133 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:29 smithi188 ceph-mon[33283]: from='client.24436 v1:172.21.15.188:0/863602754' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi188=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:30.133 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:29 smithi188 ceph-mon[33283]: Saving service prometheus spec with placement smithi188=a;count:1 2024-02-05T07:17:30.133 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:29 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:30.133 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:29 smithi188 ceph-mon[33283]: osdmap e69: 8 total, 8 up, 8 in 2024-02-05T07:17:30.133 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:29 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:30.133 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:29 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:30.133 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:29 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:30.133 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:29 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:30.133 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:29 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:30.134 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.188:0/889982906' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-05T07:17:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[29861]: from='client.24436 v1:172.21.15.188:0/863602754' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi188=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[29861]: Saving service prometheus spec with placement smithi188=a;count:1 2024-02-05T07:17:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[29861]: osdmap e69: 8 total, 8 up, 8 in 2024-02-05T07:17:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:30.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.188:0/889982906' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-05T07:17:30.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[41609]: from='client.24436 v1:172.21.15.188:0/863602754' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi188=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:30.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[41609]: Saving service prometheus spec with placement smithi188=a;count:1 2024-02-05T07:17:30.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:30.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[41609]: osdmap e69: 8 total, 8 up, 8 in 2024-02-05T07:17:30.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:30.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:30.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:30.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:30.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:30.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.188:0/889982906' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-05T07:17:30.441 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:17:31.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:30 smithi188 ceph-mon[33283]: Checking pool "datapool" exists for service iscsi.datapool 2024-02-05T07:17:31.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:30 smithi188 ceph-mon[33283]: pgmap v202: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 5.8 KiB/s wr, 187 op/s 2024-02-05T07:17:31.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:30 smithi188 ceph-mon[33283]: mgrmap e16: y(active, since 4m), standbys: x 2024-02-05T07:17:31.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:30 smithi184 ceph-mon[41609]: Checking pool "datapool" exists for service iscsi.datapool 2024-02-05T07:17:31.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:30 smithi184 ceph-mon[41609]: pgmap v202: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 5.8 KiB/s wr, 187 op/s 2024-02-05T07:17:31.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:30 smithi184 ceph-mon[41609]: mgrmap e16: y(active, since 4m), standbys: x 2024-02-05T07:17:31.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:30 smithi184 ceph-mon[29861]: Checking pool "datapool" exists for service iscsi.datapool 2024-02-05T07:17:31.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:30 smithi184 ceph-mon[29861]: pgmap v202: 132 pgs: 132 active+clean; 582 KiB data, 234 MiB used, 715 GiB / 715 GiB avail; 77 KiB/s rd, 5.8 KiB/s wr, 187 op/s 2024-02-05T07:17:31.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:30 smithi184 ceph-mon[29861]: mgrmap e16: y(active, since 4m), standbys: x 2024-02-05T07:17:32.461 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.458+0000 7fce583ad700 1 -- 172.21.15.188:0/4120057227 >> v1:172.21.15.188:6789/0 conn(0x7fce50101b30 legacy=0x7fce50101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:32.461 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.458+0000 7fce583ad700 1 -- 172.21.15.188:0/4120057227 shutdown_connections 2024-02-05T07:17:32.461 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.458+0000 7fce583ad700 1 -- 172.21.15.188:0/4120057227 >> 172.21.15.188:0/4120057227 conn(0x7fce500fd0d0 msgr2=0x7fce500ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:32.461 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.458+0000 7fce583ad700 1 -- 172.21.15.188:0/4120057227 shutdown_connections 2024-02-05T07:17:32.462 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.458+0000 7fce583ad700 1 -- 172.21.15.188:0/4120057227 wait complete. 2024-02-05T07:17:32.462 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.459+0000 7fce583ad700 1 Processor -- start 2024-02-05T07:17:32.462 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.459+0000 7fce583ad700 1 -- start start 2024-02-05T07:17:32.462 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.459+0000 7fce583ad700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fce50197a00 con 0x7fce50101b30 2024-02-05T07:17:32.462 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.459+0000 7fce583ad700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fce501a31f0 con 0x7fce50109ca0 2024-02-05T07:17:32.462 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.459+0000 7fce583ad700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fce501a4390 con 0x7fce50105f60 2024-02-05T07:17:32.462 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.459+0000 7fce5694a700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7fce50109ca0 0x7fce501a0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:35288/0 (socket says 172.21.15.188:35288) 2024-02-05T07:17:32.462 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.459+0000 7fce5694a700 1 -- 172.21.15.188:0/338554262 learned_addr learned my addr 172.21.15.188:0/338554262 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:17:32.465 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402751677 0 0) 0x7fce501a31f0 con 0x7fce50109ca0 2024-02-05T07:17:32.466 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce3c0035b0 con 0x7fce50109ca0 2024-02-05T07:17:32.466 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 31408755 0 0) 0x7fce50197a00 con 0x7fce50101b30 2024-02-05T07:17:32.466 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce501a31f0 con 0x7fce50101b30 2024-02-05T07:17:32.466 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682945721 0 0) 0x7fce501a4390 con 0x7fce50105f60 2024-02-05T07:17:32.466 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce50197a00 con 0x7fce50105f60 2024-02-05T07:17:32.466 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2243704855 0 0) 0x7fce3c0035b0 con 0x7fce50109ca0 2024-02-05T07:17:32.466 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fce501a4390 con 0x7fce50109ca0 2024-02-05T07:17:32.467 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fce48001ba0 con 0x7fce50109ca0 2024-02-05T07:17:32.467 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 90645143 0 0) 0x7fce501a31f0 con 0x7fce50101b30 2024-02-05T07:17:32.467 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fce3c0035b0 con 0x7fce50101b30 2024-02-05T07:17:32.467 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fce400018c0 con 0x7fce50101b30 2024-02-05T07:17:32.467 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1491247531 0 0) 0x7fce50197a00 con 0x7fce50105f60 2024-02-05T07:17:32.467 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fce501a31f0 con 0x7fce50105f60 2024-02-05T07:17:32.467 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2030608905 0 0) 0x7fce501a4390 con 0x7fce50109ca0 2024-02-05T07:17:32.467 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 >> v1:172.21.15.184:6790/0 conn(0x7fce50105f60 legacy=0x7fce5019d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:32.467 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 >> v1:172.21.15.184:6789/0 conn(0x7fce50101b30 legacy=0x7fce50196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:32.467 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce501a5530 con 0x7fce50109ca0 2024-02-05T07:17:32.468 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce583ad700 1 -- 172.21.15.188:0/338554262 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce501a2240 con 0x7fce50109ca0 2024-02-05T07:17:32.468 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce583ad700 1 -- 172.21.15.188:0/338554262 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fce501a2740 con 0x7fce50109ca0 2024-02-05T07:17:32.468 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fce48003eb0 con 0x7fce50109ca0 2024-02-05T07:17:32.468 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.460+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fce48006010 con 0x7fce50109ca0 2024-02-05T07:17:32.468 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.461+0000 7fce583ad700 1 -- 172.21.15.188:0/338554262 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce34005150 con 0x7fce50109ca0 2024-02-05T07:17:32.468 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.462+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 16) v1 ==== 91423+0+0 (unknown 3189986717 0 0) 0x7fce48003a20 con 0x7fce50109ca0 2024-02-05T07:17:32.468 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.462+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(69..69 src has 1..69) v4 ==== 5942+0+0 (unknown 4052725624 0 0) 0x7fce48088aa0 con 0x7fce50109ca0 2024-02-05T07:17:32.468 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.466+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fce48052220 con 0x7fce50109ca0 2024-02-05T07:17:32.678 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.676+0000 7fce583ad700 1 -- 172.21.15.188:0/338554262 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi184=a;smithi188=b", "target": ["mon-mgr", ""]}) v1 -- 0x7fce34000bc0 con 0x7fce3c06ea60 2024-02-05T07:17:32.687 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.686+0000 7fce477fe700 1 -- 172.21.15.188:0/338554262 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (unknown 0 0 240551134) 0x7fce34000bc0 con 0x7fce3c06ea60 2024-02-05T07:17:32.688 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled node-exporter update... 2024-02-05T07:17:32.690 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.688+0000 7fce583ad700 1 -- 172.21.15.188:0/338554262 >> v1:172.21.15.184:6800/2865218501 conn(0x7fce3c06ea60 legacy=0x7fce3c070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:32.690 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.688+0000 7fce583ad700 1 -- 172.21.15.188:0/338554262 >> v1:172.21.15.188:6789/0 conn(0x7fce50109ca0 legacy=0x7fce501a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:32.690 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.688+0000 7fce583ad700 1 -- 172.21.15.188:0/338554262 shutdown_connections 2024-02-05T07:17:32.690 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.688+0000 7fce583ad700 1 -- 172.21.15.188:0/338554262 >> 172.21.15.188:0/338554262 conn(0x7fce500fd0d0 msgr2=0x7fce501083b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:32.690 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.688+0000 7fce583ad700 1 -- 172.21.15.188:0/338554262 shutdown_connections 2024-02-05T07:17:32.690 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:32.688+0000 7fce583ad700 1 -- 172.21.15.188:0/338554262 wait complete. 2024-02-05T07:17:33.297 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:33 smithi188 ceph-mon[33283]: pgmap v203: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 4.5 KiB/s wr, 143 op/s 2024-02-05T07:17:33.297 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:33 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:33.299 DEBUG:teuthology.orchestra.run.smithi184:node-exporter.a> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@node-exporter.a.service 2024-02-05T07:17:33.302 DEBUG:teuthology.orchestra.run.smithi188:node-exporter.b> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@node-exporter.b.service 2024-02-05T07:17:33.304 INFO:tasks.cephadm:Adding alertmanager.a on smithi184 2024-02-05T07:17:33.304 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch apply alertmanager '1;smithi184=a' 2024-02-05T07:17:33.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:33 smithi184 ceph-mon[29861]: pgmap v203: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 4.5 KiB/s wr, 143 op/s 2024-02-05T07:17:33.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:33 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:33.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:33 smithi184 ceph-mon[41609]: pgmap v203: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 59 KiB/s rd, 4.5 KiB/s wr, 143 op/s 2024-02-05T07:17:33.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:33 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:33.948 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:17:34.401 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:34 smithi188 ceph-mon[33283]: from='client.24472 v1:172.21.15.188:0/338554262' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi184=a;smithi188=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:34.401 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:34 smithi188 ceph-mon[33283]: Saving service node-exporter spec with placement smithi184=a;smithi188=b;count:2 2024-02-05T07:17:34.401 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:34 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:34.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:34 smithi184 ceph-mon[29861]: from='client.24472 v1:172.21.15.188:0/338554262' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi184=a;smithi188=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:34.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:34 smithi184 ceph-mon[29861]: Saving service node-exporter spec with placement smithi184=a;smithi188=b;count:2 2024-02-05T07:17:34.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:34 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:34.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:34 smithi184 ceph-mon[41609]: from='client.24472 v1:172.21.15.188:0/338554262' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi184=a;smithi188=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:34.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:34 smithi184 ceph-mon[41609]: Saving service node-exporter spec with placement smithi184=a;smithi188=b;count:2 2024-02-05T07:17:34.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:34 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:35.440 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:35 smithi188 ceph-mon[33283]: pgmap v204: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s rd, 3.9 KiB/s wr, 126 op/s 2024-02-05T07:17:35.441 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:35 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:35.441 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:35 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:35.441 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:35 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:35.441 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:35 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:17:35.441 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:35 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:35.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:35 smithi184 ceph-mon[29861]: pgmap v204: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s rd, 3.9 KiB/s wr, 126 op/s 2024-02-05T07:17:35.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:35 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:35.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:35 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:35.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:35 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:35.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:35 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:17:35.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:35 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:35 smithi184 ceph-mon[41609]: pgmap v204: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s rd, 3.9 KiB/s wr, 126 op/s 2024-02-05T07:17:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:35 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:35 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:35 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:17:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:35 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:17:35.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:35 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:36.122 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.120+0000 7f8475286700 1 -- 172.21.15.188:0/1695732649 >> v1:172.21.15.188:6789/0 conn(0x7f8470100a10 legacy=0x7f8470100e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:36.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.120+0000 7f8475286700 1 -- 172.21.15.188:0/1695732649 shutdown_connections 2024-02-05T07:17:36.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.120+0000 7f8475286700 1 -- 172.21.15.188:0/1695732649 >> 172.21.15.188:0/1695732649 conn(0x7f84700fbfb0 msgr2=0x7f84700fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:36.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.120+0000 7f8475286700 1 -- 172.21.15.188:0/1695732649 shutdown_connections 2024-02-05T07:17:36.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.120+0000 7f8475286700 1 -- 172.21.15.188:0/1695732649 wait complete. 2024-02-05T07:17:36.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.120+0000 7f8475286700 1 Processor -- start 2024-02-05T07:17:36.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.120+0000 7f8475286700 1 -- start start 2024-02-05T07:17:36.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8475286700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8470197990 con 0x7f8470108b80 2024-02-05T07:17:36.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8475286700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f84701a3180 con 0x7f8470104e40 2024-02-05T07:17:36.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8475286700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f84701a4320 con 0x7f8470100a10 2024-02-05T07:17:36.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f846e7fc700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f8470104e40 0x7f847019d320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:35298/0 (socket says 172.21.15.188:35298) 2024-02-05T07:17:36.123 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f846e7fc700 1 -- 172.21.15.188:0/676553844 learned_addr learned my addr 172.21.15.188:0/676553844 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:17:36.125 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933959719 0 0) 0x7f84701a3180 con 0x7f8470104e40 2024-02-05T07:17:36.125 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84580035b0 con 0x7f8470104e40 2024-02-05T07:17:36.125 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444184095 0 0) 0x7f84701a4320 con 0x7f8470100a10 2024-02-05T07:17:36.125 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84701a3180 con 0x7f8470100a10 2024-02-05T07:17:36.125 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114071482 0 0) 0x7f8470197990 con 0x7f8470108b80 2024-02-05T07:17:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84701a4320 con 0x7f8470108b80 2024-02-05T07:17:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3644483404 0 0) 0x7f84580035b0 con 0x7f8470104e40 2024-02-05T07:17:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8470197990 con 0x7f8470104e40 2024-02-05T07:17:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f8464001930 con 0x7f8470104e40 2024-02-05T07:17:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1179257792 0 0) 0x7f8470197990 con 0x7f8470104e40 2024-02-05T07:17:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 >> v1:172.21.15.184:6790/0 conn(0x7f8470100a10 legacy=0x7f8470196e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 >> v1:172.21.15.184:6789/0 conn(0x7f8470108b80 legacy=0x7f84701a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84701a54c0 con 0x7f8470104e40 2024-02-05T07:17:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8475286700 1 -- 172.21.15.188:0/676553844 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84701a4510 con 0x7f8470104e40 2024-02-05T07:17:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.121+0000 7f8475286700 1 -- 172.21.15.188:0/676553844 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f84701a4a10 con 0x7f8470104e40 2024-02-05T07:17:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.122+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f8464003b30 con 0x7f8470104e40 2024-02-05T07:17:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.122+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f8464005ca0 con 0x7f8470104e40 2024-02-05T07:17:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.122+0000 7f8475286700 1 -- 172.21.15.188:0/676553844 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c005150 con 0x7f8470104e40 2024-02-05T07:17:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.123+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 16) v1 ==== 91423+0+0 (unknown 3189986717 0 0) 0x7f84640036a0 con 0x7f8470104e40 2024-02-05T07:17:36.126 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.123+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(69..69 src has 1..69) v4 ==== 5942+0+0 (unknown 4052725624 0 0) 0x7f8464088890 con 0x7f8470104e40 2024-02-05T07:17:36.130 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.128+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f8464052030 con 0x7f8470104e40 2024-02-05T07:17:36.353 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.351+0000 7f8475286700 1 -- 172.21.15.188:0/676553844 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi184=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f845c000bc0 con 0x7f845806e5e0 2024-02-05T07:17:36.363 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.361+0000 7f8457fff700 1 -- 172.21.15.188:0/676553844 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (unknown 0 0 1850065467) 0x7f845c000bc0 con 0x7f845806e5e0 2024-02-05T07:17:36.363 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled alertmanager update... 2024-02-05T07:17:36.366 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.363+0000 7f8475286700 1 -- 172.21.15.188:0/676553844 >> v1:172.21.15.184:6800/2865218501 conn(0x7f845806e5e0 legacy=0x7f8458070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:36.366 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.363+0000 7f8475286700 1 -- 172.21.15.188:0/676553844 >> v1:172.21.15.188:6789/0 conn(0x7f8470104e40 legacy=0x7f847019d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:36.366 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.363+0000 7f8475286700 1 -- 172.21.15.188:0/676553844 shutdown_connections 2024-02-05T07:17:36.366 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.363+0000 7f8475286700 1 -- 172.21.15.188:0/676553844 >> 172.21.15.188:0/676553844 conn(0x7f84700fbfb0 msgr2=0x7f8470107230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:36.366 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.363+0000 7f8475286700 1 -- 172.21.15.188:0/676553844 shutdown_connections 2024-02-05T07:17:36.366 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:36.363+0000 7f8475286700 1 -- 172.21.15.188:0/676553844 wait complete. 2024-02-05T07:17:36.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:36 smithi188 ceph-mon[33283]: Deploying daemon prometheus.a on smithi188 2024-02-05T07:17:36.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:36 smithi184 ceph-mon[29861]: Deploying daemon prometheus.a on smithi188 2024-02-05T07:17:36.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:36 smithi184 ceph-mon[41609]: Deploying daemon prometheus.a on smithi188 2024-02-05T07:17:37.363 DEBUG:teuthology.orchestra.run.smithi184:alertmanager.a> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@alertmanager.a.service 2024-02-05T07:17:37.366 INFO:tasks.cephadm:Adding grafana.a on smithi188 2024-02-05T07:17:37.366 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph orch apply grafana '1;smithi188=a' 2024-02-05T07:17:37.628 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:17:37.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:37 smithi184 ceph-mon[29861]: pgmap v205: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 3.4 KiB/s wr, 112 op/s 2024-02-05T07:17:37.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:37 smithi184 ceph-mon[29861]: from='client.24478 v1:172.21.15.188:0/676553844' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi184=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:37.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:37 smithi184 ceph-mon[29861]: Saving service alertmanager spec with placement smithi184=a;count:1 2024-02-05T07:17:37.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:37 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:37.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:37 smithi184 ceph-mon[41609]: pgmap v205: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 3.4 KiB/s wr, 112 op/s 2024-02-05T07:17:37.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:37 smithi184 ceph-mon[41609]: from='client.24478 v1:172.21.15.188:0/676553844' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi184=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:37.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:37 smithi184 ceph-mon[41609]: Saving service alertmanager spec with placement smithi184=a;count:1 2024-02-05T07:17:37.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:37 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:37.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:37 smithi188 ceph-mon[33283]: pgmap v205: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 46 KiB/s rd, 3.4 KiB/s wr, 112 op/s 2024-02-05T07:17:37.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:37 smithi188 ceph-mon[33283]: from='client.24478 v1:172.21.15.188:0/676553844' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi184=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:37.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:37 smithi188 ceph-mon[33283]: Saving service alertmanager spec with placement smithi184=a;count:1 2024-02-05T07:17:37.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:37 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:38.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:38 smithi188 ceph-mon[33283]: pgmap v206: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 1.9 KiB/s wr, 62 op/s 2024-02-05T07:17:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:38 smithi184 ceph-mon[29861]: pgmap v206: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 1.9 KiB/s wr, 62 op/s 2024-02-05T07:17:38.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:38 smithi184 ceph-mon[41609]: pgmap v206: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 26 KiB/s rd, 1.9 KiB/s wr, 62 op/s 2024-02-05T07:17:40.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:40 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:40.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:40 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:40.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:40 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:40.866 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.837+0000 7f07ab81e700 1 -- 172.21.15.188:0/1821713308 >> v1:172.21.15.188:6789/0 conn(0x7f07a4104e40 legacy=0x7f07a4107290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:40.866 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.837+0000 7f07ab81e700 1 -- 172.21.15.188:0/1821713308 shutdown_connections 2024-02-05T07:17:40.866 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.837+0000 7f07ab81e700 1 -- 172.21.15.188:0/1821713308 >> 172.21.15.188:0/1821713308 conn(0x7f07a40fbfb0 msgr2=0x7f07a40fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:40.866 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.838+0000 7f07ab81e700 1 -- 172.21.15.188:0/1821713308 shutdown_connections 2024-02-05T07:17:40.866 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.838+0000 7f07ab81e700 1 -- 172.21.15.188:0/1821713308 wait complete. 2024-02-05T07:17:40.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.838+0000 7f07ab81e700 1 Processor -- start 2024-02-05T07:17:40.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.838+0000 7f07ab81e700 1 -- start start 2024-02-05T07:17:40.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f07ab81e700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f07a406a560 con 0x7f07a4108b80 2024-02-05T07:17:40.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f07ab81e700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f07a41a3120 con 0x7f07a4100a10 2024-02-05T07:17:40.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f07ab81e700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f07a41a42c0 con 0x7f07a4104e40 2024-02-05T07:17:40.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f07a95ba700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f07a4100a10 0x7f07a4199b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:57018/0 (socket says 172.21.15.188:57018) 2024-02-05T07:17:40.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f07a95ba700 1 -- 172.21.15.188:0/1035659603 learned_addr learned my addr 172.21.15.188:0/1035659603 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:17:40.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550860437 0 0) 0x7f07a41a3120 con 0x7f07a4100a10 2024-02-05T07:17:40.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07900035b0 con 0x7f07a4100a10 2024-02-05T07:17:40.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454657606 0 0) 0x7f07a41a42c0 con 0x7f07a4104e40 2024-02-05T07:17:40.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a41a3120 con 0x7f07a4104e40 2024-02-05T07:17:40.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673513032 0 0) 0x7f07a406a560 con 0x7f07a4108b80 2024-02-05T07:17:40.867 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a41a42c0 con 0x7f07a4108b80 2024-02-05T07:17:40.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3932590938 0 0) 0x7f07900035b0 con 0x7f07a4100a10 2024-02-05T07:17:40.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f07a406a560 con 0x7f07a4100a10 2024-02-05T07:17:40.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f07a0001870 con 0x7f07a4100a10 2024-02-05T07:17:40.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1062448194 0 0) 0x7f07a41a3120 con 0x7f07a4104e40 2024-02-05T07:17:40.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f07900035b0 con 0x7f07a4104e40 2024-02-05T07:17:40.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f07940044b0 con 0x7f07a4104e40 2024-02-05T07:17:40.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1024574628 0 0) 0x7f07a41a42c0 con 0x7f07a4108b80 2024-02-05T07:17:40.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.839+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f07a41a3120 con 0x7f07a4108b80 2024-02-05T07:17:40.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.840+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f079c001af0 con 0x7f07a4108b80 2024-02-05T07:17:40.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.840+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2612712604 0 0) 0x7f07a406a560 con 0x7f07a4100a10 2024-02-05T07:17:40.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.840+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 >> v1:172.21.15.184:6790/0 conn(0x7f07a4104e40 legacy=0x7f07a419d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:40.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.840+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 >> v1:172.21.15.184:6789/0 conn(0x7f07a4108b80 legacy=0x7f07a41a09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:40.868 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.840+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a41a54c0 con 0x7f07a4100a10 2024-02-05T07:17:40.869 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.840+0000 7f07ab81e700 1 -- 172.21.15.188:0/1035659603 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a41a44b0 con 0x7f07a4100a10 2024-02-05T07:17:40.869 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.840+0000 7f07ab81e700 1 -- 172.21.15.188:0/1035659603 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a41a49b0 con 0x7f07a4100a10 2024-02-05T07:17:40.869 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.840+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f07a0003b30 con 0x7f07a4100a10 2024-02-05T07:17:40.869 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.840+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f07a0005bf0 con 0x7f07a4100a10 2024-02-05T07:17:40.869 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.841+0000 7f07ab81e700 1 -- 172.21.15.188:0/1035659603 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0788005150 con 0x7f07a4100a10 2024-02-05T07:17:40.869 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.841+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 16) v1 ==== 91423+0+0 (unknown 3189986717 0 0) 0x7f07a001c360 con 0x7f07a4100a10 2024-02-05T07:17:40.869 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.842+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(69..69 src has 1..69) v4 ==== 5942+0+0 (unknown 4052725624 0 0) 0x7f07a0088830 con 0x7f07a4100a10 2024-02-05T07:17:40.869 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:40.846+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f07a0051fb0 con 0x7f07a4100a10 2024-02-05T07:17:41.067 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:41.064+0000 7f07ab81e700 1 -- 172.21.15.188:0/1035659603 --> v1:172.21.15.184:6800/2865218501 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi188=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f0788000bc0 con 0x7f079006e9d0 2024-02-05T07:17:41.073 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:41.071+0000 7f079a7fc700 1 -- 172.21.15.188:0/1035659603 <== mgr.14150 v1:172.21.15.184:6800/2865218501 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (unknown 0 0 664801700) 0x7f0788000bc0 con 0x7f079006e9d0 2024-02-05T07:17:41.074 INFO:teuthology.orchestra.run.smithi188.stdout:Scheduled grafana update... 2024-02-05T07:17:41.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:41.074+0000 7f07ab81e700 1 -- 172.21.15.188:0/1035659603 >> v1:172.21.15.184:6800/2865218501 conn(0x7f079006e9d0 legacy=0x7f0790070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:41.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:41.074+0000 7f07ab81e700 1 -- 172.21.15.188:0/1035659603 >> v1:172.21.15.188:6789/0 conn(0x7f07a4100a10 legacy=0x7f07a4199b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:41.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:41.074+0000 7f07ab81e700 1 -- 172.21.15.188:0/1035659603 shutdown_connections 2024-02-05T07:17:41.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:41.074+0000 7f07ab81e700 1 -- 172.21.15.188:0/1035659603 >> 172.21.15.188:0/1035659603 conn(0x7f07a40fbfb0 msgr2=0x7f07a4107290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:41.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:41.074+0000 7f07ab81e700 1 -- 172.21.15.188:0/1035659603 shutdown_connections 2024-02-05T07:17:41.076 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:41.074+0000 7f07ab81e700 1 -- 172.21.15.188:0/1035659603 wait complete. 2024-02-05T07:17:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:41 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:17:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:41 smithi188 ceph-mon[33283]: pgmap v207: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 834 B/s wr, 31 op/s 2024-02-05T07:17:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:41 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:41.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:41 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:17:41.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:41 smithi184 ceph-mon[29861]: pgmap v207: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 834 B/s wr, 31 op/s 2024-02-05T07:17:41.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:41 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:41.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:41 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:17:41.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:41 smithi184 ceph-mon[41609]: pgmap v207: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 13 KiB/s rd, 834 B/s wr, 31 op/s 2024-02-05T07:17:41.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:41 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:42.253 DEBUG:teuthology.orchestra.run.smithi188:grafana.a> sudo journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@grafana.a.service 2024-02-05T07:17:42.255 INFO:tasks.cephadm:Setting up client nodes... 2024-02-05T07:17:42.255 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-05T07:17:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:42 smithi188 ceph-mon[33283]: from='client.24484 v1:172.21.15.188:0/1035659603' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi188=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:42 smithi188 ceph-mon[33283]: Saving service grafana spec with placement smithi188=a;count:1 2024-02-05T07:17:42.509 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:17:42.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:42 smithi184 ceph-mon[29861]: from='client.24484 v1:172.21.15.188:0/1035659603' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi188=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:42.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:42 smithi184 ceph-mon[29861]: Saving service grafana spec with placement smithi188=a;count:1 2024-02-05T07:17:42.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:42 smithi184 ceph-mon[41609]: from='client.24484 v1:172.21.15.188:0/1035659603' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi188=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-05T07:17:42.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:42 smithi184 ceph-mon[41609]: Saving service grafana spec with placement smithi188=a;count:1 2024-02-05T07:17:43.514 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:43 smithi188 ceph-mon[33283]: pgmap v208: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 85 B/s wr, 1 op/s 2024-02-05T07:17:43.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:43 smithi184 ceph-mon[29861]: pgmap v208: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 85 B/s wr, 1 op/s 2024-02-05T07:17:43.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:43 smithi184 ceph-mon[41609]: pgmap v208: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 85 B/s wr, 1 op/s 2024-02-05T07:17:44.270 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.268+0000 7ffb64db0700 1 -- 172.21.15.184:0/933728698 >> v1:172.21.15.184:6790/0 conn(0x7ffb60108b60 legacy=0x7ffb6010b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:44.271 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.268+0000 7ffb64db0700 1 -- 172.21.15.184:0/933728698 shutdown_connections 2024-02-05T07:17:44.271 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.268+0000 7ffb64db0700 1 -- 172.21.15.184:0/933728698 >> 172.21.15.184:0/933728698 conn(0x7ffb600fbfb0 msgr2=0x7ffb600fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:44.271 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.268+0000 7ffb64db0700 1 -- 172.21.15.184:0/933728698 shutdown_connections 2024-02-05T07:17:44.271 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.268+0000 7ffb64db0700 1 -- 172.21.15.184:0/933728698 wait complete. 2024-02-05T07:17:44.273 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.269+0000 7ffb64db0700 1 Processor -- start 2024-02-05T07:17:44.273 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.269+0000 7ffb64db0700 1 -- start start 2024-02-05T07:17:44.273 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.269+0000 7ffb64db0700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ffb6006a5c0 con 0x7ffb60108b60 2024-02-05T07:17:44.273 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.269+0000 7ffb64db0700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ffb601a2f80 con 0x7ffb601009f0 2024-02-05T07:17:44.273 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.269+0000 7ffb64db0700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ffb601a4180 con 0x7ffb60104e20 2024-02-05T07:17:44.273 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.269+0000 7ffb5dd9b700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7ffb60104e20 0x7ffb6019d120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:59692/0 (socket says 172.21.15.184:59692) 2024-02-05T07:17:44.273 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.269+0000 7ffb5dd9b700 1 -- 172.21.15.184:0/2006636843 learned_addr learned my addr 172.21.15.184:0/2006636843 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:17:44.273 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.269+0000 7ffb5ed9d700 1 --1- 172.21.15.184:0/2006636843 >> v1:172.21.15.184:6789/0 conn(0x7ffb60108b60 0x7ffb601a0850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:52842/0 (socket says 172.21.15.184:52842) 2024-02-05T07:17:44.273 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272502131 0 0) 0x7ffb601a2f80 con 0x7ffb601009f0 2024-02-05T07:17:44.273 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb48005070 con 0x7ffb601009f0 2024-02-05T07:17:44.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584798319 0 0) 0x7ffb6006a5c0 con 0x7ffb60108b60 2024-02-05T07:17:44.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb601a2f80 con 0x7ffb60108b60 2024-02-05T07:17:44.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154739117 0 0) 0x7ffb601a4180 con 0x7ffb60104e20 2024-02-05T07:17:44.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb6006a5c0 con 0x7ffb60104e20 2024-02-05T07:17:44.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3782745529 0 0) 0x7ffb601a2f80 con 0x7ffb60108b60 2024-02-05T07:17:44.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffb601a4180 con 0x7ffb60108b60 2024-02-05T07:17:44.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7ffb58004650 con 0x7ffb60108b60 2024-02-05T07:17:44.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2043000484 0 0) 0x7ffb48005070 con 0x7ffb601009f0 2024-02-05T07:17:44.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffb601a2f80 con 0x7ffb601009f0 2024-02-05T07:17:44.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3487376421 0 0) 0x7ffb6006a5c0 con 0x7ffb60104e20 2024-02-05T07:17:44.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffb48005070 con 0x7ffb60104e20 2024-02-05T07:17:44.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7ffb50001850 con 0x7ffb601009f0 2024-02-05T07:17:44.274 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7ffb540017f0 con 0x7ffb60104e20 2024-02-05T07:17:44.275 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3272651501 0 0) 0x7ffb601a4180 con 0x7ffb60108b60 2024-02-05T07:17:44.275 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 >> v1:172.21.15.184:6790/0 conn(0x7ffb60104e20 legacy=0x7ffb6019d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:44.275 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 >> v1:172.21.15.188:6789/0 conn(0x7ffb601009f0 legacy=0x7ffb601999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:44.275 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb601a5380 con 0x7ffb60108b60 2024-02-05T07:17:44.275 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb64db0700 1 -- 172.21.15.184:0/2006636843 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb601a3170 con 0x7ffb60108b60 2024-02-05T07:17:44.275 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb64db0700 1 -- 172.21.15.184:0/2006636843 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb601a3670 con 0x7ffb60108b60 2024-02-05T07:17:44.275 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7ffb58001df0 con 0x7ffb60108b60 2024-02-05T07:17:44.275 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.270+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7ffb58005210 con 0x7ffb60108b60 2024-02-05T07:17:44.276 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.271+0000 7ffb64db0700 1 -- 172.21.15.184:0/2006636843 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb40005150 con 0x7ffb60108b60 2024-02-05T07:17:44.276 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.272+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 16) v1 ==== 91423+0+0 (unknown 3189986717 0 0) 0x7ffb58005370 con 0x7ffb60108b60 2024-02-05T07:17:44.276 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.272+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(69..69 src has 1..69) v4 ==== 5942+0+0 (unknown 4052725624 0 0) 0x7ffb58088d90 con 0x7ffb60108b60 2024-02-05T07:17:44.278 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.277+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7ffb58052510 con 0x7ffb60108b60 2024-02-05T07:17:44.553 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.551+0000 7ffb64db0700 1 -- 172.21.15.184:0/2006636843 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7ffb40005400 con 0x7ffb60108b60 2024-02-05T07:17:44.555 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.553+0000 7ffb4f7fe700 1 -- 172.21.15.184:0/2006636843 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (unknown 57899324 0 1808166071) 0x7ffb58054440 con 0x7ffb60108b60 2024-02-05T07:17:44.555 INFO:teuthology.orchestra.run.smithi184.stdout:[client.0] 2024-02-05T07:17:44.555 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQCYi8BlKOvyIBAAEDRbsAqATYr3FBM4H2Y0Ig== 2024-02-05T07:17:44.558 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.556+0000 7ffb64db0700 1 -- 172.21.15.184:0/2006636843 >> v1:172.21.15.184:6800/2865218501 conn(0x7ffb4806ea90 legacy=0x7ffb48070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:44.558 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.556+0000 7ffb64db0700 1 -- 172.21.15.184:0/2006636843 >> v1:172.21.15.184:6789/0 conn(0x7ffb60108b60 legacy=0x7ffb601a0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:44.558 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.556+0000 7ffb64db0700 1 -- 172.21.15.184:0/2006636843 shutdown_connections 2024-02-05T07:17:44.558 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.556+0000 7ffb64db0700 1 -- 172.21.15.184:0/2006636843 >> 172.21.15.184:0/2006636843 conn(0x7ffb600fbfb0 msgr2=0x7ffb601079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:44.558 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.556+0000 7ffb64db0700 1 -- 172.21.15.184:0/2006636843 shutdown_connections 2024-02-05T07:17:44.558 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:44.556+0000 7ffb64db0700 1 -- 172.21.15.184:0/2006636843 wait complete. 2024-02-05T07:17:45.193 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:17:45.193 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-05T07:17:45.193 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-05T07:17:45.236 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-05T07:17:45.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:45 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-05T07:17:45.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:45 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-05T07:17:45.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:45 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-05T07:17:45.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:45 smithi188 ceph-mon[33283]: pgmap v209: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:17:45.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2006636843' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-05T07:17:45.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2006636843' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-05T07:17:45.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:45 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-05T07:17:45.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:45 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-05T07:17:45.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:45 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-05T07:17:45.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:45 smithi184 ceph-mon[41609]: pgmap v209: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:17:45.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2006636843' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-05T07:17:45.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2006636843' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-05T07:17:45.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-05T07:17:45.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-05T07:17:45.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:45 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2024-02-05T07:17:45.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:45 smithi184 ceph-mon[29861]: pgmap v209: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:17:45.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2006636843' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-05T07:17:45.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2006636843' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-05T07:17:46.009 INFO:teuthology.orchestra.run.smithi188.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.b/config 2024-02-05T07:17:46.404 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:46 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]': finished 2024-02-05T07:17:46.404 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:46 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-02-05T07:17:46.404 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:46 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]': finished 2024-02-05T07:17:46.404 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:46 smithi188 ceph-mon[33283]: osdmap e70: 8 total, 8 up, 8 in 2024-02-05T07:17:46.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:46 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]': finished 2024-02-05T07:17:46.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:46 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-02-05T07:17:46.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:46 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]': finished 2024-02-05T07:17:46.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:46 smithi184 ceph-mon[29861]: osdmap e70: 8 total, 8 up, 8 in 2024-02-05T07:17:46.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:46 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]': finished 2024-02-05T07:17:46.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:46 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]': finished 2024-02-05T07:17:46.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:46 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]': finished 2024-02-05T07:17:46.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:46 smithi184 ceph-mon[41609]: osdmap e70: 8 total, 8 up, 8 in 2024-02-05T07:17:47.418 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:47 smithi188 ceph-mon[33283]: osdmap e71: 8 total, 8 up, 8 in 2024-02-05T07:17:47.418 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:47 smithi188 ceph-mon[33283]: pgmap v212: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:17:47.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:47 smithi184 ceph-mon[29861]: osdmap e71: 8 total, 8 up, 8 in 2024-02-05T07:17:47.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:47 smithi184 ceph-mon[29861]: pgmap v212: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:17:47.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:47 smithi184 ceph-mon[41609]: osdmap e71: 8 total, 8 up, 8 in 2024-02-05T07:17:47.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:47 smithi184 ceph-mon[41609]: pgmap v212: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:17:47.666 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.663+0000 7f9884ea9700 1 -- 172.21.15.188:0/1753196037 >> v1:172.21.15.188:6789/0 conn(0x7f9880108b60 legacy=0x7f988010b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:47.666 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.663+0000 7f9884ea9700 1 -- 172.21.15.188:0/1753196037 shutdown_connections 2024-02-05T07:17:47.666 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.663+0000 7f9884ea9700 1 -- 172.21.15.188:0/1753196037 >> 172.21.15.188:0/1753196037 conn(0x7f98800fbfb0 msgr2=0x7f98800fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:47.666 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.663+0000 7f9884ea9700 1 -- 172.21.15.188:0/1753196037 shutdown_connections 2024-02-05T07:17:47.666 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.663+0000 7f9884ea9700 1 -- 172.21.15.188:0/1753196037 wait complete. 2024-02-05T07:17:47.666 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.664+0000 7f9884ea9700 1 Processor -- start 2024-02-05T07:17:47.666 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.664+0000 7f9884ea9700 1 -- start start 2024-02-05T07:17:47.666 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.664+0000 7f9884ea9700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f988006a560 con 0x7f98801009f0 2024-02-05T07:17:47.667 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.664+0000 7f9884ea9700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f98801a3160 con 0x7f9880108b60 2024-02-05T07:17:47.667 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.664+0000 7f9884ea9700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f98801a4300 con 0x7f9880104e20 2024-02-05T07:17:47.667 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.664+0000 7f987ed9d700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f9880108b60 0x7f98801a0a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.188:57028/0 (socket says 172.21.15.188:57028) 2024-02-05T07:17:47.667 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.664+0000 7f987ed9d700 1 -- 172.21.15.188:0/2451619802 learned_addr learned my addr 172.21.15.188:0/2451619802 (peer_addr_for_me v1:172.21.15.188:0/0) 2024-02-05T07:17:47.669 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.664+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687141715 0 0) 0x7f98801a3160 con 0x7f9880108b60 2024-02-05T07:17:47.669 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.664+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98680035b0 con 0x7f9880108b60 2024-02-05T07:17:47.669 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.664+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1372156144 0 0) 0x7f98801a4300 con 0x7f9880104e20 2024-02-05T07:17:47.669 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.664+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98801a3160 con 0x7f9880104e20 2024-02-05T07:17:47.669 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.664+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 882980586 0 0) 0x7f988006a560 con 0x7f98801009f0 2024-02-05T07:17:47.669 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.664+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98801a4300 con 0x7f98801009f0 2024-02-05T07:17:47.669 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2104404376 0 0) 0x7f98680035b0 con 0x7f9880108b60 2024-02-05T07:17:47.669 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f988006a560 con 0x7f9880108b60 2024-02-05T07:17:47.669 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f98780017b0 con 0x7f9880108b60 2024-02-05T07:17:47.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1846552245 0 0) 0x7f98801a3160 con 0x7f9880104e20 2024-02-05T07:17:47.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f98680035b0 con 0x7f9880104e20 2024-02-05T07:17:47.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2889026886 0 0) 0x7f98801a4300 con 0x7f98801009f0 2024-02-05T07:17:47.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f98801a3160 con 0x7f98801009f0 2024-02-05T07:17:47.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f98740017e0 con 0x7f9880104e20 2024-02-05T07:17:47.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9870001830 con 0x7f98801009f0 2024-02-05T07:17:47.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 610476451 0 0) 0x7f988006a560 con 0x7f9880108b60 2024-02-05T07:17:47.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 >> v1:172.21.15.184:6790/0 conn(0x7f9880104e20 legacy=0x7f988019d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:47.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 >> v1:172.21.15.184:6789/0 conn(0x7f98801009f0 legacy=0x7f9880199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:47.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98801a5500 con 0x7f9880108b60 2024-02-05T07:17:47.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f9884ea9700 1 -- 172.21.15.188:0/2451619802 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98801a44f0 con 0x7f9880108b60 2024-02-05T07:17:47.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f9884ea9700 1 -- 172.21.15.188:0/2451619802 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f98801a49f0 con 0x7f9880108b60 2024-02-05T07:17:47.670 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f9878001ef0 con 0x7f9880108b60 2024-02-05T07:17:47.671 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.665+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9878005340 con 0x7f9880108b60 2024-02-05T07:17:47.671 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.666+0000 7f9884ea9700 1 -- 172.21.15.188:0/2451619802 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9860005150 con 0x7f9880108b60 2024-02-05T07:17:47.671 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.666+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 16) v1 ==== 91423+0+0 (unknown 3189986717 0 0) 0x7f9878005540 con 0x7f9880108b60 2024-02-05T07:17:47.671 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.667+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(71..71 src has 1..71) v4 ==== 6001+0+0 (unknown 2067935021 0 0) 0x7f9878088e80 con 0x7f9880108b60 2024-02-05T07:17:47.673 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.671+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f9878052540 con 0x7f9880108b60 2024-02-05T07:17:47.953 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.950+0000 7f9884ea9700 1 -- 172.21.15.188:0/2451619802 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f9860005400 con 0x7f9880108b60 2024-02-05T07:17:47.953 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:47 smithi188 podman[64194]: 2024-02-05 07:17:47.793477935 +0000 UTC m=+0.378319497 container create 69763a4bcbf22f7d7afa001dc409759808ae26968eff5b66a4000d3eb2c9bd0e (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-02-05T07:17:47.957 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.955+0000 7f986f7fe700 1 -- 172.21.15.188:0/2451619802 <== mon.1 v1:172.21.15.188:6789/0 10 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) v1 ==== 170+0+59 (unknown 3508017507 0 1103987794) 0x7f9878054470 con 0x7f9880108b60 2024-02-05T07:17:47.957 INFO:teuthology.orchestra.run.smithi188.stdout:[client.1] 2024-02-05T07:17:47.957 INFO:teuthology.orchestra.run.smithi188.stdout: key = AQCbi8BlNc/POBAAjuv84n5DnY/ozYQbEncTRQ== 2024-02-05T07:17:47.960 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.957+0000 7f9884ea9700 1 -- 172.21.15.188:0/2451619802 >> v1:172.21.15.184:6800/2865218501 conn(0x7f986806ea70 legacy=0x7f9868070f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:47.960 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.957+0000 7f9884ea9700 1 -- 172.21.15.188:0/2451619802 >> v1:172.21.15.188:6789/0 conn(0x7f9880108b60 legacy=0x7f98801a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:47.960 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.957+0000 7f9884ea9700 1 -- 172.21.15.188:0/2451619802 shutdown_connections 2024-02-05T07:17:47.960 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.957+0000 7f9884ea9700 1 -- 172.21.15.188:0/2451619802 >> 172.21.15.188:0/2451619802 conn(0x7f98800fbfb0 msgr2=0x7f988010b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:47.960 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.957+0000 7f9884ea9700 1 -- 172.21.15.188:0/2451619802 shutdown_connections 2024-02-05T07:17:47.960 INFO:teuthology.orchestra.run.smithi188.stderr:2024-02-05T07:17:47.957+0000 7f9884ea9700 1 -- 172.21.15.188:0/2451619802 wait complete. 2024-02-05T07:17:48.217 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.188:0/2451619802' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-05T07:17:48.217 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-mon[33283]: from='client.24496 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-05T07:17:48.217 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-mon[33283]: from='client.24496 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-05T07:17:48.217 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 podman[64194]: 2024-02-05 07:17:48.03744733 +0000 UTC m=+0.622288891 container init 69763a4bcbf22f7d7afa001dc409759808ae26968eff5b66a4000d3eb2c9bd0e (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-02-05T07:17:48.217 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 podman[64194]: 2024-02-05 07:17:48.043058187 +0000 UTC m=+0.627899750 container start 69763a4bcbf22f7d7afa001dc409759808ae26968eff5b66a4000d3eb2c9bd0e (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-02-05T07:17:48.218 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.066Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-02-05T07:17:48.218 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.066Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-02-05T07:17:48.218 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.066Z caller=main.go:570 level=info host_details="(Linux 5.14.0-416.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jan 31 22:52:48 UTC 2024 x86_64 smithi188 (none))" 2024-02-05T07:17:48.218 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.066Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-05T07:17:48.218 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.066Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-05T07:17:48.218 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.068Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-02-05T07:17:48.218 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.069Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-02-05T07:17:48.218 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.070Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-02-05T07:17:48.218 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.070Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-02-05T07:17:48.218 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.071Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-05T07:17:48.218 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.071Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.472µs 2024-02-05T07:17:48.218 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.071Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-05T07:17:48.218 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.071Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-02-05T07:17:48.219 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.072Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=17.101µs wal_replay_duration=337.911µs wbl_replay_duration=108ns total_replay_duration=376.275µs 2024-02-05T07:17:48.219 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.072Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-02-05T07:17:48.219 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.072Z caller=main.go:1029 level=info msg="TSDB started" 2024-02-05T07:17:48.219 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.072Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-05T07:17:48.219 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.090Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=18.008376ms db_storage=739ns remote_storage=1.158µs web_handler=316ns query_engine=472ns scrape=681.163µs scrape_sd=122.068µs notify=1.173µs notify_sd=2.467µs rules=17.02741ms tracing=5.84µs 2024-02-05T07:17:48.219 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.090Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-02-05T07:17:48.219 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:17:48.090Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-02-05T07:17:48.219 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 bash[64194]: 69763a4bcbf22f7d7afa001dc409759808ae26968eff5b66a4000d3eb2c9bd0e 2024-02-05T07:17:48.499 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:17:48 smithi188 systemd[1]: Started Ceph prometheus.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:17:48.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:48 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.188:0/2451619802' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-05T07:17:48.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:48 smithi184 ceph-mon[29861]: from='client.24496 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-05T07:17:48.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:48 smithi184 ceph-mon[29861]: from='client.24496 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-05T07:17:48.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:48 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.188:0/2451619802' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-05T07:17:48.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:48 smithi184 ceph-mon[41609]: from='client.24496 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-05T07:17:48.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:48 smithi184 ceph-mon[41609]: from='client.24496 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-05T07:17:49.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-mon[29861]: pgmap v213: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 27 B/s, 1 objects/s recovering 2024-02-05T07:17:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-05T07:17:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:49.522 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ignoring --setuser ceph since I am not root 2024-02-05T07:17:49.522 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ignoring --setgroup ceph since I am not root 2024-02-05T07:17:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-mon[41609]: pgmap v213: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 27 B/s, 1 objects/s recovering 2024-02-05T07:17:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-05T07:17:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:49 smithi188 ceph-mon[33283]: pgmap v213: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 27 B/s, 1 objects/s recovering 2024-02-05T07:17:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:49 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:49 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:49 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:49 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-05T07:17:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:49 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' 2024-02-05T07:17:49.749 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: ignoring --setuser ceph since I am not root 2024-02-05T07:17:49.750 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: ignoring --setgroup ceph since I am not root 2024-02-05T07:17:50.185 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:49.887+0000 7f0d2862b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-05T07:17:50.185 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:49.981+0000 7f0d2862b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-05T07:17:50.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:49.883+0000 7f9784c69200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-05T07:17:50.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:49 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:49.976+0000 7f9784c69200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-05T07:17:50.469 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:50 smithi188 ceph-mon[33283]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-05T07:17:50.469 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:50 smithi188 ceph-mon[33283]: mgrmap e17: y(active, since 5m), standbys: x 2024-02-05T07:17:50.498 DEBUG:teuthology.orchestra.run.smithi188:> set -ex 2024-02-05T07:17:50.498 DEBUG:teuthology.orchestra.run.smithi188:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-05T07:17:50.499 DEBUG:teuthology.orchestra.run.smithi188:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-05T07:17:50.583 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-05T07:17:50.583 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-05T07:17:50.583 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph mgr dump --format=json 2024-02-05T07:17:50.610 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:50 smithi184 ceph-mon[29861]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-05T07:17:50.610 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:50 smithi184 ceph-mon[29861]: mgrmap e17: y(active, since 5m), standbys: x 2024-02-05T07:17:50.610 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:50 smithi184 ceph-mon[41609]: from='mgr.14150 v1:172.21.15.184:0/1849755500' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-05T07:17:50.610 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:50 smithi184 ceph-mon[41609]: mgrmap e17: y(active, since 5m), standbys: x 2024-02-05T07:17:50.733 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:50.637+0000 7f0d2862b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-05T07:17:50.733 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:50.730+0000 7f0d2862b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-05T07:17:50.826 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:17:50.869 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:50 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:50.617+0000 7f9784c69200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-05T07:17:50.870 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:50 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:50.711+0000 7f9784c69200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-05T07:17:50.870 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:50 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:50.867+0000 7f9784c69200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-05T07:17:50.999 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:50.874+0000 7f0d2862b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-05T07:17:50.999 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:50.968+0000 7f0d2862b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-05T07:17:51.131 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:50 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:50.965+0000 7f9784c69200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-05T07:17:51.131 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:51.049+0000 7f9784c69200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-05T07:17:51.316 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:51.051+0000 7f0d2862b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-05T07:17:51.521 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:51.339+0000 7f9784c69200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-05T07:17:51.521 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:51.449+0000 7f9784c69200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-05T07:17:51.606 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:51.314+0000 7f0d2862b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-05T07:17:51.606 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:51.423+0000 7f0d2862b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-05T07:17:51.606 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:51.508+0000 7f0d2862b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-05T07:17:51.606 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:51.603+0000 7f0d2862b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-05T07:17:51.815 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:51.536+0000 7f9784c69200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-05T07:17:51.815 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:51.633+0000 7f9784c69200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-05T07:17:51.816 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:51.813+0000 7f9784c69200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-05T07:17:51.999 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:51.780+0000 7f0d2862b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-05T07:17:52.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.570+0000 7fe1af559700 1 -- 172.21.15.184:0/1689480958 >> v1:172.21.15.184:6790/0 conn(0x7fe1a810e560 legacy=0x7fe1a8110a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:52.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.570+0000 7fe1af559700 1 -- 172.21.15.184:0/1689480958 shutdown_connections 2024-02-05T07:17:52.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.570+0000 7fe1af559700 1 -- 172.21.15.184:0/1689480958 >> 172.21.15.184:0/1689480958 conn(0x7fe1a80fd5f0 msgr2=0x7fe1a80ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:52.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.571+0000 7fe1af559700 1 -- 172.21.15.184:0/1689480958 shutdown_connections 2024-02-05T07:17:52.573 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.571+0000 7fe1af559700 1 -- 172.21.15.184:0/1689480958 wait complete. 2024-02-05T07:17:52.576 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.571+0000 7fe1af559700 1 Processor -- start 2024-02-05T07:17:52.576 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.571+0000 7fe1af559700 1 -- start start 2024-02-05T07:17:52.576 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe1af559700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe1a81a69c0 con 0x7fe1a810a990 2024-02-05T07:17:52.576 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe1af559700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe1a81a7bc0 con 0x7fe1a810e560 2024-02-05T07:17:52.576 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe1af559700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe1a81a8dc0 con 0x7fe1a8107b70 2024-02-05T07:17:52.576 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe1ad2f5700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7fe1a8107b70 0x7fe1a810dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:56748/0 (socket says 172.21.15.184:56748) 2024-02-05T07:17:52.576 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe1ad2f5700 1 -- 172.21.15.184:0/120066193 learned_addr learned my addr 172.21.15.184:0/120066193 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:17:52.576 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565407103 0 0) 0x7fe1a81a7bc0 con 0x7fe1a810e560 2024-02-05T07:17:52.576 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1940035b0 con 0x7fe1a810e560 2024-02-05T07:17:52.576 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134378881 0 0) 0x7fe1a81a69c0 con 0x7fe1a810a990 2024-02-05T07:17:52.576 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1a81a7bc0 con 0x7fe1a810a990 2024-02-05T07:17:52.577 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219646129 0 0) 0x7fe1a81a8dc0 con 0x7fe1a8107b70 2024-02-05T07:17:52.577 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1a81a69c0 con 0x7fe1a8107b70 2024-02-05T07:17:52.577 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1901655404 0 0) 0x7fe1940035b0 con 0x7fe1a810e560 2024-02-05T07:17:52.577 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe1a81a8dc0 con 0x7fe1a810e560 2024-02-05T07:17:52.577 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fe1a00047e0 con 0x7fe1a810e560 2024-02-05T07:17:52.577 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4133006317 0 0) 0x7fe1a81a69c0 con 0x7fe1a8107b70 2024-02-05T07:17:52.577 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe1940035b0 con 0x7fe1a8107b70 2024-02-05T07:17:52.577 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3956294662 0 0) 0x7fe1a81a7bc0 con 0x7fe1a810a990 2024-02-05T07:17:52.577 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe1a81a69c0 con 0x7fe1a810a990 2024-02-05T07:17:52.577 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fe198001870 con 0x7fe1a8107b70 2024-02-05T07:17:52.577 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fe1a4001a70 con 0x7fe1a810a990 2024-02-05T07:17:52.577 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.572+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4077248116 0 0) 0x7fe1a81a8dc0 con 0x7fe1a810e560 2024-02-05T07:17:52.577 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.573+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 >> v1:172.21.15.184:6790/0 conn(0x7fe1a8107b70 legacy=0x7fe1a810dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:52.577 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.573+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 >> v1:172.21.15.184:6789/0 conn(0x7fe1a810a990 legacy=0x7fe1a81a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:52.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.573+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1a81a9fc0 con 0x7fe1a810e560 2024-02-05T07:17:52.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.573+0000 7fe1af559700 1 -- 172.21.15.184:0/120066193 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a81a8fb0 con 0x7fe1a810e560 2024-02-05T07:17:52.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.573+0000 7fe1af559700 1 -- 172.21.15.184:0/120066193 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1a81a9430 con 0x7fe1a810e560 2024-02-05T07:17:52.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.573+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fe1a0004a50 con 0x7fe1a810e560 2024-02-05T07:17:52.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.573+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fe1a0005010 con 0x7fe1a810e560 2024-02-05T07:17:52.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.574+0000 7fe1af559700 1 -- 172.21.15.184:0/120066193 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18c005150 con 0x7fe1a810e560 2024-02-05T07:17:52.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.574+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 17) v1 ==== 91437+0+0 (unknown 139547501 0 0) 0x7fe1a001b6b0 con 0x7fe1a810e560 2024-02-05T07:17:52.578 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.575+0000 7fe1ad2f5700 1 -- 172.21.15.184:0/120066193 >> v1:172.21.15.184:6800/2865218501 conn(0x7fe19406ecb0 legacy=0x7fe194071170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/2865218501 2024-02-05T07:17:52.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.575+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(71..71 src has 1..71) v4 ==== 6001+0+0 (unknown 2067935021 0 0) 0x7fe1a0087ba0 con 0x7fe1a810e560 2024-02-05T07:17:52.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.579+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fe1a0051220 con 0x7fe1a810e560 2024-02-05T07:17:52.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.776+0000 7fe1ad2f5700 1 -- 172.21.15.184:0/120066193 >> v1:172.21.15.184:6800/2865218501 conn(0x7fe19406ecb0 legacy=0x7fe194071170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/2865218501 2024-02-05T07:17:52.841 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.839+0000 7fe1af559700 1 -- 172.21.15.184:0/120066193 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe18c005400 con 0x7fe1a810e560 2024-02-05T07:17:52.844 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.842+0000 7fe19e7fc700 1 -- 172.21.15.184:0/120066193 <== mon.1 v1:172.21.15.188:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+174820 (unknown 831476310 0 1420875776) 0x7fe1a0053150 con 0x7fe1a810e560 2024-02-05T07:17:52.847 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:17:52.848 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.845+0000 7fe1af559700 1 -- 172.21.15.184:0/120066193 >> v1:172.21.15.184:6800/2865218501 conn(0x7fe19406ecb0 legacy=0x7fe194071170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-05T07:17:52.848 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.845+0000 7fe1af559700 1 -- 172.21.15.184:0/120066193 >> v1:172.21.15.188:6789/0 conn(0x7fe1a810e560 legacy=0x7fe1a81a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:52.848 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.845+0000 7fe1af559700 1 -- 172.21.15.184:0/120066193 shutdown_connections 2024-02-05T07:17:52.848 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.845+0000 7fe1af559700 1 -- 172.21.15.184:0/120066193 >> 172.21.15.184:0/120066193 conn(0x7fe1a80fd5f0 msgr2=0x7fe1a8111a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:52.849 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.845+0000 7fe1af559700 1 -- 172.21.15.184:0/120066193 shutdown_connections 2024-02-05T07:17:52.849 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:52.845+0000 7fe1af559700 1 -- 172.21.15.184:0/120066193 wait complete. 2024-02-05T07:17:52.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/120066193' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-05T07:17:52.999 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:52 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:52.745+0000 7f0d2862b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-05T07:17:52.999 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:52 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:52.877+0000 7f0d2862b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-05T07:17:53.196 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/120066193' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-05T07:17:53.197 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/120066193' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-05T07:17:53.197 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:52 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:52.811+0000 7f9784c69200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-05T07:17:53.197 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:52 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:52.950+0000 7f9784c69200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-05T07:17:53.499 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:53 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:53.211+0000 7f0d2862b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-05T07:17:53.499 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:53 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:53.302+0000 7f0d2862b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-05T07:17:53.521 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:53.291+0000 7f9784c69200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-05T07:17:53.521 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:53.383+0000 7f9784c69200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-05T07:17:53.626 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6800","nonce":2865218501}]},"active_addr":"172.21.15.184:6800/2865218501","active_change":"2024-02-05T07:12:44.148853+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":24109,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.184:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"cephadm","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":1419819400}]},{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":1333061501}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":4251421385}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":690644036}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.184:0","nonce":4043163629}]}]} 2024-02-05T07:17:53.630 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-05T07:17:53.630 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-05T07:17:53.630 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph osd dump --format=json 2024-02-05T07:17:53.917 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:17:53.969 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:53 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:53.499+0000 7f0d2862b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-05T07:17:53.969 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:53 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:53.684+0000 7f0d2862b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-05T07:17:54.021 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:53.581+0000 7f9784c69200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-05T07:17:54.021 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:53.779+0000 7f9784c69200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-05T07:17:54.232 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:53 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:53.967+0000 7f0d2862b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-05T07:17:54.301 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:54 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:54.095+0000 7f9784c69200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-05T07:17:54.499 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:54 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:54.230+0000 7f0d2862b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-05T07:17:54.499 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:54 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:54.468+0000 7f0d2862b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-05T07:17:54.559 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:54 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:54.368+0000 7f9784c69200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-05T07:17:54.921 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:54 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:54.619+0000 7f9784c69200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-05T07:17:55.512 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:55 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:55.446+0000 7f9784c69200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-05T07:17:55.673 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:55 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:55.265+0000 7f0d2862b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-05T07:17:55.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.754+0000 7ff1feff1700 1 -- 172.21.15.184:0/2486234279 >> v1:172.21.15.184:6789/0 conn(0x7ff1f8102c70 legacy=0x7ff1f8103050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:55.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.754+0000 7ff1feff1700 1 -- 172.21.15.184:0/2486234279 shutdown_connections 2024-02-05T07:17:55.756 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.754+0000 7ff1feff1700 1 -- 172.21.15.184:0/2486234279 >> 172.21.15.184:0/2486234279 conn(0x7ff1f80fc4c0 msgr2=0x7ff1f80fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:55.757 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.754+0000 7ff1feff1700 1 -- 172.21.15.184:0/2486234279 shutdown_connections 2024-02-05T07:17:55.757 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.754+0000 7ff1feff1700 1 -- 172.21.15.184:0/2486234279 wait complete. 2024-02-05T07:17:55.759 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.755+0000 7ff1feff1700 1 Processor -- start 2024-02-05T07:17:55.759 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.755+0000 7ff1feff1700 1 -- start start 2024-02-05T07:17:55.759 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.755+0000 7ff1feff1700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff1f81a68d0 con 0x7ff1f8102c70 2024-02-05T07:17:55.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.755+0000 7ff1feff1700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff1f81a7ab0 con 0x7ff1f810e590 2024-02-05T07:17:55.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.755+0000 7ff1f7fff700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7ff1f810aa80 0x7ff1f81a18b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:56756/0 (socket says 172.21.15.184:56756) 2024-02-05T07:17:55.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.755+0000 7ff1fcd8d700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7ff1f8102c70 0x7ff1f810a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:52856/0 (socket says 172.21.15.184:52856) 2024-02-05T07:17:55.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.755+0000 7ff1fd58e700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7ff1f810e590 0x7ff1f81a4fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.184:49390/0 (socket says 172.21.15.184:49390) 2024-02-05T07:17:55.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.755+0000 7ff1f7fff700 1 -- 172.21.15.184:0/1986251635 learned_addr learned my addr 172.21.15.184:0/1986251635 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:17:55.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.755+0000 7ff1feff1700 1 -- 172.21.15.184:0/1986251635 --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff1f81a6a60 con 0x7ff1f810aa80 2024-02-05T07:17:55.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190716894 0 0) 0x7ff1f81a68d0 con 0x7ff1f8102c70 2024-02-05T07:17:55.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e80035b0 con 0x7ff1f8102c70 2024-02-05T07:17:55.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821369274 0 0) 0x7ff1f81a7ab0 con 0x7ff1f810e590 2024-02-05T07:17:55.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f81a68d0 con 0x7ff1f810e590 2024-02-05T07:17:55.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3134086855 0 0) 0x7ff1f81a6a60 con 0x7ff1f810aa80 2024-02-05T07:17:55.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1f81a7ab0 con 0x7ff1f810aa80 2024-02-05T07:17:55.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2055453128 0 0) 0x7ff1e80035b0 con 0x7ff1f8102c70 2024-02-05T07:17:55.760 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1f81a6a60 con 0x7ff1f8102c70 2024-02-05T07:17:55.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2499338876 0 0) 0x7ff1f81a68d0 con 0x7ff1f810e590 2024-02-05T07:17:55.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1e80035b0 con 0x7ff1f810e590 2024-02-05T07:17:55.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7ff1ec001510 con 0x7ff1f8102c70 2024-02-05T07:17:55.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 577746168 0 0) 0x7ff1f81a7ab0 con 0x7ff1f810aa80 2024-02-05T07:17:55.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1f81a68d0 con 0x7ff1f810aa80 2024-02-05T07:17:55.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7ff1f0001c00 con 0x7ff1f810e590 2024-02-05T07:17:55.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7ff1e40017f0 con 0x7ff1f810aa80 2024-02-05T07:17:55.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1609570335 0 0) 0x7ff1e80035b0 con 0x7ff1f810e590 2024-02-05T07:17:55.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 >> v1:172.21.15.184:6790/0 conn(0x7ff1f810aa80 legacy=0x7ff1f81a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:55.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 >> v1:172.21.15.184:6789/0 conn(0x7ff1f8102c70 legacy=0x7ff1f810a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:55.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f81a6c30 con 0x7ff1f810e590 2024-02-05T07:17:55.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1feff1700 1 -- 172.21.15.184:0/1986251635 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f81a6ee0 con 0x7ff1f810e590 2024-02-05T07:17:55.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7ff1f0003e90 con 0x7ff1f810e590 2024-02-05T07:17:55.761 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7ff1f0005df0 con 0x7ff1f810e590 2024-02-05T07:17:55.762 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.756+0000 7ff1feff1700 1 -- 172.21.15.184:0/1986251635 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f81a7360 con 0x7ff1f810e590 2024-02-05T07:17:55.762 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.757+0000 7ff1feff1700 1 -- 172.21.15.184:0/1986251635 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f8069f80 con 0x7ff1f810e590 2024-02-05T07:17:55.762 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.758+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 17) v1 ==== 91437+0+0 (unknown 139547501 0 0) 0x7ff1f001c600 con 0x7ff1f810e590 2024-02-05T07:17:55.762 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.758+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(71..71 src has 1..71) v4 ==== 6001+0+0 (unknown 2067935021 0 0) 0x7ff1f0088d40 con 0x7ff1f810e590 2024-02-05T07:17:55.762 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.758+0000 7ff1fcd8d700 1 -- 172.21.15.184:0/1986251635 >> v1:172.21.15.184:6800/2865218501 conn(0x7ff1e806eb80 legacy=0x7ff1e8071040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/2865218501 2024-02-05T07:17:55.764 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.763+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7ff1f00523c0 con 0x7ff1f810e590 2024-02-05T07:17:55.961 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.959+0000 7ff1fcd8d700 1 -- 172.21.15.184:0/1986251635 >> v1:172.21.15.184:6800/2865218501 conn(0x7ff1e806eb80 legacy=0x7ff1e8071040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.184:6800/2865218501 2024-02-05T07:17:55.966 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.965+0000 7ff1feff1700 1 -- 172.21.15.184:0/1986251635 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1f8068610 con 0x7ff1f810e590 2024-02-05T07:17:55.967 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:55 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:55.861+0000 7f0d2862b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-05T07:17:55.967 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:55 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:55.965+0000 7f0d2862b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-05T07:17:55.968 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.967+0000 7ff1f5ffb700 1 -- 172.21.15.184:0/1986251635 <== mon.1 v1:172.21.15.188:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+20701 (unknown 2035373579 0 2669434772) 0x7ff1f00542f0 con 0x7ff1f810e590 2024-02-05T07:17:55.969 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:17:55.969 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":71,"fsid":"ae38c7f2-c3f5-11ee-95b6-87774f69a715","created":"2024-02-05T07:11:44.147297+0000","modified":"2024-02-05T07:17:46.176013+0000","last_up_change":"2024-02-05T07:17:05.272039+0000","last_in_change":"2024-02-05T07:16:47.187382+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-05T07:14:58.475517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"datapool","create_time":"2024-02-05T07:17:16.768731+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":65,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":".rgw.root","create_time":"2024-02-05T07:17:17.006822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-02-05T07:17:18.589703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-05T07:17:20.533717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-05T07:17:22.600036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55bd1041-d85f-429b-842b-f0ad482a2b35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6801","nonce":2828935930}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6802","nonce":2828935930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6804","nonce":2828935930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6803","nonce":2828935930}]},"public_addr":"172.21.15.184:6801/2828935930","cluster_addr":"172.21.15.184:6802/2828935930","heartbeat_back_addr":"172.21.15.184:6804/2828935930","heartbeat_front_addr":"172.21.15.184:6803/2828935930","state":["exists","up"]},{"osd":1,"uuid":"6f44c46f-e055-4522-a4bc-452f92e923af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6805","nonce":1083118002}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6806","nonce":1083118002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6808","nonce":1083118002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6807","nonce":1083118002}]},"public_addr":"172.21.15.184:6805/1083118002","cluster_addr":"172.21.15.184:6806/1083118002","heartbeat_back_addr":"172.21.15.184:6808/1083118002","heartbeat_front_addr":"172.21.15.184:6807/1083118002","state":["exists","up"]},{"osd":2,"uuid":"16e61e10-2c70-4ae2-ac6f-871d6d08a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6809","nonce":2153385925}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6810","nonce":2153385925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6812","nonce":2153385925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6811","nonce":2153385925}]},"public_addr":"172.21.15.184:6809/2153385925","cluster_addr":"172.21.15.184:6810/2153385925","heartbeat_back_addr":"172.21.15.184:6812/2153385925","heartbeat_front_addr":"172.21.15.184:6811/2153385925","state":["exists","up"]},{"osd":3,"uuid":"bbd6c528-127a-4a3e-9d2c-7da677ba4d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6813","nonce":2068331347}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6814","nonce":2068331347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6816","nonce":2068331347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6815","nonce":2068331347}]},"public_addr":"172.21.15.184:6813/2068331347","cluster_addr":"172.21.15.184:6814/2068331347","heartbeat_back_addr":"172.21.15.184:6816/2068331347","heartbeat_front_addr":"172.21.15.184:6815/2068331347","state":["exists","up"]},{"osd":4,"uuid":"a6d7e5ec-413d-445b-ab87-a6c924832a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6800","nonce":3630742885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6801","nonce":3630742885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6803","nonce":3630742885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6802","nonce":3630742885}]},"public_addr":"172.21.15.188:6800/3630742885","cluster_addr":"172.21.15.188:6801/3630742885","heartbeat_back_addr":"172.21.15.188:6803/3630742885","heartbeat_front_addr":"172.21.15.188:6802/3630742885","state":["exists","up"]},{"osd":5,"uuid":"dcc242b3-3f4a-4f09-83f3-5d8e6afb8a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6804","nonce":52728079}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6805","nonce":52728079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6807","nonce":52728079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6806","nonce":52728079}]},"public_addr":"172.21.15.188:6804/52728079","cluster_addr":"172.21.15.188:6805/52728079","heartbeat_back_addr":"172.21.15.188:6807/52728079","heartbeat_front_addr":"172.21.15.188:6806/52728079","state":["exists","up"]},{"osd":6,"uuid":"a53c7687-7dd7-4cf9-9a1c-5644b6474991","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6808","nonce":2094972647}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6809","nonce":2094972647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6811","nonce":2094972647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6810","nonce":2094972647}]},"public_addr":"172.21.15.188:6808/2094972647","cluster_addr":"172.21.15.188:6809/2094972647","heartbeat_back_addr":"172.21.15.188:6811/2094972647","heartbeat_front_addr":"172.21.15.188:6810/2094972647","state":["exists","up"]},{"osd":7,"uuid":"c353d532-f620-43b7-95b9-df50228eef01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6812","nonce":949787136}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6813","nonce":949787136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6815","nonce":949787136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6814","nonce":949787136}]},"public_addr":"172.21.15.188:6812/949787136","cluster_addr":"172.21.15.188:6813/949787136","heartbeat_back_addr":"172.21.15.188:6815/949787136","heartbeat_front_addr":"172.21.15.188:6814/949787136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:14:04.725385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:14:30.353209+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:14:56.068658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:15:21.668821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:15:45.127188+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:16:11.789995+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:16:37.456483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:17:03.186929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6800/2693451489":"2024-02-06T07:12:44.148742+0000","172.21.15.184:0/2200977126":"2024-02-06T07:12:44.148742+0000","172.21.15.184:0/2330160689":"2024-02-06T07:12:16.981827+0000","172.21.15.184:6800/668972809":"2024-02-06T07:12:16.981827+0000","172.21.15.184:0/884148618":"2024-02-06T07:12:16.981827+0000","172.21.15.184:0/221157509":"2024-02-06T07:12:44.148742+0000","172.21.15.184:0/1076320344":"2024-02-06T07:12:16.981827+0000","172.21.15.184:0/2023523197":"2024-02-06T07:12:44.148742+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-05T07:17:55.971 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.969+0000 7ff1feff1700 1 -- 172.21.15.184:0/1986251635 >> v1:172.21.15.184:6800/2865218501 conn(0x7ff1e806eb80 legacy=0x7ff1e8071040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-05T07:17:55.971 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.969+0000 7ff1feff1700 1 -- 172.21.15.184:0/1986251635 >> v1:172.21.15.188:6789/0 conn(0x7ff1f810e590 legacy=0x7ff1f81a4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:55.971 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.969+0000 7ff1feff1700 1 -- 172.21.15.184:0/1986251635 shutdown_connections 2024-02-05T07:17:55.971 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.969+0000 7ff1feff1700 1 -- 172.21.15.184:0/1986251635 >> 172.21.15.184:0/1986251635 conn(0x7ff1f80fc4c0 msgr2=0x7ff1f81109e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:55.971 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.969+0000 7ff1feff1700 1 -- 172.21.15.184:0/1986251635 shutdown_connections 2024-02-05T07:17:55.971 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:55.969+0000 7ff1feff1700 1 -- 172.21.15.184:0/1986251635 wait complete. 2024-02-05T07:17:56.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:56 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1986251635' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-05T07:17:56.249 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:56 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:56.191+0000 7f0d2862b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-05T07:17:56.249 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:56 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: [05/Feb/2024:07:17:56] ENGINE Bus STARTING 2024-02-05T07:17:56.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:56 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1986251635' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-05T07:17:56.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:56 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:56.047+0000 7f9784c69200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-05T07:17:56.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:56 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:56.146+0000 7f9784c69200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-05T07:17:56.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:56 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1986251635' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-05T07:17:56.570 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:56 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:56.369+0000 7f9784c69200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-05T07:17:56.571 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:56 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:17:56] ENGINE Bus STARTING 2024-02-05T07:17:56.581 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:56 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: CherryPy Checker: 2024-02-05T07:17:56.581 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:56 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: The Application mounted at '' has an empty config. 2024-02-05T07:17:56.581 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:56 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: 2024-02-05T07:17:56.581 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:56 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: [05/Feb/2024:07:17:56] ENGINE Serving on http://:::9283 2024-02-05T07:17:56.581 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:17:56 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x[35367]: [05/Feb/2024:07:17:56] ENGINE Bus STARTED 2024-02-05T07:17:56.724 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-05T07:17:56.724 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph osd dump --format=json 2024-02-05T07:17:56.989 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:17:57.021 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:56 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: CherryPy Checker: 2024-02-05T07:17:57.022 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:56 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: The Application mounted at '' has an empty config. 2024-02-05T07:17:57.022 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:56 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: 2024-02-05T07:17:57.022 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:56 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:17:56] ENGINE Serving on http://:::9283 2024-02-05T07:17:57.022 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:17:56 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:17:56] ENGINE Bus STARTED 2024-02-05T07:17:57.368 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: Standby manager daemon x restarted 2024-02-05T07:17:57.369 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: Standby manager daemon x started 2024-02-05T07:17:57.369 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.? v1:172.21.15.188:0/3184564773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-05T07:17:57.369 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.? v1:172.21.15.188:0/3184564773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-05T07:17:57.369 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.? v1:172.21.15.188:0/3184564773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-05T07:17:57.369 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.? v1:172.21.15.188:0/3184564773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-05T07:17:57.369 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: Active manager daemon y restarted 2024-02-05T07:17:57.369 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: Activating manager daemon y 2024-02-05T07:17:57.369 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: osdmap e72: 8 total, 8 up, 8 in 2024-02-05T07:17:57.369 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: mgrmap e18: y(active, starting, since 0.00884899s), standbys: x 2024-02-05T07:17:57.369 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:17:57.369 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:17:57.369 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:17:57.369 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-05T07:17:57.369 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: Manager daemon y is now available 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:17:57.370 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-05T07:17:57.371 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-05T07:17:57.371 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: Standby manager daemon x restarted 2024-02-05T07:17:57.371 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: Standby manager daemon x started 2024-02-05T07:17:57.371 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.? v1:172.21.15.188:0/3184564773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-05T07:17:57.371 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.? v1:172.21.15.188:0/3184564773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-05T07:17:57.371 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.? v1:172.21.15.188:0/3184564773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-05T07:17:57.371 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.? v1:172.21.15.188:0/3184564773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-05T07:17:57.371 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: Active manager daemon y restarted 2024-02-05T07:17:57.371 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: Activating manager daemon y 2024-02-05T07:17:57.371 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: osdmap e72: 8 total, 8 up, 8 in 2024-02-05T07:17:57.371 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: mgrmap e18: y(active, starting, since 0.00884899s), standbys: x 2024-02-05T07:17:57.372 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:17:57.372 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:17:57.372 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:17:57.372 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-05T07:17:57.372 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-05T07:17:57.372 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:17:57.372 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:17:57.372 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:17:57.372 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:17:57.372 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:17:57.372 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:17:57.372 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:17:57.372 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:57.372 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-05T07:17:57.373 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-05T07:17:57.373 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-05T07:17:57.373 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: Manager daemon y is now available 2024-02-05T07:17:57.373 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:57.373 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:57.373 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:17:57.373 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:17:57.373 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-05T07:17:57.373 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-05T07:17:57.397 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: Standby manager daemon x restarted 2024-02-05T07:17:57.397 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: Standby manager daemon x started 2024-02-05T07:17:57.397 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.? v1:172.21.15.188:0/3184564773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-05T07:17:57.397 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.? v1:172.21.15.188:0/3184564773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-05T07:17:57.397 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.? v1:172.21.15.188:0/3184564773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-05T07:17:57.397 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.? v1:172.21.15.188:0/3184564773' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-05T07:17:57.397 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: Active manager daemon y restarted 2024-02-05T07:17:57.397 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: Activating manager daemon y 2024-02-05T07:17:57.397 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: osdmap e72: 8 total, 8 up, 8 in 2024-02-05T07:17:57.397 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: mgrmap e18: y(active, starting, since 0.00884899s), standbys: x 2024-02-05T07:17:57.398 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-05T07:17:57.398 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-05T07:17:57.398 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-05T07:17:57.398 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-05T07:17:57.398 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-05T07:17:57.398 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-05T07:17:57.398 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-05T07:17:57.398 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-05T07:17:57.398 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-05T07:17:57.398 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-05T07:17:57.398 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-05T07:17:57.398 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-05T07:17:57.398 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-05T07:17:57.398 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-05T07:17:57.399 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-05T07:17:57.399 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-05T07:17:57.399 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: Manager daemon y is now available 2024-02-05T07:17:57.399 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:57.399 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:17:57.399 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:17:57.399 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:17:57.399 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-05T07:17:57.399 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-05T07:17:58.199 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:58 smithi184 ceph-mon[29861]: [05/Feb/2024:07:17:56] ENGINE Bus STARTING 2024-02-05T07:17:58.199 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:58 smithi184 ceph-mon[29861]: [05/Feb/2024:07:17:56] ENGINE Serving on https://172.21.15.184:7150 2024-02-05T07:17:58.199 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:58 smithi184 ceph-mon[29861]: [05/Feb/2024:07:17:56] ENGINE Serving on http://172.21.15.184:8765 2024-02-05T07:17:58.199 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:58 smithi184 ceph-mon[29861]: [05/Feb/2024:07:17:56] ENGINE Bus STARTED 2024-02-05T07:17:58.199 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:58 smithi184 ceph-mon[29861]: mgrmap e19: y(active, since 1.01446s), standbys: x 2024-02-05T07:17:58.200 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:58 smithi184 ceph-mon[41609]: [05/Feb/2024:07:17:56] ENGINE Bus STARTING 2024-02-05T07:17:58.200 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:58 smithi184 ceph-mon[41609]: [05/Feb/2024:07:17:56] ENGINE Serving on https://172.21.15.184:7150 2024-02-05T07:17:58.200 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:58 smithi184 ceph-mon[41609]: [05/Feb/2024:07:17:56] ENGINE Serving on http://172.21.15.184:8765 2024-02-05T07:17:58.200 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:58 smithi184 ceph-mon[41609]: [05/Feb/2024:07:17:56] ENGINE Bus STARTED 2024-02-05T07:17:58.200 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:58 smithi184 ceph-mon[41609]: mgrmap e19: y(active, since 1.01446s), standbys: x 2024-02-05T07:17:58.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:58 smithi188 ceph-mon[33283]: [05/Feb/2024:07:17:56] ENGINE Bus STARTING 2024-02-05T07:17:58.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:58 smithi188 ceph-mon[33283]: [05/Feb/2024:07:17:56] ENGINE Serving on https://172.21.15.184:7150 2024-02-05T07:17:58.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:58 smithi188 ceph-mon[33283]: [05/Feb/2024:07:17:56] ENGINE Serving on http://172.21.15.184:8765 2024-02-05T07:17:58.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:58 smithi188 ceph-mon[33283]: [05/Feb/2024:07:17:56] ENGINE Bus STARTED 2024-02-05T07:17:58.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:58 smithi188 ceph-mon[33283]: mgrmap e19: y(active, since 1.01446s), standbys: x 2024-02-05T07:17:58.790 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.752+0000 7fcff906a700 1 -- 172.21.15.184:0/177844418 >> v1:172.21.15.184:6790/0 conn(0x7fcff4109860 legacy=0x7fcff410bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:58.790 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.752+0000 7fcff906a700 1 -- 172.21.15.184:0/177844418 shutdown_connections 2024-02-05T07:17:58.790 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.752+0000 7fcff906a700 1 -- 172.21.15.184:0/177844418 >> 172.21.15.184:0/177844418 conn(0x7fcff40fc4c0 msgr2=0x7fcff40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:58.790 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.752+0000 7fcff906a700 1 -- 172.21.15.184:0/177844418 shutdown_connections 2024-02-05T07:17:58.790 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.752+0000 7fcff906a700 1 -- 172.21.15.184:0/177844418 wait complete. 2024-02-05T07:17:58.790 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.753+0000 7fcff906a700 1 Processor -- start 2024-02-05T07:17:58.790 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.753+0000 7fcff906a700 1 -- start start 2024-02-05T07:17:58.790 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcff906a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcff41a58d0 con 0x7fcff4109860 2024-02-05T07:17:58.791 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcff906a700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcff41a6ad0 con 0x7fcff410d430 2024-02-05T07:17:58.791 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcff906a700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcff41a7cd0 con 0x7fcff41069b0 2024-02-05T07:17:58.791 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcff259c700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fcff4109860 0x7fcff41a07e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:47542/0 (socket says 172.21.15.184:47542) 2024-02-05T07:17:58.791 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcff2d9d700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7fcff41069b0 0x7fcff410cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:40866/0 (socket says 172.21.15.184:40866) 2024-02-05T07:17:58.791 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcff259c700 1 -- 172.21.15.184:0/16906811 learned_addr learned my addr 172.21.15.184:0/16906811 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:17:58.791 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3497087182 0 0) 0x7fcff41a7cd0 con 0x7fcff41069b0 2024-02-05T07:17:58.791 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfdc0031f0 con 0x7fcff41069b0 2024-02-05T07:17:58.791 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4117390682 0 0) 0x7fcff41a58d0 con 0x7fcff4109860 2024-02-05T07:17:58.791 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff41a7cd0 con 0x7fcff4109860 2024-02-05T07:17:58.791 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617703310 0 0) 0x7fcff41a6ad0 con 0x7fcff410d430 2024-02-05T07:17:58.791 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcff41a58d0 con 0x7fcff410d430 2024-02-05T07:17:58.791 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1615882012 0 0) 0x7fcfdc0031f0 con 0x7fcff41069b0 2024-02-05T07:17:58.791 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcff41a6ad0 con 0x7fcff41069b0 2024-02-05T07:17:58.791 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fcfe4001830 con 0x7fcff41069b0 2024-02-05T07:17:58.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3849906912 0 0) 0x7fcff41a7cd0 con 0x7fcff4109860 2024-02-05T07:17:58.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcfdc0031f0 con 0x7fcff4109860 2024-02-05T07:17:58.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fcfe80015d0 con 0x7fcff4109860 2024-02-05T07:17:58.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2378103953 0 0) 0x7fcff41a58d0 con 0x7fcff410d430 2024-02-05T07:17:58.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcff41a7cd0 con 0x7fcff410d430 2024-02-05T07:17:58.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.754+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fcfec0013f0 con 0x7fcff410d430 2024-02-05T07:17:58.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.755+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1904418089 0 0) 0x7fcff41a6ad0 con 0x7fcff41069b0 2024-02-05T07:17:58.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.755+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 >> v1:172.21.15.188:6789/0 conn(0x7fcff410d430 legacy=0x7fcff41a3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:58.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.755+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 >> v1:172.21.15.184:6789/0 conn(0x7fcff4109860 legacy=0x7fcff41a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:58.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.755+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff41a8ed0 con 0x7fcff41069b0 2024-02-05T07:17:58.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.755+0000 7fcff906a700 1 -- 172.21.15.184:0/16906811 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff41a5ac0 con 0x7fcff41069b0 2024-02-05T07:17:58.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.755+0000 7fcff906a700 1 -- 172.21.15.184:0/16906811 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff41a5f40 con 0x7fcff41069b0 2024-02-05T07:17:58.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.755+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fcfe4003b30 con 0x7fcff41069b0 2024-02-05T07:17:58.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.755+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fcfe4005be0 con 0x7fcff41069b0 2024-02-05T07:17:58.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.756+0000 7fcff906a700 1 -- 172.21.15.184:0/16906811 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe0005150 con 0x7fcff41069b0 2024-02-05T07:17:58.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.756+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 19) v1 ==== 91180+0+0 (unknown 4179895283 0 0) 0x7fcfe4005e30 con 0x7fcff41069b0 2024-02-05T07:17:58.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.756+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7fcfe40883c0 con 0x7fcff41069b0 2024-02-05T07:17:58.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.761+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fcfe4051df0 con 0x7fcff41069b0 2024-02-05T07:17:58.969 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.967+0000 7fcff906a700 1 -- 172.21.15.184:0/16906811 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfe0005400 con 0x7fcff41069b0 2024-02-05T07:17:58.970 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.968+0000 7fcfdbfff700 1 -- 172.21.15.184:0/16906811 <== mon.2 v1:172.21.15.184:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+21081 (unknown 1686360691 0 2109993936) 0x7fcfe4053d20 con 0x7fcff41069b0 2024-02-05T07:17:58.971 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:17:58.971 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":72,"fsid":"ae38c7f2-c3f5-11ee-95b6-87774f69a715","created":"2024-02-05T07:11:44.147297+0000","modified":"2024-02-05T07:17:56.382755+0000","last_up_change":"2024-02-05T07:17:05.272039+0000","last_in_change":"2024-02-05T07:16:47.187382+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-05T07:14:58.475517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"datapool","create_time":"2024-02-05T07:17:16.768731+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":65,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":".rgw.root","create_time":"2024-02-05T07:17:17.006822+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.log","create_time":"2024-02-05T07:17:18.589703+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-05T07:17:20.533717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-05T07:17:22.600036+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"55bd1041-d85f-429b-842b-f0ad482a2b35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6801","nonce":2828935930}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6802","nonce":2828935930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6804","nonce":2828935930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6803","nonce":2828935930}]},"public_addr":"172.21.15.184:6801/2828935930","cluster_addr":"172.21.15.184:6802/2828935930","heartbeat_back_addr":"172.21.15.184:6804/2828935930","heartbeat_front_addr":"172.21.15.184:6803/2828935930","state":["exists","up"]},{"osd":1,"uuid":"6f44c46f-e055-4522-a4bc-452f92e923af","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6805","nonce":1083118002}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6806","nonce":1083118002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6808","nonce":1083118002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6807","nonce":1083118002}]},"public_addr":"172.21.15.184:6805/1083118002","cluster_addr":"172.21.15.184:6806/1083118002","heartbeat_back_addr":"172.21.15.184:6808/1083118002","heartbeat_front_addr":"172.21.15.184:6807/1083118002","state":["exists","up"]},{"osd":2,"uuid":"16e61e10-2c70-4ae2-ac6f-871d6d08a20c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6809","nonce":2153385925}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6810","nonce":2153385925}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6812","nonce":2153385925}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6811","nonce":2153385925}]},"public_addr":"172.21.15.184:6809/2153385925","cluster_addr":"172.21.15.184:6810/2153385925","heartbeat_back_addr":"172.21.15.184:6812/2153385925","heartbeat_front_addr":"172.21.15.184:6811/2153385925","state":["exists","up"]},{"osd":3,"uuid":"bbd6c528-127a-4a3e-9d2c-7da677ba4d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6813","nonce":2068331347}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6814","nonce":2068331347}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6816","nonce":2068331347}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.184:6815","nonce":2068331347}]},"public_addr":"172.21.15.184:6813/2068331347","cluster_addr":"172.21.15.184:6814/2068331347","heartbeat_back_addr":"172.21.15.184:6816/2068331347","heartbeat_front_addr":"172.21.15.184:6815/2068331347","state":["exists","up"]},{"osd":4,"uuid":"a6d7e5ec-413d-445b-ab87-a6c924832a26","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6800","nonce":3630742885}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6801","nonce":3630742885}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6803","nonce":3630742885}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6802","nonce":3630742885}]},"public_addr":"172.21.15.188:6800/3630742885","cluster_addr":"172.21.15.188:6801/3630742885","heartbeat_back_addr":"172.21.15.188:6803/3630742885","heartbeat_front_addr":"172.21.15.188:6802/3630742885","state":["exists","up"]},{"osd":5,"uuid":"dcc242b3-3f4a-4f09-83f3-5d8e6afb8a2e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6804","nonce":52728079}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6805","nonce":52728079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6807","nonce":52728079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6806","nonce":52728079}]},"public_addr":"172.21.15.188:6804/52728079","cluster_addr":"172.21.15.188:6805/52728079","heartbeat_back_addr":"172.21.15.188:6807/52728079","heartbeat_front_addr":"172.21.15.188:6806/52728079","state":["exists","up"]},{"osd":6,"uuid":"a53c7687-7dd7-4cf9-9a1c-5644b6474991","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6808","nonce":2094972647}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6809","nonce":2094972647}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6811","nonce":2094972647}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6810","nonce":2094972647}]},"public_addr":"172.21.15.188:6808/2094972647","cluster_addr":"172.21.15.188:6809/2094972647","heartbeat_back_addr":"172.21.15.188:6811/2094972647","heartbeat_front_addr":"172.21.15.188:6810/2094972647","state":["exists","up"]},{"osd":7,"uuid":"c353d532-f620-43b7-95b9-df50228eef01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":66,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6812","nonce":949787136}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6813","nonce":949787136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6815","nonce":949787136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.188:6814","nonce":949787136}]},"public_addr":"172.21.15.188:6812/949787136","cluster_addr":"172.21.15.188:6813/949787136","heartbeat_back_addr":"172.21.15.188:6815/949787136","heartbeat_front_addr":"172.21.15.188:6814/949787136","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:14:04.725385+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:14:30.353209+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:14:56.068658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:15:21.668821+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:15:45.127188+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:16:11.789995+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:16:37.456483+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-02-05T07:17:03.186929+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6800/2865218501":"2024-02-06T07:17:56.382716+0000","172.21.15.184:0/1419819400":"2024-02-06T07:17:56.382716+0000","172.21.15.184:0/4043163629":"2024-02-06T07:17:56.382716+0000","172.21.15.184:0/1333061501":"2024-02-06T07:17:56.382716+0000","172.21.15.184:0/690644036":"2024-02-06T07:17:56.382716+0000","172.21.15.184:6800/2693451489":"2024-02-06T07:12:44.148742+0000","172.21.15.184:0/4251421385":"2024-02-06T07:17:56.382716+0000","172.21.15.184:0/2200977126":"2024-02-06T07:12:44.148742+0000","172.21.15.184:0/2330160689":"2024-02-06T07:12:16.981827+0000","172.21.15.184:6800/668972809":"2024-02-06T07:12:16.981827+0000","172.21.15.184:0/884148618":"2024-02-06T07:12:16.981827+0000","172.21.15.184:0/221157509":"2024-02-06T07:12:44.148742+0000","172.21.15.184:0/1076320344":"2024-02-06T07:12:16.981827+0000","172.21.15.184:0/2023523197":"2024-02-06T07:12:44.148742+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-05T07:17:58.973 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.971+0000 7fcff906a700 1 -- 172.21.15.184:0/16906811 >> v1:172.21.15.184:6800/103463156 conn(0x7fcfdc070920 legacy=0x7fcfdc072de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:58.973 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.971+0000 7fcff906a700 1 -- 172.21.15.184:0/16906811 >> v1:172.21.15.184:6790/0 conn(0x7fcff41069b0 legacy=0x7fcff410cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:17:58.973 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.971+0000 7fcff906a700 1 -- 172.21.15.184:0/16906811 shutdown_connections 2024-02-05T07:17:58.973 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.971+0000 7fcff906a700 1 -- 172.21.15.184:0/16906811 >> 172.21.15.184:0/16906811 conn(0x7fcff40fc4c0 msgr2=0x7fcff4110670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:17:58.973 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.971+0000 7fcff906a700 1 -- 172.21.15.184:0/16906811 shutdown_connections 2024-02-05T07:17:58.973 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:17:58.971+0000 7fcff906a700 1 -- 172.21.15.184:0/16906811 wait complete. 2024-02-05T07:17:59.113 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:17:59.113 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:59 smithi184 ceph-mon[29861]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:17:59.113 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:17:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/16906811' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-05T07:17:59.114 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:17:59.114 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:59 smithi184 ceph-mon[41609]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:17:59.114 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:17:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/16906811' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-05T07:17:59.363 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:17:59.363 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:59 smithi188 ceph-mon[33283]: pgmap v3: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:17:59.363 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:17:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/16906811' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-05T07:18:00.222 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-05T07:18:00.223 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-05T07:18:00.223 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-05T07:18:00.223 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-05T07:18:00.224 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-05T07:18:00.224 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-05T07:18:00.225 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-02-05T07:18:00.225 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-02-05T07:18:00.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:00 smithi188 ceph-mon[33283]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:18:00.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:00 smithi188 ceph-mon[33283]: mgrmap e20: y(active, since 3s), standbys: x 2024-02-05T07:18:00.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:00.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:00.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:00 smithi184 ceph-mon[29861]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:18:00.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:00 smithi184 ceph-mon[29861]: mgrmap e20: y(active, since 3s), standbys: x 2024-02-05T07:18:00.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:00.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:00.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:00 smithi184 ceph-mon[41609]: pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:18:00.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:00 smithi184 ceph-mon[41609]: mgrmap e20: y(active, since 3s), standbys: x 2024-02-05T07:18:00.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:00.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:00.664 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:00.665 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:01.004 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:01.004 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:01.005 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:01.008 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:01.396 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:01.396 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:02.074 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:18:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:18:02.074 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[29861]: pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:18:02.074 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:02.074 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:02.074 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:02.074 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:02.074 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:02.074 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:02.075 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[29861]: Adjusting osd_memory_target on smithi188 to 3760M 2024-02-05T07:18:02.075 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:02.075 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[29861]: mgrmap e21: y(active, since 4s), standbys: x 2024-02-05T07:18:02.075 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[41609]: pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:18:02.075 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:02.075 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:02.075 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:02.075 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:02.075 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:02.075 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:02.076 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[41609]: Adjusting osd_memory_target on smithi188 to 3760M 2024-02-05T07:18:02.076 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:02.076 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:01 smithi184 ceph-mon[41609]: mgrmap e21: y(active, since 4s), standbys: x 2024-02-05T07:18:02.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:01 smithi188 ceph-mon[33283]: pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:18:02.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:01 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:02.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:01 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:02.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:01 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:02.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:01 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:02.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:01 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:02.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:01 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:02.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:01 smithi188 ceph-mon[33283]: Adjusting osd_memory_target on smithi188 to 3760M 2024-02-05T07:18:02.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:01 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:02.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:01 smithi188 ceph-mon[33283]: mgrmap e21: y(active, since 4s), standbys: x 2024-02-05T07:18:04.185 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:03 smithi184 ceph-mon[29861]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:18:04.185 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:03 smithi184 ceph-mon[41609]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:18:04.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:03 smithi188 ceph-mon[33283]: pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:18:06.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:06 smithi188 ceph-mon[33283]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-02-05T07:18:06.509 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.081+0000 7fec03d4b700 1 -- 172.21.15.184:0/1912024979 >> v1:172.21.15.184:6790/0 conn(0x7febfc102cb0 legacy=0x7febfc103090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:06.509 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.081+0000 7fec03d4b700 1 -- 172.21.15.184:0/1912024979 shutdown_connections 2024-02-05T07:18:06.509 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.081+0000 7fec03d4b700 1 -- 172.21.15.184:0/1912024979 >> 172.21.15.184:0/1912024979 conn(0x7febfc0fc4c0 msgr2=0x7febfc0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:06.509 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.081+0000 7fec03d4b700 1 -- 172.21.15.184:0/1912024979 shutdown_connections 2024-02-05T07:18:06.509 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.081+0000 7fec03d4b700 1 -- 172.21.15.184:0/1912024979 wait complete. 2024-02-05T07:18:06.509 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.082+0000 7fec03d4b700 1 Processor -- start 2024-02-05T07:18:06.509 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.082+0000 7fec03d4b700 1 -- start start 2024-02-05T07:18:06.509 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.082+0000 7fec03d4b700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7febfc1a8af0 con 0x7febfc102cb0 2024-02-05T07:18:06.509 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.082+0000 7fec03d4b700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7febfc1a9cd0 con 0x7febfc10aac0 2024-02-05T07:18:06.509 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.082+0000 7fec03d4b700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7febfc1aaed0 con 0x7febfc10e5d0 2024-02-05T07:18:06.509 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.082+0000 7fec022e8700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7febfc10e5d0 0x7febfc1a73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:40886/0 (socket says 172.21.15.184:40886) 2024-02-05T07:18:06.509 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.082+0000 7fec022e8700 1 -- 172.21.15.184:0/1602438178 learned_addr learned my addr 172.21.15.184:0/1602438178 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:06.510 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.082+0000 7fec01ae7700 1 --1- 172.21.15.184:0/1602438178 >> v1:172.21.15.184:6789/0 conn(0x7febfc102cb0 0x7febfc10a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:47548/0 (socket says 172.21.15.184:47548) 2024-02-05T07:18:06.510 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.082+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145607156 0 0) 0x7febfc1aaed0 con 0x7febfc10e5d0 2024-02-05T07:18:06.510 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.082+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febe80049e0 con 0x7febfc10e5d0 2024-02-05T07:18:06.510 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.082+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610144420 0 0) 0x7febfc1a8af0 con 0x7febfc102cb0 2024-02-05T07:18:06.510 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.082+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febfc1aaed0 con 0x7febfc102cb0 2024-02-05T07:18:06.510 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.082+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258479343 0 0) 0x7febfc1a9cd0 con 0x7febfc10aac0 2024-02-05T07:18:06.510 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.082+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febfc1a8af0 con 0x7febfc10aac0 2024-02-05T07:18:06.510 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.082+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 973137836 0 0) 0x7febe80049e0 con 0x7febfc10e5d0 2024-02-05T07:18:06.510 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7febfc1a9cd0 con 0x7febfc10e5d0 2024-02-05T07:18:06.510 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7febf4001d70 con 0x7febfc10e5d0 2024-02-05T07:18:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2879514197 0 0) 0x7febfc1aaed0 con 0x7febfc102cb0 2024-02-05T07:18:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7febe80049e0 con 0x7febfc102cb0 2024-02-05T07:18:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7febec004570 con 0x7febfc102cb0 2024-02-05T07:18:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4160244008 0 0) 0x7febfc1a8af0 con 0x7febfc10aac0 2024-02-05T07:18:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7febfc1aaed0 con 0x7febfc10aac0 2024-02-05T07:18:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7febf80017f0 con 0x7febfc10aac0 2024-02-05T07:18:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4030168472 0 0) 0x7febfc1a9cd0 con 0x7febfc10e5d0 2024-02-05T07:18:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 >> v1:172.21.15.188:6789/0 conn(0x7febfc10aac0 legacy=0x7febfc1a3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 >> v1:172.21.15.184:6789/0 conn(0x7febfc102cb0 legacy=0x7febfc10a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febfc1ac0d0 con 0x7febfc10e5d0 2024-02-05T07:18:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7fec03d4b700 1 -- 172.21.15.184:0/1602438178 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febfc1a8ce0 con 0x7febfc10e5d0 2024-02-05T07:18:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7fec03d4b700 1 -- 172.21.15.184:0/1602438178 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7febfc1a9160 con 0x7febfc10e5d0 2024-02-05T07:18:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7febf4002020 con 0x7febfc10e5d0 2024-02-05T07:18:06.511 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.083+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7febf4006010 con 0x7febfc10e5d0 2024-02-05T07:18:06.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.084+0000 7fec03d4b700 1 -- 172.21.15.184:0/1602438178 --> v1:172.21.15.184:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7febe0000fb0 con 0x7febfc10e5d0 2024-02-05T07:18:06.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.084+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7febf40072b0 con 0x7febfc10e5d0 2024-02-05T07:18:06.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.085+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7febf4088c60 con 0x7febfc10e5d0 2024-02-05T07:18:06.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.085+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 --> v1:172.21.15.188:6800/3630742885 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7febe807cec0 con 0x7febe8079250 2024-02-05T07:18:06.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.085+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (unknown 571355762 0 0) 0x7febf4089060 con 0x7febfc10e5d0 2024-02-05T07:18:06.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.086+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== osd.4 v1:172.21.15.188:6800/3630742885 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7febe807cec0 con 0x7febe8079250 2024-02-05T07:18:06.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.102+0000 7fec03d4b700 1 -- 172.21.15.184:0/1602438178 --> v1:172.21.15.188:6800/3630742885 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7febe0002c70 con 0x7febe8079250 2024-02-05T07:18:06.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.103+0000 7febf2ffd700 1 -- 172.21.15.184:0/1602438178 <== osd.4 v1:172.21.15.188:6800/3630742885 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 804844592) 0x7febe0002c70 con 0x7febe8079250 2024-02-05T07:18:06.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.103+0000 7fec03d4b700 1 -- 172.21.15.184:0/1602438178 >> v1:172.21.15.188:6800/3630742885 conn(0x7febe8079250 legacy=0x7febe807b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:06.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.103+0000 7fec03d4b700 1 -- 172.21.15.184:0/1602438178 >> v1:172.21.15.184:6800/103463156 conn(0x7febe806ea60 legacy=0x7febe8070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:06.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.103+0000 7fec03d4b700 1 -- 172.21.15.184:0/1602438178 >> v1:172.21.15.184:6790/0 conn(0x7febfc10e5d0 legacy=0x7febfc1a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:06.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.103+0000 7fec022e8700 1 -- 172.21.15.184:0/1602438178 reap_dead start 2024-02-05T07:18:06.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.104+0000 7fec03d4b700 1 -- 172.21.15.184:0/1602438178 shutdown_connections 2024-02-05T07:18:06.512 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.104+0000 7fec03d4b700 1 -- 172.21.15.184:0/1602438178 >> 172.21.15.184:0/1602438178 conn(0x7febfc0fc4c0 msgr2=0x7febfc1109e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:06.513 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.104+0000 7fec03d4b700 1 -- 172.21.15.184:0/1602438178 shutdown_connections 2024-02-05T07:18:06.513 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:06.104+0000 7fec03d4b700 1 -- 172.21.15.184:0/1602438178 wait complete. 2024-02-05T07:18:06.513 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:06 smithi184 ceph-mon[29861]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-02-05T07:18:06.513 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:06 smithi184 ceph-mon[41609]: pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-02-05T07:18:07.159 INFO:teuthology.orchestra.run.smithi184.stdout:128849018909 2024-02-05T07:18:07.159 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-05T07:18:07.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:07 smithi188 ceph-mon[33283]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-05T07:18:07.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:07 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:07.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:07 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:07.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:07 smithi184 ceph-mon[29861]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-05T07:18:07.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:07 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:07.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:07 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:07.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:07 smithi184 ceph-mon[41609]: pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-05T07:18:07.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:07 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:07.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:07 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:09.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:09.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:09.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:09.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:09.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: Adjusting osd_memory_target on smithi184 to 3760M 2024-02-05T07:18:09.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:18:09.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:18:09.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-05T07:18:09.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: Updating smithi188:/etc/ceph/ceph.conf 2024-02-05T07:18:09.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: Updating smithi184:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:18:09.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: Updating smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:18:09.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-02-05T07:18:09.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-02-05T07:18:09.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.024 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:09.024 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.024 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.024 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:09.024 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:09.024 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:09.024 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:09.024 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: Adjusting osd_memory_target on smithi184 to 3760M 2024-02-05T07:18:09.024 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.025 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:18:09.025 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:18:09.025 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-05T07:18:09.025 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: Updating smithi188:/etc/ceph/ceph.conf 2024-02-05T07:18:09.025 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: Updating smithi184:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:18:09.025 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: Updating smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:18:09.025 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-02-05T07:18:09.025 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-02-05T07:18:09.025 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.025 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.025 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.025 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.025 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:08 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:09.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:09.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:09.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:09.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:18:09.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: Adjusting osd_memory_target on smithi184 to 3760M 2024-02-05T07:18:09.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:18:09.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:18:09.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-05T07:18:09.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: Updating smithi188:/etc/ceph/ceph.conf 2024-02-05T07:18:09.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: Updating smithi184:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:18:09.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: Updating smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.conf 2024-02-05T07:18:09.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-02-05T07:18:09.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: Updating smithi188:/etc/ceph/ceph.client.admin.keyring 2024-02-05T07:18:09.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:08 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:09.777 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.775+0000 7f52a2029700 1 -- 172.21.15.184:0/366760963 >> v1:172.21.15.184:6790/0 conn(0x7f529c10e560 legacy=0x7f529c110a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:09.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.775+0000 7f52a2029700 1 -- 172.21.15.184:0/366760963 shutdown_connections 2024-02-05T07:18:09.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.775+0000 7f52a2029700 1 -- 172.21.15.184:0/366760963 >> 172.21.15.184:0/366760963 conn(0x7f529c0fd5f0 msgr2=0x7f529c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:09.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.775+0000 7f52a2029700 1 -- 172.21.15.184:0/366760963 shutdown_connections 2024-02-05T07:18:09.778 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.775+0000 7f52a2029700 1 -- 172.21.15.184:0/366760963 wait complete. 2024-02-05T07:18:09.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.776+0000 7f52a2029700 1 Processor -- start 2024-02-05T07:18:09.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.776+0000 7f52a2029700 1 -- start start 2024-02-05T07:18:09.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.776+0000 7f52a2029700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f529c1a6ba0 con 0x7f529c107b70 2024-02-05T07:18:09.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.776+0000 7f52a2029700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f529c1a7d80 con 0x7f529c10a990 2024-02-05T07:18:09.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.776+0000 7f52a2029700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f529c1a8f80 con 0x7f529c10e560 2024-02-05T07:18:09.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.776+0000 7f529b7fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f529c107b70 0x7f529c10de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:32922/0 (socket says 172.21.15.184:32922) 2024-02-05T07:18:09.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.776+0000 7f529b7fe700 1 -- 172.21.15.184:0/981239015 learned_addr learned my addr 172.21.15.184:0/981239015 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:09.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2606335499 0 0) 0x7f529c1a6ba0 con 0x7f529c107b70 2024-02-05T07:18:09.780 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52840035b0 con 0x7f529c107b70 2024-02-05T07:18:09.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2438387490 0 0) 0x7f529c1a8f80 con 0x7f529c10e560 2024-02-05T07:18:09.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f529c1a6ba0 con 0x7f529c10e560 2024-02-05T07:18:09.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2516084257 0 0) 0x7f529c1a6ba0 con 0x7f529c10e560 2024-02-05T07:18:09.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f529c1a8f80 con 0x7f529c10e560 2024-02-05T07:18:09.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f528c001880 con 0x7f529c10e560 2024-02-05T07:18:09.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1791863257 0 0) 0x7f52840035b0 con 0x7f529c107b70 2024-02-05T07:18:09.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f529c1a6ba0 con 0x7f529c107b70 2024-02-05T07:18:09.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f5294001c10 con 0x7f529c107b70 2024-02-05T07:18:09.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638106714 0 0) 0x7f529c1a7d80 con 0x7f529c10a990 2024-02-05T07:18:09.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52840035b0 con 0x7f529c10a990 2024-02-05T07:18:09.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 9681835 0 0) 0x7f529c1a8f80 con 0x7f529c10e560 2024-02-05T07:18:09.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 >> v1:172.21.15.188:6789/0 conn(0x7f529c10a990 legacy=0x7f529c1a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:09.781 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 >> v1:172.21.15.184:6789/0 conn(0x7f529c107b70 legacy=0x7f529c10de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:09.782 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f529c1aa180 con 0x7f529c10e560 2024-02-05T07:18:09.782 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f52a2029700 1 -- 172.21.15.184:0/981239015 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529c1a9170 con 0x7f529c10e560 2024-02-05T07:18:09.782 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f52a2029700 1 -- 172.21.15.184:0/981239015 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f529c1a95f0 con 0x7f529c10e560 2024-02-05T07:18:09.782 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f528c001b40 con 0x7f529c10e560 2024-02-05T07:18:09.782 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.777+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f528c004e10 con 0x7f529c10e560 2024-02-05T07:18:09.782 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.778+0000 7f52a2029700 1 -- 172.21.15.184:0/981239015 --> v1:172.21.15.184:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5288000fb0 con 0x7f529c10e560 2024-02-05T07:18:09.782 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.779+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f528c0038a0 con 0x7f529c10e560 2024-02-05T07:18:09.783 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.779+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7f528c087820 con 0x7f529c10e560 2024-02-05T07:18:09.783 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.779+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 --> v1:172.21.15.188:6804/52728079 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f528407ce90 con 0x7f5284079180 2024-02-05T07:18:09.783 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.779+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (unknown 571355762 0 0) 0x7f528c087c20 con 0x7f529c10e560 2024-02-05T07:18:09.783 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.781+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 <== osd.5 v1:172.21.15.188:6804/52728079 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f528407ce90 con 0x7f5284079180 2024-02-05T07:18:09.798 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.797+0000 7f52a2029700 1 -- 172.21.15.184:0/981239015 --> v1:172.21.15.188:6804/52728079 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5288002c70 con 0x7f5284079180 2024-02-05T07:18:09.799 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.797+0000 7f5298ff9700 1 -- 172.21.15.184:0/981239015 <== osd.5 v1:172.21.15.188:6804/52728079 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 829413231) 0x7f5288002c70 con 0x7f5284079180 2024-02-05T07:18:09.800 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.798+0000 7f52a2029700 1 -- 172.21.15.184:0/981239015 >> v1:172.21.15.188:6804/52728079 conn(0x7f5284079180 legacy=0x7f528407b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:09.800 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.798+0000 7f52a2029700 1 -- 172.21.15.184:0/981239015 >> v1:172.21.15.184:6800/103463156 conn(0x7f528406ea20 legacy=0x7f5284070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:09.800 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.798+0000 7f52a2029700 1 -- 172.21.15.184:0/981239015 >> v1:172.21.15.184:6790/0 conn(0x7f529c10e560 legacy=0x7f529c1a52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:09.800 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.798+0000 7f529bfff700 1 -- 172.21.15.184:0/981239015 reap_dead start 2024-02-05T07:18:09.800 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.798+0000 7f52a2029700 1 -- 172.21.15.184:0/981239015 shutdown_connections 2024-02-05T07:18:09.800 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.798+0000 7f52a2029700 1 -- 172.21.15.184:0/981239015 >> 172.21.15.184:0/981239015 conn(0x7f529c0fd5f0 msgr2=0x7f529c111c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:09.800 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.798+0000 7f52a2029700 1 -- 172.21.15.184:0/981239015 shutdown_connections 2024-02-05T07:18:09.800 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:09.798+0000 7f52a2029700 1 -- 172.21.15.184:0/981239015 wait complete. 2024-02-05T07:18:10.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:10 smithi184 ceph-mon[29861]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-05T07:18:10.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:10 smithi184 ceph-mon[29861]: Updating smithi184:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-05T07:18:10.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:10 smithi184 ceph-mon[29861]: Updating smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-05T07:18:10.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:10 smithi184 ceph-mon[29861]: Deploying daemon alertmanager.a on smithi184 2024-02-05T07:18:10.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:10 smithi184 ceph-mon[41609]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-05T07:18:10.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:10 smithi184 ceph-mon[41609]: Updating smithi184:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-05T07:18:10.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:10 smithi184 ceph-mon[41609]: Updating smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-05T07:18:10.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:10 smithi184 ceph-mon[41609]: Deploying daemon alertmanager.a on smithi184 2024-02-05T07:18:10.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:10 smithi188 ceph-mon[33283]: pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-05T07:18:10.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:10 smithi188 ceph-mon[33283]: Updating smithi184:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-05T07:18:10.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:10 smithi188 ceph-mon[33283]: Updating smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/config/ceph.client.admin.keyring 2024-02-05T07:18:10.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:10 smithi188 ceph-mon[33283]: Deploying daemon alertmanager.a on smithi184 2024-02-05T07:18:11.889 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.694+0000 7fccdc623700 1 -- 172.21.15.184:0/83532081 >> v1:172.21.15.184:6789/0 conn(0x7fccd4107b70 legacy=0x7fccd4107f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:11.889 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.694+0000 7fccdc623700 1 -- 172.21.15.184:0/83532081 shutdown_connections 2024-02-05T07:18:11.889 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.694+0000 7fccdc623700 1 -- 172.21.15.184:0/83532081 >> 172.21.15.184:0/83532081 conn(0x7fccd40fd610 msgr2=0x7fccd40ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:11.889 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.694+0000 7fccdc623700 1 -- 172.21.15.184:0/83532081 shutdown_connections 2024-02-05T07:18:11.889 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.694+0000 7fccdc623700 1 -- 172.21.15.184:0/83532081 wait complete. 2024-02-05T07:18:11.889 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.694+0000 7fccdc623700 1 Processor -- start 2024-02-05T07:18:11.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.694+0000 7fccdc623700 1 -- start start 2024-02-05T07:18:11.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccdc623700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fccd41a8b50 con 0x7fccd410a990 2024-02-05T07:18:11.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccdc623700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fccd41a9cf0 con 0x7fccd4107b70 2024-02-05T07:18:11.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccdc623700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fccd41aae90 con 0x7fccd410e560 2024-02-05T07:18:11.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccd9bbe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fccd410a990 0x7fccd41a3d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:32956/0 (socket says 172.21.15.184:32956) 2024-02-05T07:18:11.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccd9bbe700 1 -- 172.21.15.184:0/428637746 learned_addr learned my addr 172.21.15.184:0/428637746 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:11.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccdabc0700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7fccd410e560 0x7fccd41a7430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:53010/0 (socket says 172.21.15.184:53010) 2024-02-05T07:18:11.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052523890 0 0) 0x7fccd41a8b50 con 0x7fccd410a990 2024-02-05T07:18:11.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc00035b0 con 0x7fccd410a990 2024-02-05T07:18:11.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198034623 0 0) 0x7fccd41aae90 con 0x7fccd410e560 2024-02-05T07:18:11.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd41a8b50 con 0x7fccd410e560 2024-02-05T07:18:11.890 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 965104737 0 0) 0x7fccc00035b0 con 0x7fccd410a990 2024-02-05T07:18:11.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fccd41aae90 con 0x7fccd410a990 2024-02-05T07:18:11.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fccc8001910 con 0x7fccd410a990 2024-02-05T07:18:11.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2892609700 0 0) 0x7fccd41a8b50 con 0x7fccd410e560 2024-02-05T07:18:11.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fccc00035b0 con 0x7fccd410e560 2024-02-05T07:18:11.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734663351 0 0) 0x7fccd41a9cf0 con 0x7fccd4107b70 2024-02-05T07:18:11.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd41a8b50 con 0x7fccd4107b70 2024-02-05T07:18:11.891 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fcccc0019b0 con 0x7fccd410e560 2024-02-05T07:18:11.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1927667082 0 0) 0x7fccd41aae90 con 0x7fccd410a990 2024-02-05T07:18:11.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 >> v1:172.21.15.184:6790/0 conn(0x7fccd410e560 legacy=0x7fccd41a7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:11.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 >> v1:172.21.15.188:6789/0 conn(0x7fccd4107b70 legacy=0x7fccd4075800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:11.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd41ac070 con 0x7fccd410a990 2024-02-05T07:18:11.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccdc623700 1 -- 172.21.15.184:0/428637746 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd41ab080 con 0x7fccd410a990 2024-02-05T07:18:11.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccdc623700 1 -- 172.21.15.184:0/428637746 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd41ab500 con 0x7fccd410a990 2024-02-05T07:18:11.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fccc8003b30 con 0x7fccd410a990 2024-02-05T07:18:11.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.695+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fccc8005c80 con 0x7fccd410a990 2024-02-05T07:18:11.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.696+0000 7fccdc623700 1 -- 172.21.15.184:0/428637746 --> v1:172.21.15.184:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fccb8000fb0 con 0x7fccd410a990 2024-02-05T07:18:11.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.697+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7fccc80036a0 con 0x7fccd410a990 2024-02-05T07:18:11.892 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.697+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7fccc8088960 con 0x7fccd410a990 2024-02-05T07:18:11.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.697+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 --> v1:172.21.15.184:6801/2828935930 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fccc007cde0 con 0x7fccc00790d0 2024-02-05T07:18:11.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.697+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (unknown 571355762 0 0) 0x7fccc8088d70 con 0x7fccd410a990 2024-02-05T07:18:11.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.698+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 <== osd.0 v1:172.21.15.184:6801/2828935930 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fccc007cde0 con 0x7fccc00790d0 2024-02-05T07:18:11.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.714+0000 7fccdc623700 1 -- 172.21.15.184:0/428637746 --> v1:172.21.15.184:6801/2828935930 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fccb8002c70 con 0x7fccc00790d0 2024-02-05T07:18:11.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.715+0000 7fccc77fe700 1 -- 172.21.15.184:0/428637746 <== osd.0 v1:172.21.15.184:6801/2828935930 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3385987527) 0x7fccb8002c70 con 0x7fccc00790d0 2024-02-05T07:18:11.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.715+0000 7fccdc623700 1 -- 172.21.15.184:0/428637746 >> v1:172.21.15.184:6801/2828935930 conn(0x7fccc00790d0 legacy=0x7fccc007b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:11.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.715+0000 7fccdc623700 1 -- 172.21.15.184:0/428637746 >> v1:172.21.15.184:6800/103463156 conn(0x7fccc006e9f0 legacy=0x7fccc0070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:11.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.715+0000 7fccdc623700 1 -- 172.21.15.184:0/428637746 >> v1:172.21.15.184:6789/0 conn(0x7fccd410a990 legacy=0x7fccd41a3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:11.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.715+0000 7fccdabc0700 1 -- 172.21.15.184:0/428637746 reap_dead start 2024-02-05T07:18:11.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.715+0000 7fccdc623700 1 -- 172.21.15.184:0/428637746 shutdown_connections 2024-02-05T07:18:11.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.715+0000 7fccdc623700 1 -- 172.21.15.184:0/428637746 >> 172.21.15.184:0/428637746 conn(0x7fccd40fd610 msgr2=0x7fccd41001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:11.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.715+0000 7fccdc623700 1 -- 172.21.15.184:0/428637746 shutdown_connections 2024-02-05T07:18:11.893 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.715+0000 7fccdc623700 1 -- 172.21.15.184:0/428637746 wait complete. 2024-02-05T07:18:12.148 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:18:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:18:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:18:12.483 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:12 smithi184 ceph-mon[29861]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-05T07:18:12.483 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:12 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:18:12.483 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:12 smithi184 ceph-mon[41609]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-05T07:18:12.483 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:12 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:18:12.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:12 smithi188 ceph-mon[33283]: pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-05T07:18:12.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:12 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:18:12.512 INFO:teuthology.orchestra.run.smithi184.stdout:34359738419 2024-02-05T07:18:12.512 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-05T07:18:13.490 INFO:teuthology.orchestra.run.smithi184.stdout:163208757273 2024-02-05T07:18:13.490 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-05T07:18:13.732 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.565+0000 7fbba8362700 1 -- 172.21.15.184:0/1874320801 >> v1:172.21.15.184:6790/0 conn(0x7fbba010e550 legacy=0x7fbba0110a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:13.732 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.565+0000 7fbba8362700 1 -- 172.21.15.184:0/1874320801 shutdown_connections 2024-02-05T07:18:13.732 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.565+0000 7fbba8362700 1 -- 172.21.15.184:0/1874320801 >> 172.21.15.184:0/1874320801 conn(0x7fbba00fd600 msgr2=0x7fbba00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:13.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.565+0000 7fbba8362700 1 -- 172.21.15.184:0/1874320801 shutdown_connections 2024-02-05T07:18:13.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.565+0000 7fbba8362700 1 -- 172.21.15.184:0/1874320801 wait complete. 2024-02-05T07:18:13.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.566+0000 7fbba8362700 1 Processor -- start 2024-02-05T07:18:13.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.566+0000 7fbba8362700 1 -- start start 2024-02-05T07:18:13.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.566+0000 7fbba8362700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbba01a6a00 con 0x7fbba010a980 2024-02-05T07:18:13.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.566+0000 7fbba8362700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbba01a7be0 con 0x7fbba010e550 2024-02-05T07:18:13.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.566+0000 7fbba8362700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbba01a8de0 con 0x7fbba0107b60 2024-02-05T07:18:13.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.566+0000 7fbba60fe700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7fbba0107b60 0x7fbba010dca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:52986/0 (socket says 172.21.15.184:52986) 2024-02-05T07:18:13.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.566+0000 7fbba60fe700 1 -- 172.21.15.184:0/483714504 learned_addr learned my addr 172.21.15.184:0/483714504 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:13.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 596925116 0 0) 0x7fbba01a6a00 con 0x7fbba010a980 2024-02-05T07:18:13.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb8c0035b0 con 0x7fbba010a980 2024-02-05T07:18:13.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209447923 0 0) 0x7fbba01a8de0 con 0x7fbba0107b60 2024-02-05T07:18:13.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba01a6a00 con 0x7fbba0107b60 2024-02-05T07:18:13.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349190772 0 0) 0x7fbba01a7be0 con 0x7fbba010e550 2024-02-05T07:18:13.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba01a8de0 con 0x7fbba010e550 2024-02-05T07:18:13.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2142617511 0 0) 0x7fbb8c0035b0 con 0x7fbba010a980 2024-02-05T07:18:13.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbba01a7be0 con 0x7fbba010a980 2024-02-05T07:18:13.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fbb90001250 con 0x7fbba010a980 2024-02-05T07:18:13.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3927232051 0 0) 0x7fbba01a8de0 con 0x7fbba010e550 2024-02-05T07:18:13.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbb8c0035b0 con 0x7fbba010e550 2024-02-05T07:18:13.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fbb980017b0 con 0x7fbba010e550 2024-02-05T07:18:13.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3698727754 0 0) 0x7fbba01a6a00 con 0x7fbba0107b60 2024-02-05T07:18:13.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbba01a8de0 con 0x7fbba0107b60 2024-02-05T07:18:13.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fbb9c001870 con 0x7fbba0107b60 2024-02-05T07:18:13.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3039727190 0 0) 0x7fbba01a7be0 con 0x7fbba010a980 2024-02-05T07:18:13.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 >> v1:172.21.15.184:6790/0 conn(0x7fbba0107b60 legacy=0x7fbba010dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:13.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 >> v1:172.21.15.188:6789/0 conn(0x7fbba010e550 legacy=0x7fbba01a50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:13.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba01a9fe0 con 0x7fbba010a980 2024-02-05T07:18:13.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbba8362700 1 -- 172.21.15.184:0/483714504 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbba01a8fd0 con 0x7fbba010a980 2024-02-05T07:18:13.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbba8362700 1 -- 172.21.15.184:0/483714504 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbba01a9450 con 0x7fbba010a980 2024-02-05T07:18:13.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fbb90003b10 con 0x7fbba010a980 2024-02-05T07:18:13.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.567+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fbb90004870 con 0x7fbba010a980 2024-02-05T07:18:13.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.568+0000 7fbba8362700 1 -- 172.21.15.184:0/483714504 --> v1:172.21.15.184:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbb84000f80 con 0x7fbba010a980 2024-02-05T07:18:13.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.569+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7fbb9001afe0 con 0x7fbba010a980 2024-02-05T07:18:13.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.569+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7fbb90087660 con 0x7fbba010a980 2024-02-05T07:18:13.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.569+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 --> v1:172.21.15.188:6808/2094972647 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbb8c07d000 con 0x7fbb8c0792f0 2024-02-05T07:18:13.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.569+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (unknown 571355762 0 0) 0x7fbb90087a90 con 0x7fbba010a980 2024-02-05T07:18:13.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.570+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== osd.6 v1:172.21.15.188:6808/2094972647 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fbb98008e90 con 0x7fbb8c0792f0 2024-02-05T07:18:13.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.587+0000 7fbba8362700 1 -- 172.21.15.184:0/483714504 --> v1:172.21.15.188:6808/2094972647 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbb84002c40 con 0x7fbb8c0792f0 2024-02-05T07:18:13.735 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.588+0000 7fbb977fe700 1 -- 172.21.15.184:0/483714504 <== osd.6 v1:172.21.15.188:6808/2094972647 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2319438110) 0x7fbb84002c40 con 0x7fbb8c0792f0 2024-02-05T07:18:13.736 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.588+0000 7fbba8362700 1 -- 172.21.15.184:0/483714504 >> v1:172.21.15.188:6808/2094972647 conn(0x7fbb8c0792f0 legacy=0x7fbb8c07b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:13.736 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.588+0000 7fbba8362700 1 -- 172.21.15.184:0/483714504 >> v1:172.21.15.184:6800/103463156 conn(0x7fbb8c06eb10 legacy=0x7fbb8c070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:13.736 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.588+0000 7fbba8362700 1 -- 172.21.15.184:0/483714504 >> v1:172.21.15.184:6789/0 conn(0x7fbba010a980 legacy=0x7fbba01a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:13.736 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.588+0000 7fbba68ff700 1 -- 172.21.15.184:0/483714504 reap_dead start 2024-02-05T07:18:13.736 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.588+0000 7fbba8362700 1 -- 172.21.15.184:0/483714504 shutdown_connections 2024-02-05T07:18:13.736 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.588+0000 7fbba8362700 1 -- 172.21.15.184:0/483714504 >> 172.21.15.184:0/483714504 conn(0x7fbba00fd600 msgr2=0x7fbba0101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:13.736 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.588+0000 7fbba8362700 1 -- 172.21.15.184:0/483714504 shutdown_connections 2024-02-05T07:18:13.736 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:11.588+0000 7fbba8362700 1 -- 172.21.15.184:0/483714504 wait complete. 2024-02-05T07:18:14.194 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.180+0000 7f927de83700 1 -- 172.21.15.184:0/3052397729 >> v1:172.21.15.184:6790/0 conn(0x7f927810e630 legacy=0x7f9278110af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:14.194 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.180+0000 7f927de83700 1 -- 172.21.15.184:0/3052397729 shutdown_connections 2024-02-05T07:18:14.194 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.180+0000 7f927de83700 1 -- 172.21.15.184:0/3052397729 >> 172.21.15.184:0/3052397729 conn(0x7f9278076e50 msgr2=0x7f92780fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:14.194 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.181+0000 7f927de83700 1 -- 172.21.15.184:0/3052397729 shutdown_connections 2024-02-05T07:18:14.194 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.181+0000 7f927de83700 1 -- 172.21.15.184:0/3052397729 wait complete. 2024-02-05T07:18:14.194 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.181+0000 7f927de83700 1 Processor -- start 2024-02-05T07:18:14.195 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.181+0000 7f927de83700 1 -- start start 2024-02-05T07:18:14.195 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.181+0000 7f927de83700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f92781a8cb0 con 0x7f927810a960 2024-02-05T07:18:14.195 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.181+0000 7f927de83700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f92781a9e50 con 0x7f927810e630 2024-02-05T07:18:14.195 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.181+0000 7f927de83700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f92781ab030 con 0x7f9278106ae0 2024-02-05T07:18:14.195 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f92777fe700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f9278106ae0 0x7f9278105f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:53032/0 (socket says 172.21.15.184:53032) 2024-02-05T07:18:14.195 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f92777fe700 1 -- 172.21.15.184:0/331470306 learned_addr learned my addr 172.21.15.184:0/331470306 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:14.195 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1777047378 0 0) 0x7f92781ab030 con 0x7f9278106ae0 2024-02-05T07:18:14.195 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92600049e0 con 0x7f9278106ae0 2024-02-05T07:18:14.195 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 414625894 0 0) 0x7f92781a8cb0 con 0x7f927810a960 2024-02-05T07:18:14.195 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92781ab030 con 0x7f927810a960 2024-02-05T07:18:14.195 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631141202 0 0) 0x7f92781a9e50 con 0x7f927810e630 2024-02-05T07:18:14.195 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92781a8cb0 con 0x7f927810e630 2024-02-05T07:18:14.195 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 59126688 0 0) 0x7f92600049e0 con 0x7f9278106ae0 2024-02-05T07:18:14.196 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f92781a9e50 con 0x7f9278106ae0 2024-02-05T07:18:14.196 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9268001930 con 0x7f9278106ae0 2024-02-05T07:18:14.196 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2477567062 0 0) 0x7f92781ab030 con 0x7f927810a960 2024-02-05T07:18:14.196 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f92600049e0 con 0x7f927810a960 2024-02-05T07:18:14.196 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 714049593 0 0) 0x7f92781a8cb0 con 0x7f927810e630 2024-02-05T07:18:14.196 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f92781ab030 con 0x7f927810e630 2024-02-05T07:18:14.196 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f926c0010b0 con 0x7f927810a960 2024-02-05T07:18:14.196 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9270001ba0 con 0x7f927810e630 2024-02-05T07:18:14.196 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1975140999 0 0) 0x7f92781a9e50 con 0x7f9278106ae0 2024-02-05T07:18:14.196 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 >> v1:172.21.15.188:6789/0 conn(0x7f927810e630 legacy=0x7f92781a7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:14.196 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 >> v1:172.21.15.184:6789/0 conn(0x7f927810a960 legacy=0x7f92781a3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:14.196 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92781ac230 con 0x7f9278106ae0 2024-02-05T07:18:14.197 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f927de83700 1 -- 172.21.15.184:0/331470306 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92781a8ea0 con 0x7f9278106ae0 2024-02-05T07:18:14.197 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f927de83700 1 -- 172.21.15.184:0/331470306 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f92781a9320 con 0x7f9278106ae0 2024-02-05T07:18:14.197 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f9268001cc0 con 0x7f9278106ae0 2024-02-05T07:18:14.197 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.182+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9268005cb0 con 0x7f9278106ae0 2024-02-05T07:18:14.197 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.183+0000 7f927de83700 1 -- 172.21.15.184:0/331470306 --> v1:172.21.15.184:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9264000f80 con 0x7f9278106ae0 2024-02-05T07:18:14.197 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.184+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f926801c420 con 0x7f9278106ae0 2024-02-05T07:18:14.197 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.184+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7f9268088a10 con 0x7f9278106ae0 2024-02-05T07:18:14.197 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.184+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 --> v1:172.21.15.188:6812/949787136 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f926007d050 con 0x7f9260079340 2024-02-05T07:18:14.197 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.184+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (unknown 571355762 0 0) 0x7f9268088e40 con 0x7f9278106ae0 2024-02-05T07:18:14.197 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.185+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== osd.7 v1:172.21.15.188:6812/949787136 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f926007d050 con 0x7f9260079340 2024-02-05T07:18:14.204 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.202+0000 7f927de83700 1 -- 172.21.15.184:0/331470306 --> v1:172.21.15.188:6812/949787136 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9264002c40 con 0x7f9260079340 2024-02-05T07:18:14.204 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.203+0000 7f9274ff9700 1 -- 172.21.15.184:0/331470306 <== osd.7 v1:172.21.15.188:6812/949787136 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3159816221) 0x7f9264002c40 con 0x7f9260079340 2024-02-05T07:18:14.205 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.203+0000 7f927de83700 1 -- 172.21.15.184:0/331470306 >> v1:172.21.15.188:6812/949787136 conn(0x7f9260079340 legacy=0x7f926007b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:14.205 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.203+0000 7f927de83700 1 -- 172.21.15.184:0/331470306 >> v1:172.21.15.184:6800/103463156 conn(0x7f926006ec60 legacy=0x7f9260071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:14.205 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.203+0000 7f927de83700 1 -- 172.21.15.184:0/331470306 >> v1:172.21.15.184:6790/0 conn(0x7f9278106ae0 legacy=0x7f9278105f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:14.206 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.203+0000 7f9277fff700 1 -- 172.21.15.184:0/331470306 reap_dead start 2024-02-05T07:18:14.206 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.203+0000 7f927de83700 1 -- 172.21.15.184:0/331470306 shutdown_connections 2024-02-05T07:18:14.206 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.203+0000 7f927de83700 1 -- 172.21.15.184:0/331470306 >> 172.21.15.184:0/331470306 conn(0x7f9278076e50 msgr2=0x7f927810d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:14.206 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.203+0000 7f927de83700 1 -- 172.21.15.184:0/331470306 shutdown_connections 2024-02-05T07:18:14.206 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.203+0000 7f927de83700 1 -- 172.21.15.184:0/331470306 wait complete. 2024-02-05T07:18:14.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:14 smithi188 ceph-mon[33283]: pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-05T07:18:14.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:14 smithi184 ceph-mon[29861]: pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-05T07:18:14.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:14 smithi184 ceph-mon[41609]: pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-05T07:18:14.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.836+0000 7f2da4024700 1 -- 172.21.15.184:0/1018751308 >> v1:172.21.15.184:6790/0 conn(0x7f2d9c1069b0 legacy=0x7f2d9c106d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:14.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.836+0000 7f2da4024700 1 -- 172.21.15.184:0/1018751308 shutdown_connections 2024-02-05T07:18:14.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.836+0000 7f2da4024700 1 -- 172.21.15.184:0/1018751308 >> 172.21.15.184:0/1018751308 conn(0x7f2d9c0fc4c0 msgr2=0x7f2d9c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:14.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.836+0000 7f2da4024700 1 -- 172.21.15.184:0/1018751308 shutdown_connections 2024-02-05T07:18:14.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.836+0000 7f2da4024700 1 -- 172.21.15.184:0/1018751308 wait complete. 2024-02-05T07:18:14.840 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.837+0000 7f2da4024700 1 Processor -- start 2024-02-05T07:18:14.840 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.837+0000 7f2da4024700 1 -- start start 2024-02-05T07:18:14.840 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.837+0000 7f2da4024700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2d9c10d130 con 0x7f2d9c1069b0 2024-02-05T07:18:14.840 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.837+0000 7f2da4024700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2d9c1a7f50 con 0x7f2d9c109860 2024-02-05T07:18:14.841 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.837+0000 7f2da4024700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2d9c1a90f0 con 0x7f2d9c10d430 2024-02-05T07:18:14.841 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.837+0000 7f2da1dc0700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f2d9c1069b0 0x7f2d9c069f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:33000/0 (socket says 172.21.15.184:33000) 2024-02-05T07:18:14.841 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.837+0000 7f2da1dc0700 1 -- 172.21.15.184:0/109812798 learned_addr learned my addr 172.21.15.184:0/109812798 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:14.841 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204003133 0 0) 0x7f2d9c10d130 con 0x7f2d9c1069b0 2024-02-05T07:18:14.841 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d880035b0 con 0x7f2d9c1069b0 2024-02-05T07:18:14.841 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734003144 0 0) 0x7f2d9c1a90f0 con 0x7f2d9c10d430 2024-02-05T07:18:14.841 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d9c10d130 con 0x7f2d9c10d430 2024-02-05T07:18:14.841 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609185380 0 0) 0x7f2d9c1a7f50 con 0x7f2d9c109860 2024-02-05T07:18:14.841 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d9c1a90f0 con 0x7f2d9c109860 2024-02-05T07:18:14.841 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 583667668 0 0) 0x7f2d880035b0 con 0x7f2d9c1069b0 2024-02-05T07:18:14.841 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2d9c1a7f50 con 0x7f2d9c1069b0 2024-02-05T07:18:14.841 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f2d98001a20 con 0x7f2d9c1069b0 2024-02-05T07:18:14.842 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3573148777 0 0) 0x7f2d9c10d130 con 0x7f2d9c10d430 2024-02-05T07:18:14.842 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2d880035b0 con 0x7f2d9c10d430 2024-02-05T07:18:14.842 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f2d94001c30 con 0x7f2d9c10d430 2024-02-05T07:18:14.842 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 84001333 0 0) 0x7f2d9c1a90f0 con 0x7f2d9c109860 2024-02-05T07:18:14.842 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2d9c10d130 con 0x7f2d9c109860 2024-02-05T07:18:14.842 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f2d8c001830 con 0x7f2d9c109860 2024-02-05T07:18:14.842 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1656542952 0 0) 0x7f2d880035b0 con 0x7f2d9c10d430 2024-02-05T07:18:14.842 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 >> v1:172.21.15.188:6789/0 conn(0x7f2d9c109860 legacy=0x7f2d9c06a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:14.842 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 >> v1:172.21.15.184:6789/0 conn(0x7f2d9c1069b0 legacy=0x7f2d9c069f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:14.842 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d9c1aa290 con 0x7f2d9c10d430 2024-02-05T07:18:14.842 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2da4024700 1 -- 172.21.15.184:0/109812798 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d9c1a92e0 con 0x7f2d9c10d430 2024-02-05T07:18:14.842 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2da4024700 1 -- 172.21.15.184:0/109812798 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d9c1a9760 con 0x7f2d9c10d430 2024-02-05T07:18:14.842 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.838+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f2d94003eb0 con 0x7f2d9c10d430 2024-02-05T07:18:14.843 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.839+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f2d94004cc0 con 0x7f2d9c10d430 2024-02-05T07:18:14.843 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.839+0000 7f2da4024700 1 -- 172.21.15.184:0/109812798 --> v1:172.21.15.184:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d80000f80 con 0x7f2d9c10d430 2024-02-05T07:18:14.843 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.840+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f2d9401b350 con 0x7f2d9c10d430 2024-02-05T07:18:14.844 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.840+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7f2d94087a20 con 0x7f2d9c10d430 2024-02-05T07:18:14.844 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.841+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 --> v1:172.21.15.184:6809/2153385925 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d8807d070 con 0x7f2d88079360 2024-02-05T07:18:14.844 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.841+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (unknown 571355762 0 0) 0x7f2d94087e50 con 0x7f2d9c10d430 2024-02-05T07:18:14.844 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.841+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== osd.2 v1:172.21.15.184:6809/2153385925 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f2d8807d070 con 0x7f2d88079360 2024-02-05T07:18:14.879 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.876+0000 7f2da4024700 1 -- 172.21.15.184:0/109812798 --> v1:172.21.15.184:6809/2153385925 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2d80002c40 con 0x7f2d88079360 2024-02-05T07:18:14.879 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.877+0000 7f2d92ffd700 1 -- 172.21.15.184:0/109812798 <== osd.2 v1:172.21.15.184:6809/2153385925 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2783450430) 0x7f2d80002c40 con 0x7f2d88079360 2024-02-05T07:18:14.880 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.877+0000 7f2da4024700 1 -- 172.21.15.184:0/109812798 >> v1:172.21.15.184:6809/2153385925 conn(0x7f2d88079360 legacy=0x7f2d8807b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:14.880 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.877+0000 7f2da4024700 1 -- 172.21.15.184:0/109812798 >> v1:172.21.15.184:6800/103463156 conn(0x7f2d8806eaf0 legacy=0x7f2d88070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:14.880 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.877+0000 7f2da4024700 1 -- 172.21.15.184:0/109812798 >> v1:172.21.15.184:6790/0 conn(0x7f2d9c10d430 legacy=0x7f2d9c1a5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:14.880 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.877+0000 7f2da25c1700 1 -- 172.21.15.184:0/109812798 reap_dead start 2024-02-05T07:18:14.880 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.877+0000 7f2da4024700 1 -- 172.21.15.184:0/109812798 shutdown_connections 2024-02-05T07:18:14.880 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.877+0000 7f2da4024700 1 -- 172.21.15.184:0/109812798 >> 172.21.15.184:0/109812798 conn(0x7f2d9c0fc4c0 msgr2=0x7f2d9c0ff860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:14.880 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.877+0000 7f2da4024700 1 -- 172.21.15.184:0/109812798 shutdown_connections 2024-02-05T07:18:14.880 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:14.877+0000 7f2da4024700 1 -- 172.21.15.184:0/109812798 wait complete. 2024-02-05T07:18:15.399 INFO:teuthology.orchestra.run.smithi184.stdout:197568495634 2024-02-05T07:18:15.400 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-02-05T07:18:15.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.842+0000 7fa061e33700 1 -- 172.21.15.184:0/656549908 >> v1:172.21.15.184:6790/0 conn(0x7fa05c10d430 legacy=0x7fa05c10f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:15.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.842+0000 7fa061e33700 1 -- 172.21.15.184:0/656549908 shutdown_connections 2024-02-05T07:18:15.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.842+0000 7fa061e33700 1 -- 172.21.15.184:0/656549908 >> 172.21.15.184:0/656549908 conn(0x7fa05c0fc4c0 msgr2=0x7fa05c0fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:15.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.842+0000 7fa061e33700 1 -- 172.21.15.184:0/656549908 shutdown_connections 2024-02-05T07:18:15.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.842+0000 7fa061e33700 1 -- 172.21.15.184:0/656549908 wait complete. 2024-02-05T07:18:15.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.843+0000 7fa061e33700 1 Processor -- start 2024-02-05T07:18:15.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.843+0000 7fa061e33700 1 -- start start 2024-02-05T07:18:15.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.843+0000 7fa061e33700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa05c1a6980 con 0x7fa05c10d430 2024-02-05T07:18:15.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.843+0000 7fa061e33700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa05c1a7b60 con 0x7fa05c1069b0 2024-02-05T07:18:15.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.843+0000 7fa061e33700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa05c1a8d60 con 0x7fa05c109860 2024-02-05T07:18:15.884 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.843+0000 7fa05affd700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7fa05c109860 0x7fa05c1a17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:53068/0 (socket says 172.21.15.184:53068) 2024-02-05T07:18:15.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.843+0000 7fa05affd700 1 -- 172.21.15.184:0/558880012 learned_addr learned my addr 172.21.15.184:0/558880012 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:15.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451384516 0 0) 0x7fa05c1a8d60 con 0x7fa05c109860 2024-02-05T07:18:15.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0440049e0 con 0x7fa05c109860 2024-02-05T07:18:15.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043113299 0 0) 0x7fa05c1a6980 con 0x7fa05c10d430 2024-02-05T07:18:15.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa05c1a8d60 con 0x7fa05c10d430 2024-02-05T07:18:15.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688959165 0 0) 0x7fa05c1a7b60 con 0x7fa05c1069b0 2024-02-05T07:18:15.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa05c1a6980 con 0x7fa05c1069b0 2024-02-05T07:18:15.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1938398789 0 0) 0x7fa0440049e0 con 0x7fa05c109860 2024-02-05T07:18:15.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa05c1a7b60 con 0x7fa05c109860 2024-02-05T07:18:15.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 592926576 0 0) 0x7fa05c1a8d60 con 0x7fa05c10d430 2024-02-05T07:18:15.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa0440049e0 con 0x7fa05c10d430 2024-02-05T07:18:15.885 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fa050001930 con 0x7fa05c109860 2024-02-05T07:18:15.886 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fa054001d40 con 0x7fa05c10d430 2024-02-05T07:18:15.886 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3651200010 0 0) 0x7fa05c1a6980 con 0x7fa05c1069b0 2024-02-05T07:18:15.886 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa05c1a8d60 con 0x7fa05c1069b0 2024-02-05T07:18:15.886 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fa04c0019f0 con 0x7fa05c1069b0 2024-02-05T07:18:15.886 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1201077281 0 0) 0x7fa05c1a7b60 con 0x7fa05c109860 2024-02-05T07:18:15.886 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 >> v1:172.21.15.188:6789/0 conn(0x7fa05c1069b0 legacy=0x7fa05c10cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:15.886 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 >> v1:172.21.15.184:6789/0 conn(0x7fa05c10d430 legacy=0x7fa05c1a5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:15.886 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c1a9f60 con 0x7fa05c109860 2024-02-05T07:18:15.886 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa061e33700 1 -- 172.21.15.184:0/558880012 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05c1a8f50 con 0x7fa05c109860 2024-02-05T07:18:15.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa061e33700 1 -- 172.21.15.184:0/558880012 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05c1a93d0 con 0x7fa05c109860 2024-02-05T07:18:15.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fa050001c70 con 0x7fa05c109860 2024-02-05T07:18:15.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.844+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fa050005ca0 con 0x7fa05c109860 2024-02-05T07:18:15.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.845+0000 7fa061e33700 1 -- 172.21.15.184:0/558880012 --> v1:172.21.15.184:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa048000f80 con 0x7fa05c109860 2024-02-05T07:18:15.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.846+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7fa050003950 con 0x7fa05c109860 2024-02-05T07:18:15.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.846+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7fa050088830 con 0x7fa05c109860 2024-02-05T07:18:15.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.846+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 --> v1:172.21.15.184:6813/2068331347 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa04407ce80 con 0x7fa044079170 2024-02-05T07:18:15.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.846+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (unknown 571355762 0 0) 0x7fa050088c90 con 0x7fa05c109860 2024-02-05T07:18:15.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.847+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== osd.3 v1:172.21.15.184:6813/2068331347 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fa04407ce80 con 0x7fa044079170 2024-02-05T07:18:15.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.863+0000 7fa061e33700 1 -- 172.21.15.184:0/558880012 --> v1:172.21.15.184:6813/2068331347 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa048002c40 con 0x7fa044079170 2024-02-05T07:18:15.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.863+0000 7fa058ff9700 1 -- 172.21.15.184:0/558880012 <== osd.3 v1:172.21.15.184:6813/2068331347 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 4066359062) 0x7fa048002c40 con 0x7fa044079170 2024-02-05T07:18:15.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.863+0000 7fa061e33700 1 -- 172.21.15.184:0/558880012 >> v1:172.21.15.184:6813/2068331347 conn(0x7fa044079170 legacy=0x7fa04407b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:15.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.863+0000 7fa061e33700 1 -- 172.21.15.184:0/558880012 >> v1:172.21.15.184:6800/103463156 conn(0x7fa04406ea90 legacy=0x7fa044070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:15.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.864+0000 7fa061e33700 1 -- 172.21.15.184:0/558880012 >> v1:172.21.15.184:6790/0 conn(0x7fa05c109860 legacy=0x7fa05c1a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:15.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.864+0000 7fa05bfff700 1 -- 172.21.15.184:0/558880012 reap_dead start 2024-02-05T07:18:15.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.864+0000 7fa061e33700 1 -- 172.21.15.184:0/558880012 shutdown_connections 2024-02-05T07:18:15.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.864+0000 7fa061e33700 1 -- 172.21.15.184:0/558880012 >> 172.21.15.184:0/558880012 conn(0x7fa05c0fc4c0 msgr2=0x7fa05c1009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:15.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.864+0000 7fa061e33700 1 -- 172.21.15.184:0/558880012 shutdown_connections 2024-02-05T07:18:15.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:15.864+0000 7fa061e33700 1 -- 172.21.15.184:0/558880012 wait complete. 2024-02-05T07:18:16.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:16 smithi188 ceph-mon[33283]: pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-05T07:18:16.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:16 smithi184 ceph-mon[29861]: pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-05T07:18:16.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:16 smithi184 ceph-mon[41609]: pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-05T07:18:16.524 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.522+0000 7f976a7e7700 1 -- 172.21.15.184:0/1762049062 >> v1:172.21.15.184:6789/0 conn(0x7f976410a970 legacy=0x7f976410cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:16.524 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.522+0000 7f976a7e7700 1 -- 172.21.15.184:0/1762049062 shutdown_connections 2024-02-05T07:18:16.524 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.522+0000 7f976a7e7700 1 -- 172.21.15.184:0/1762049062 >> 172.21.15.184:0/1762049062 conn(0x7f97640fd5d0 msgr2=0x7f97640ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:16.524 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.522+0000 7f976a7e7700 1 -- 172.21.15.184:0/1762049062 shutdown_connections 2024-02-05T07:18:16.524 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.522+0000 7f976a7e7700 1 -- 172.21.15.184:0/1762049062 wait complete. 2024-02-05T07:18:16.525 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.522+0000 7f976a7e7700 1 Processor -- start 2024-02-05T07:18:16.525 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.522+0000 7f976a7e7700 1 -- start start 2024-02-05T07:18:16.525 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.523+0000 7f976a7e7700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f97641a8bc0 con 0x7f976410a970 2024-02-05T07:18:16.525 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.523+0000 7f976a7e7700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f97641a9da0 con 0x7f976410e540 2024-02-05T07:18:16.525 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.523+0000 7f976a7e7700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f97641aaf80 con 0x7f9764107ac0 2024-02-05T07:18:16.526 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.523+0000 7f9768d84700 1 --1- >> v1:172.21.15.188:6789/0 conn(0x7f976410e540 0x7f97641a7410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.188:6789/0 says I am v1:172.21.15.184:45668/0 (socket says 172.21.15.184:45668) 2024-02-05T07:18:16.526 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.523+0000 7f9768d84700 1 -- 172.21.15.184:0/3564635723 learned_addr learned my addr 172.21.15.184:0/3564635723 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:16.526 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.523+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 258616978 0 0) 0x7f97641a8bc0 con 0x7f976410a970 2024-02-05T07:18:16.526 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f974c0049e0 con 0x7f976410a970 2024-02-05T07:18:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2475071183 0 0) 0x7f97641aaf80 con 0x7f9764107ac0 2024-02-05T07:18:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97641a8bc0 con 0x7f9764107ac0 2024-02-05T07:18:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1401276753 0 0) 0x7f97641a9da0 con 0x7f976410e540 2024-02-05T07:18:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97641aaf80 con 0x7f976410e540 2024-02-05T07:18:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4004415849 0 0) 0x7f974c0049e0 con 0x7f976410a970 2024-02-05T07:18:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f97641a9da0 con 0x7f976410a970 2024-02-05T07:18:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9758004320 con 0x7f976410a970 2024-02-05T07:18:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3061623122 0 0) 0x7f97641a8bc0 con 0x7f9764107ac0 2024-02-05T07:18:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f974c0049e0 con 0x7f9764107ac0 2024-02-05T07:18:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9754001000 con 0x7f9764107ac0 2024-02-05T07:18:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3896771957 0 0) 0x7f97641a9da0 con 0x7f976410a970 2024-02-05T07:18:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 >> v1:172.21.15.184:6790/0 conn(0x7f9764107ac0 legacy=0x7f9764075910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 >> v1:172.21.15.188:6789/0 conn(0x7f976410e540 legacy=0x7f97641a7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97641ac180 con 0x7f976410a970 2024-02-05T07:18:16.527 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f976a7e7700 1 -- 172.21.15.184:0/3564635723 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97641ab170 con 0x7f976410a970 2024-02-05T07:18:16.528 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f9758001ad0 con 0x7f976410a970 2024-02-05T07:18:16.528 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9758004e40 con 0x7f976410a970 2024-02-05T07:18:16.528 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.524+0000 7f976a7e7700 1 -- 172.21.15.184:0/3564635723 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f97641ab5f0 con 0x7f976410a970 2024-02-05T07:18:16.528 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.525+0000 7f976a7e7700 1 -- 172.21.15.184:0/3564635723 --> v1:172.21.15.184:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97641148d0 con 0x7f976410a970 2024-02-05T07:18:16.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.526+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f9758003710 con 0x7f976410a970 2024-02-05T07:18:16.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.527+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7f9758087a40 con 0x7f976410a970 2024-02-05T07:18:16.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.527+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 --> v1:172.21.15.184:6805/1083118002 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f974c07cf80 con 0x7f974c079270 2024-02-05T07:18:16.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.527+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_get_version_reply(handle=1 version=72) v2 ==== 24+0+0 (unknown 571355762 0 0) 0x7f9758087e70 con 0x7f976410a970 2024-02-05T07:18:16.530 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.528+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 <== osd.1 v1:172.21.15.184:6805/1083118002 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f974c07cf80 con 0x7f974c079270 2024-02-05T07:18:16.559 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.557+0000 7f976a7e7700 1 -- 172.21.15.184:0/3564635723 --> v1:172.21.15.184:6805/1083118002 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f97641abaf0 con 0x7f974c079270 2024-02-05T07:18:16.559 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.557+0000 7f97617fa700 1 -- 172.21.15.184:0/3564635723 <== osd.1 v1:172.21.15.184:6805/1083118002 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 781486577) 0x7f97641abaf0 con 0x7f974c079270 2024-02-05T07:18:16.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.558+0000 7f976a7e7700 1 -- 172.21.15.184:0/3564635723 >> v1:172.21.15.184:6805/1083118002 conn(0x7f974c079270 legacy=0x7f974c07b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:16.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.558+0000 7f976a7e7700 1 -- 172.21.15.184:0/3564635723 >> v1:172.21.15.184:6800/103463156 conn(0x7f974c06ea90 legacy=0x7f974c070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:16.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.558+0000 7f976a7e7700 1 -- 172.21.15.184:0/3564635723 >> v1:172.21.15.184:6789/0 conn(0x7f976410a970 legacy=0x7f97641a3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:16.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.558+0000 7f9768d84700 1 -- 172.21.15.184:0/3564635723 reap_dead start 2024-02-05T07:18:16.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.558+0000 7f976a7e7700 1 -- 172.21.15.184:0/3564635723 shutdown_connections 2024-02-05T07:18:16.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.558+0000 7f976a7e7700 1 -- 172.21.15.184:0/3564635723 >> 172.21.15.184:0/3564635723 conn(0x7f97640fd5d0 msgr2=0x7f9764111a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:16.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.558+0000 7f976a7e7700 1 -- 172.21.15.184:0/3564635723 shutdown_connections 2024-02-05T07:18:16.560 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:16.558+0000 7f976a7e7700 1 -- 172.21.15.184:0/3564635723 wait complete. 2024-02-05T07:18:17.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:18:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:18:18.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:18 smithi184 ceph-mon[29861]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:18:18.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:18 smithi184 ceph-mon[41609]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:18:18.330 INFO:teuthology.orchestra.run.smithi184.stdout:77309411370 2024-02-05T07:18:18.330 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-05T07:18:18.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:18 smithi188 ceph-mon[33283]: pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:18:18.782 INFO:teuthology.orchestra.run.smithi184.stdout:55834574895 2024-02-05T07:18:18.782 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-05T07:18:18.898 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:18.905 INFO:teuthology.orchestra.run.smithi184.stdout:236223201295 2024-02-05T07:18:18.906 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-02-05T07:18:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:19.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:19.703 INFO:teuthology.orchestra.run.smithi184.stdout:107374182436 2024-02-05T07:18:19.703 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-05T07:18:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:20 smithi188 ceph-mon[33283]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:20.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:20 smithi184 ceph-mon[29861]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:20.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:20 smithi184 ceph-mon[41609]: pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:21.144 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:21.145 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:22.021 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:18:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:18:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:18:22.307 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:22.314 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:22.315 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:22.316 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:22.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:22 smithi184 ceph-mon[29861]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:22.406 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:22 smithi184 ceph-mon[41609]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:22.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:22 smithi188 ceph-mon[33283]: pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:24.481 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:24 smithi184 ceph-mon[29861]: pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:24.481 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:24 smithi184 ceph-mon[41609]: pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:24 smithi188 ceph-mon[33283]: pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:24.943 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:25.297 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:25 smithi184 systemd[1]: Starting Ceph alertmanager.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:18:26.380 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:26 smithi184 ceph-mon[29861]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:26.381 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:26 smithi184 ceph-mon[41609]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:26.403 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.401+0000 7fc345452700 1 -- 172.21.15.184:0/4201584944 >> v1:172.21.15.184:6790/0 conn(0x7fc34010e650 legacy=0x7fc340110a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:26.403 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.401+0000 7fc345452700 1 -- 172.21.15.184:0/4201584944 shutdown_connections 2024-02-05T07:18:26.403 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.401+0000 7fc345452700 1 -- 172.21.15.184:0/4201584944 >> 172.21.15.184:0/4201584944 conn(0x7fc3400fc4c0 msgr2=0x7fc3400fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:26.403 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.401+0000 7fc345452700 1 -- 172.21.15.184:0/4201584944 shutdown_connections 2024-02-05T07:18:26.403 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.401+0000 7fc345452700 1 -- 172.21.15.184:0/4201584944 wait complete. 2024-02-05T07:18:26.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.402+0000 7fc345452700 1 Processor -- start 2024-02-05T07:18:26.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.402+0000 7fc345452700 1 -- start start 2024-02-05T07:18:26.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc345452700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc3401a8b80 con 0x7fc34010e650 2024-02-05T07:18:26.405 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc345452700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc3401a9d60 con 0x7fc340102d30 2024-02-05T07:18:26.405 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc345452700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc3401aaf40 con 0x7fc34010ab40 2024-02-05T07:18:26.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc3367fc700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7fc34010ab40 0x7fc3401a3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:47208/0 (socket says 172.21.15.184:47208) 2024-02-05T07:18:26.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc3367fc700 1 -- 172.21.15.184:0/62839880 learned_addr learned my addr 172.21.15.184:0/62839880 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:26.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335072848 0 0) 0x7fc3401aaf40 con 0x7fc34010ab40 2024-02-05T07:18:26.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc32c0035b0 con 0x7fc34010ab40 2024-02-05T07:18:26.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577455826 0 0) 0x7fc3401a8b80 con 0x7fc34010e650 2024-02-05T07:18:26.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3401aaf40 con 0x7fc34010e650 2024-02-05T07:18:26.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381576390 0 0) 0x7fc3401a9d60 con 0x7fc340102d30 2024-02-05T07:18:26.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3401a8b80 con 0x7fc340102d30 2024-02-05T07:18:26.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2819659938 0 0) 0x7fc32c0035b0 con 0x7fc34010ab40 2024-02-05T07:18:26.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc3401a9d60 con 0x7fc34010ab40 2024-02-05T07:18:26.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fc328001930 con 0x7fc34010ab40 2024-02-05T07:18:26.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 196528257 0 0) 0x7fc3401a8b80 con 0x7fc340102d30 2024-02-05T07:18:26.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc32c0035b0 con 0x7fc340102d30 2024-02-05T07:18:26.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fc330001830 con 0x7fc340102d30 2024-02-05T07:18:26.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3064202039 0 0) 0x7fc3401aaf40 con 0x7fc34010e650 2024-02-05T07:18:26.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc3401a8b80 con 0x7fc34010e650 2024-02-05T07:18:26.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fc338004760 con 0x7fc34010e650 2024-02-05T07:18:26.407 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3449360213 0 0) 0x7fc3401a9d60 con 0x7fc34010ab40 2024-02-05T07:18:26.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.403+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 >> v1:172.21.15.188:6789/0 conn(0x7fc340102d30 legacy=0x7fc34010a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:26.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.404+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 >> v1:172.21.15.184:6789/0 conn(0x7fc34010e650 legacy=0x7fc3401a73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:26.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.404+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3401ac140 con 0x7fc34010ab40 2024-02-05T07:18:26.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.404+0000 7fc345452700 1 -- 172.21.15.184:0/62839880 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3401ab130 con 0x7fc34010ab40 2024-02-05T07:18:26.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.404+0000 7fc345452700 1 -- 172.21.15.184:0/62839880 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3401ab5b0 con 0x7fc34010ab40 2024-02-05T07:18:26.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.404+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fc328003b30 con 0x7fc34010ab40 2024-02-05T07:18:26.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.404+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fc328005c20 con 0x7fc34010ab40 2024-02-05T07:18:26.408 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.405+0000 7fc345452700 1 -- 172.21.15.184:0/62839880 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc320005120 con 0x7fc34010ab40 2024-02-05T07:18:26.409 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.405+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7fc32801c2b0 con 0x7fc34010ab40 2024-02-05T07:18:26.409 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.406+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7fc3280889c0 con 0x7fc34010ab40 2024-02-05T07:18:26.412 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.410+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fc328055a30 con 0x7fc34010ab40 2024-02-05T07:18:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:26 smithi188 ceph-mon[33283]: pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:26.614 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.612+0000 7fc345452700 1 -- 172.21.15.184:0/62839880 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc3200053d0 con 0x7fc34010ab40 2024-02-05T07:18:26.614 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.612+0000 7fc33cff9700 1 -- 172.21.15.184:0/62839880 <== mon.2 v1:172.21.15.184:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (unknown 1823589948 0 1144977493) 0x7fc328054030 con 0x7fc34010ab40 2024-02-05T07:18:26.615 INFO:teuthology.orchestra.run.smithi184.stdout:128849018913 2024-02-05T07:18:26.617 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.615+0000 7fc345452700 1 -- 172.21.15.184:0/62839880 >> v1:172.21.15.184:6800/103463156 conn(0x7fc32c06ecc0 legacy=0x7fc32c071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:26.617 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.615+0000 7fc345452700 1 -- 172.21.15.184:0/62839880 >> v1:172.21.15.184:6790/0 conn(0x7fc34010ab40 legacy=0x7fc3401a3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:26.617 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.615+0000 7fc345452700 1 -- 172.21.15.184:0/62839880 shutdown_connections 2024-02-05T07:18:26.618 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.615+0000 7fc345452700 1 -- 172.21.15.184:0/62839880 >> 172.21.15.184:0/62839880 conn(0x7fc3400fc4c0 msgr2=0x7fc3400fe8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:26.618 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.615+0000 7fc345452700 1 -- 172.21.15.184:0/62839880 shutdown_connections 2024-02-05T07:18:26.618 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:26.615+0000 7fc345452700 1 -- 172.21.15.184:0/62839880 wait complete. 2024-02-05T07:18:27.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:27 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:18:27.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/62839880' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-05T07:18:27.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:27 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:18:27.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/62839880' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-05T07:18:27.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:27 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:18:27.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/62839880' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-05T07:18:27.499 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:18:27 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:18:28.465 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:28 smithi184 ceph-mon[29861]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-05T07:18:28.465 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:28 smithi184 ceph-mon[41609]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-05T07:18:28.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:28 smithi188 ceph-mon[33283]: pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-02-05T07:18:29.067 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018909 got 128849018913 for osd.4 2024-02-05T07:18:29.067 DEBUG:teuthology.parallel:result is None 2024-02-05T07:18:29.294 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:29.294 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:30.499 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:30 smithi184 ceph-mon[29861]: pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-05T07:18:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:30 smithi188 ceph-mon[33283]: pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-05T07:18:30.500 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:30 smithi184 ceph-mon[41609]: pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-05T07:18:30.925 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.923+0000 7efd221ac700 1 -- 172.21.15.184:0/797437624 >> v1:172.21.15.184:6790/0 conn(0x7efd1c10e630 legacy=0x7efd1c110af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:30.925 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.923+0000 7efd221ac700 1 -- 172.21.15.184:0/797437624 shutdown_connections 2024-02-05T07:18:30.925 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.923+0000 7efd221ac700 1 -- 172.21.15.184:0/797437624 >> 172.21.15.184:0/797437624 conn(0x7efd1c076e50 msgr2=0x7efd1c0fe1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:30.925 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.923+0000 7efd221ac700 1 -- 172.21.15.184:0/797437624 shutdown_connections 2024-02-05T07:18:30.925 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.923+0000 7efd221ac700 1 -- 172.21.15.184:0/797437624 wait complete. 2024-02-05T07:18:30.926 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.923+0000 7efd221ac700 1 Processor -- start 2024-02-05T07:18:30.926 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.923+0000 7efd221ac700 1 -- start start 2024-02-05T07:18:30.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd221ac700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7efd1c1a6a00 con 0x7efd1c10a960 2024-02-05T07:18:30.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd221ac700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7efd1c1a7c00 con 0x7efd1c106ae0 2024-02-05T07:18:30.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd221ac700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7efd1c1a8e00 con 0x7efd1c10e630 2024-02-05T07:18:30.927 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd1affd700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7efd1c10a960 0x7efd1c1a19e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:39848/0 (socket says 172.21.15.184:39848) 2024-02-05T07:18:30.928 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd1affd700 1 -- 172.21.15.184:0/3196020050 learned_addr learned my addr 172.21.15.184:0/3196020050 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:30.928 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878596067 0 0) 0x7efd1c1a8e00 con 0x7efd1c10e630 2024-02-05T07:18:30.928 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd040031f0 con 0x7efd1c10e630 2024-02-05T07:18:30.929 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 877019974 0 0) 0x7efd1c1a6a00 con 0x7efd1c10a960 2024-02-05T07:18:30.929 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd1c1a8e00 con 0x7efd1c10a960 2024-02-05T07:18:30.929 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229099039 0 0) 0x7efd1c1a7c00 con 0x7efd1c106ae0 2024-02-05T07:18:30.929 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd1c1a6a00 con 0x7efd1c106ae0 2024-02-05T07:18:30.929 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 788265683 0 0) 0x7efd040031f0 con 0x7efd1c10e630 2024-02-05T07:18:30.929 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efd1c1a7c00 con 0x7efd1c10e630 2024-02-05T07:18:30.929 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7efd14001440 con 0x7efd1c10e630 2024-02-05T07:18:30.929 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2332198263 0 0) 0x7efd1c1a8e00 con 0x7efd1c10a960 2024-02-05T07:18:30.929 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efd040031f0 con 0x7efd1c10a960 2024-02-05T07:18:30.929 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.924+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7efd0c001830 con 0x7efd1c10a960 2024-02-05T07:18:30.929 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.925+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1626485876 0 0) 0x7efd1c1a6a00 con 0x7efd1c106ae0 2024-02-05T07:18:30.929 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.925+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efd1c1a8e00 con 0x7efd1c106ae0 2024-02-05T07:18:30.931 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.925+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7efd100018d0 con 0x7efd1c106ae0 2024-02-05T07:18:30.931 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.925+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2563064407 0 0) 0x7efd1c1a7c00 con 0x7efd1c10e630 2024-02-05T07:18:30.931 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.925+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 >> v1:172.21.15.188:6789/0 conn(0x7efd1c106ae0 legacy=0x7efd1c0feee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:30.931 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.925+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 >> v1:172.21.15.184:6789/0 conn(0x7efd1c10a960 legacy=0x7efd1c1a19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:30.931 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.925+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c1aa000 con 0x7efd1c10e630 2024-02-05T07:18:30.931 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.925+0000 7efd221ac700 1 -- 172.21.15.184:0/3196020050 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1c1a6bf0 con 0x7efd1c10e630 2024-02-05T07:18:30.931 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.925+0000 7efd221ac700 1 -- 172.21.15.184:0/3196020050 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7efd1c1a7070 con 0x7efd1c10e630 2024-02-05T07:18:30.931 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.925+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7efd14001df0 con 0x7efd1c10e630 2024-02-05T07:18:30.931 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.925+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7efd14005040 con 0x7efd1c10e630 2024-02-05T07:18:30.932 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.926+0000 7efd221ac700 1 -- 172.21.15.184:0/3196020050 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd08005120 con 0x7efd1c10e630 2024-02-05T07:18:30.932 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.926+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7efd1401b7b0 con 0x7efd1c10e630 2024-02-05T07:18:30.932 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.927+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7efd14087dd0 con 0x7efd1c10e630 2024-02-05T07:18:30.933 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.931+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7efd140550b0 con 0x7efd1c10e630 2024-02-05T07:18:31.011 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.830+0000 7f6936573700 1 -- 172.21.15.184:0/2426129171 >> v1:172.21.15.184:6790/0 conn(0x7f693010d480 legacy=0x7f693010f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:31.011 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.830+0000 7f6936573700 1 -- 172.21.15.184:0/2426129171 shutdown_connections 2024-02-05T07:18:31.011 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.830+0000 7f6936573700 1 -- 172.21.15.184:0/2426129171 >> 172.21.15.184:0/2426129171 conn(0x7f69300fc510 msgr2=0x7f69300fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:31.011 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.830+0000 7f6936573700 1 -- 172.21.15.184:0/2426129171 shutdown_connections 2024-02-05T07:18:31.011 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.830+0000 7f6936573700 1 -- 172.21.15.184:0/2426129171 wait complete. 2024-02-05T07:18:31.012 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.831+0000 7f6936573700 1 Processor -- start 2024-02-05T07:18:31.012 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.831+0000 7f6936573700 1 -- start start 2024-02-05T07:18:31.012 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f6936573700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f69301a5880 con 0x7f6930106a00 2024-02-05T07:18:31.012 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f6936573700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f69301a6a60 con 0x7f693010d480 2024-02-05T07:18:31.012 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f6936573700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f69301a7c60 con 0x7f69301098b0 2024-02-05T07:18:31.012 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692f7fe700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f69301098b0 0x7f69301a0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:55906/0 (socket says 172.21.15.184:55906) 2024-02-05T07:18:31.012 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692ffff700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f6930106a00 0x7f693010cb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:39832/0 (socket says 172.21.15.184:39832) 2024-02-05T07:18:31.012 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692f7fe700 1 -- 172.21.15.184:0/3093331196 learned_addr learned my addr 172.21.15.184:0/3093331196 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:31.012 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857826081 0 0) 0x7f69301a7c60 con 0x7f69301098b0 2024-02-05T07:18:31.012 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69180049e0 con 0x7f69301098b0 2024-02-05T07:18:31.012 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2712806025 0 0) 0x7f69301a5880 con 0x7f6930106a00 2024-02-05T07:18:31.012 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69301a7c60 con 0x7f6930106a00 2024-02-05T07:18:31.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880472136 0 0) 0x7f69301a6a60 con 0x7f693010d480 2024-02-05T07:18:31.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69301a5880 con 0x7f693010d480 2024-02-05T07:18:31.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1107867646 0 0) 0x7f69180049e0 con 0x7f69301098b0 2024-02-05T07:18:31.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f69301a6a60 con 0x7f69301098b0 2024-02-05T07:18:31.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6924001930 con 0x7f69301098b0 2024-02-05T07:18:31.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1895070361 0 0) 0x7f69301a7c60 con 0x7f6930106a00 2024-02-05T07:18:31.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f69180049e0 con 0x7f6930106a00 2024-02-05T07:18:31.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f69200019f0 con 0x7f6930106a00 2024-02-05T07:18:31.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4144614152 0 0) 0x7f69301a5880 con 0x7f693010d480 2024-02-05T07:18:31.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f69301a7c60 con 0x7f693010d480 2024-02-05T07:18:31.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.832+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6928001d40 con 0x7f693010d480 2024-02-05T07:18:31.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.833+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 77332383 0 0) 0x7f69301a6a60 con 0x7f69301098b0 2024-02-05T07:18:31.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.833+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 >> v1:172.21.15.188:6789/0 conn(0x7f693010d480 legacy=0x7f69301a3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:31.013 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.833+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 >> v1:172.21.15.184:6789/0 conn(0x7f6930106a00 legacy=0x7f693010cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:31.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.833+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69301a8e60 con 0x7f69301098b0 2024-02-05T07:18:31.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.833+0000 7f6936573700 1 -- 172.21.15.184:0/3093331196 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69301a5a70 con 0x7f69301098b0 2024-02-05T07:18:31.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.833+0000 7f6936573700 1 -- 172.21.15.184:0/3093331196 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f69301a5ef0 con 0x7f69301098b0 2024-02-05T07:18:31.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.833+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f6924003b30 con 0x7f69301098b0 2024-02-05T07:18:31.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.833+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f6924005bb0 con 0x7f69301098b0 2024-02-05T07:18:31.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.834+0000 7f6936573700 1 -- 172.21.15.184:0/3093331196 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f691c005150 con 0x7f69301098b0 2024-02-05T07:18:31.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.834+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f692401c320 con 0x7f69301098b0 2024-02-05T07:18:31.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.835+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7f6924088a00 con 0x7f69301098b0 2024-02-05T07:18:31.014 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:30.839+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f6924055a70 con 0x7f69301098b0 2024-02-05T07:18:31.064 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.062+0000 7f6936573700 1 -- 172.21.15.184:0/3093331196 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f691c005400 con 0x7f69301098b0 2024-02-05T07:18:31.065 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.062+0000 7f692d7fa700 1 -- 172.21.15.184:0/3093331196 <== mon.2 v1:172.21.15.184:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (unknown 92182286 0 3275464226) 0x7f6924054070 con 0x7f69301098b0 2024-02-05T07:18:31.065 INFO:teuthology.orchestra.run.smithi184.stdout:77309411373 2024-02-05T07:18:31.067 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.065+0000 7f6936573700 1 -- 172.21.15.184:0/3093331196 >> v1:172.21.15.184:6800/103463156 conn(0x7f691806eb10 legacy=0x7f6918070fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:31.067 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.065+0000 7f6936573700 1 -- 172.21.15.184:0/3093331196 >> v1:172.21.15.184:6790/0 conn(0x7f69301098b0 legacy=0x7f69301a0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:31.067 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.065+0000 7f6936573700 1 -- 172.21.15.184:0/3093331196 shutdown_connections 2024-02-05T07:18:31.067 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.065+0000 7f6936573700 1 -- 172.21.15.184:0/3093331196 >> 172.21.15.184:0/3093331196 conn(0x7f69300fc510 msgr2=0x7f69301106c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:31.067 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.065+0000 7f6936573700 1 -- 172.21.15.184:0/3093331196 shutdown_connections 2024-02-05T07:18:31.067 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.065+0000 7f6936573700 1 -- 172.21.15.184:0/3093331196 wait complete. 2024-02-05T07:18:31.158 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.156+0000 7efd221ac700 1 -- 172.21.15.184:0/3196020050 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7efd080053d0 con 0x7efd1c10e630 2024-02-05T07:18:31.159 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.157+0000 7efd18ff9700 1 -- 172.21.15.184:0/3196020050 <== mon.2 v1:172.21.15.184:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (unknown 832126871 0 2868210388) 0x7efd14053420 con 0x7efd1c10e630 2024-02-05T07:18:31.159 INFO:teuthology.orchestra.run.smithi184.stdout:55834574898 2024-02-05T07:18:31.161 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.159+0000 7efd221ac700 1 -- 172.21.15.184:0/3196020050 >> v1:172.21.15.184:6800/103463156 conn(0x7efd0406eac0 legacy=0x7efd04070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:31.161 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.159+0000 7efd221ac700 1 -- 172.21.15.184:0/3196020050 >> v1:172.21.15.184:6790/0 conn(0x7efd1c10e630 legacy=0x7efd1c1a5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:31.161 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.159+0000 7efd221ac700 1 -- 172.21.15.184:0/3196020050 shutdown_connections 2024-02-05T07:18:31.161 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.159+0000 7efd221ac700 1 -- 172.21.15.184:0/3196020050 >> 172.21.15.184:0/3196020050 conn(0x7efd1c076e50 msgr2=0x7efd1c0ffea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:31.161 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.159+0000 7efd221ac700 1 -- 172.21.15.184:0/3196020050 shutdown_connections 2024-02-05T07:18:31.161 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:31.159+0000 7efd221ac700 1 -- 172.21.15.184:0/3196020050 wait complete. 2024-02-05T07:18:31.415 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3093331196' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-05T07:18:31.415 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3196020050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-05T07:18:31.416 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3093331196' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-05T07:18:31.416 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3196020050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-05T07:18:31.416 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:31 smithi184 podman[77693]: 2024-02-05 07:18:31.036195944 +0000 UTC m=+1.749663926 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-02-05T07:18:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3093331196' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-05T07:18:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3196020050' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-05T07:18:32.021 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:18:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:18:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:18:32.075 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411370 got 77309411373 for osd.2 2024-02-05T07:18:32.075 DEBUG:teuthology.parallel:result is None 2024-02-05T07:18:32.431 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:32 smithi184 ceph-mon[29861]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:32.432 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:32 smithi184 ceph-mon[41609]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:32.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:32 smithi188 ceph-mon[33283]: pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:32.978 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:32 smithi184 podman[77693]: 2024-02-05 07:18:32.883990357 +0000 UTC m=+3.597458335 volume create 20a3ae0b323f831328f8ca676811f94efda8419d4547a75bb7be2de21db74586 2024-02-05T07:18:32.978 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:32 smithi184 podman[77693]: 2024-02-05 07:18:32.976112962 +0000 UTC m=+3.689580940 container create ab9854627eb36e3d973eb18cbfcafe68e230ea8a232348db1b187d03fed69f5c (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-02-05T07:18:33.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2015241967' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-05T07:18:33.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2015241967' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-05T07:18:33.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2015241967' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-05T07:18:33.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.886+0000 7fa63986a700 1 -- 172.21.15.184:0/1228563404 >> v1:172.21.15.184:6789/0 conn(0x7fa63410e540 legacy=0x7fa634110a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:33.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.886+0000 7fa63986a700 1 -- 172.21.15.184:0/1228563404 shutdown_connections 2024-02-05T07:18:33.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.886+0000 7fa63986a700 1 -- 172.21.15.184:0/1228563404 >> 172.21.15.184:0/1228563404 conn(0x7fa6340fd5d0 msgr2=0x7fa6340ff9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:33.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.886+0000 7fa63986a700 1 -- 172.21.15.184:0/1228563404 shutdown_connections 2024-02-05T07:18:33.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.886+0000 7fa63986a700 1 -- 172.21.15.184:0/1228563404 wait complete. 2024-02-05T07:18:33.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.886+0000 7fa63986a700 1 Processor -- start 2024-02-05T07:18:33.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa63986a700 1 -- start start 2024-02-05T07:18:33.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa63986a700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa6341a6a00 con 0x7fa63410e540 2024-02-05T07:18:33.792 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa63986a700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa6341a7c00 con 0x7fa63410a970 2024-02-05T07:18:33.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa63986a700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa6341a8e00 con 0x7fa634107ac0 2024-02-05T07:18:33.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa632ffd700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7fa634107ac0 0x7fa63410dbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:55926/0 (socket says 172.21.15.184:55926) 2024-02-05T07:18:33.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa632ffd700 1 -- 172.21.15.184:0/2015241967 learned_addr learned my addr 172.21.15.184:0/2015241967 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:33.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659411738 0 0) 0x7fa6341a8e00 con 0x7fa634107ac0 2024-02-05T07:18:33.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa61c0035b0 con 0x7fa634107ac0 2024-02-05T07:18:33.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586306493 0 0) 0x7fa6341a6a00 con 0x7fa63410e540 2024-02-05T07:18:33.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6341a8e00 con 0x7fa63410e540 2024-02-05T07:18:33.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381157646 0 0) 0x7fa6341a7c00 con 0x7fa63410a970 2024-02-05T07:18:33.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6341a6a00 con 0x7fa63410a970 2024-02-05T07:18:33.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 152474374 0 0) 0x7fa6341a8e00 con 0x7fa63410e540 2024-02-05T07:18:33.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa6341a7c00 con 0x7fa63410e540 2024-02-05T07:18:33.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2496506610 0 0) 0x7fa61c0035b0 con 0x7fa634107ac0 2024-02-05T07:18:33.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa6341a8e00 con 0x7fa634107ac0 2024-02-05T07:18:33.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fa62c001ce0 con 0x7fa63410e540 2024-02-05T07:18:33.793 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.887+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fa628001970 con 0x7fa634107ac0 2024-02-05T07:18:33.794 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.888+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2047751374 0 0) 0x7fa6341a7c00 con 0x7fa63410e540 2024-02-05T07:18:33.794 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.888+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 >> v1:172.21.15.184:6790/0 conn(0x7fa634107ac0 legacy=0x7fa63410dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:33.794 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.888+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 >> v1:172.21.15.188:6789/0 conn(0x7fa63410a970 legacy=0x7fa6341a18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:33.794 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.888+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6341aa000 con 0x7fa63410e540 2024-02-05T07:18:33.794 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.888+0000 7fa63986a700 1 -- 172.21.15.184:0/2015241967 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6341a6bf0 con 0x7fa63410e540 2024-02-05T07:18:33.794 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.888+0000 7fa63986a700 1 -- 172.21.15.184:0/2015241967 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6341a7070 con 0x7fa63410e540 2024-02-05T07:18:33.794 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.888+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fa62c004a50 con 0x7fa63410e540 2024-02-05T07:18:33.794 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.888+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fa62c005120 con 0x7fa63410e540 2024-02-05T07:18:33.794 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.889+0000 7fa63986a700 1 -- 172.21.15.184:0/2015241967 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa620005150 con 0x7fa63410e540 2024-02-05T07:18:33.794 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.889+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7fa62c003a00 con 0x7fa63410e540 2024-02-05T07:18:33.794 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.890+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7fa62c087af0 con 0x7fa63410e540 2024-02-05T07:18:33.794 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:32.894+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fa62c054ed0 con 0x7fa63410e540 2024-02-05T07:18:33.794 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:33.094+0000 7fa63986a700 1 -- 172.21.15.184:0/2015241967 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa620005400 con 0x7fa63410e540 2024-02-05T07:18:33.794 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:33.094+0000 7fa638868700 1 -- 172.21.15.184:0/2015241967 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (unknown 2131975755 0 445417845) 0x7fa62c053240 con 0x7fa63410e540 2024-02-05T07:18:33.795 INFO:teuthology.orchestra.run.smithi184.stdout:163208757277 2024-02-05T07:18:33.795 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:33.096+0000 7fa63986a700 1 -- 172.21.15.184:0/2015241967 >> v1:172.21.15.184:6800/103463156 conn(0x7fa61c06e770 legacy=0x7fa61c070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:33.795 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:33.096+0000 7fa63986a700 1 -- 172.21.15.184:0/2015241967 >> v1:172.21.15.184:6789/0 conn(0x7fa63410e540 legacy=0x7fa6341a5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:33.795 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:33.097+0000 7fa63986a700 1 -- 172.21.15.184:0/2015241967 shutdown_connections 2024-02-05T07:18:33.795 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:33.097+0000 7fa63986a700 1 -- 172.21.15.184:0/2015241967 >> 172.21.15.184:0/2015241967 conn(0x7fa6340fd5d0 msgr2=0x7fa634101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:33.795 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:33.097+0000 7fa63986a700 1 -- 172.21.15.184:0/2015241967 shutdown_connections 2024-02-05T07:18:33.795 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:33.097+0000 7fa63986a700 1 -- 172.21.15.184:0/2015241967 wait complete. 2024-02-05T07:18:34.236 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.155+0000 7f752befc700 1 -- 172.21.15.184:0/458383513 >> v1:172.21.15.184:6790/0 conn(0x7f752410d430 legacy=0x7f752410f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:34.236 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.155+0000 7f752befc700 1 -- 172.21.15.184:0/458383513 shutdown_connections 2024-02-05T07:18:34.236 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.155+0000 7f752befc700 1 -- 172.21.15.184:0/458383513 >> 172.21.15.184:0/458383513 conn(0x7f75240fc4c0 msgr2=0x7f75240fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:34.236 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.155+0000 7f752befc700 1 -- 172.21.15.184:0/458383513 shutdown_connections 2024-02-05T07:18:34.236 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.155+0000 7f752befc700 1 -- 172.21.15.184:0/458383513 wait complete. 2024-02-05T07:18:34.237 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.155+0000 7f752befc700 1 Processor -- start 2024-02-05T07:18:34.237 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.155+0000 7f752befc700 1 -- start start 2024-02-05T07:18:34.237 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f752befc700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f75241a5990 con 0x7f75241069b0 2024-02-05T07:18:34.237 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f752befc700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f75241a6b70 con 0x7f752410d430 2024-02-05T07:18:34.237 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f752befc700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f75241a7d70 con 0x7f7524109860 2024-02-05T07:18:34.237 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f7529c98700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f75241069b0 0x7f752410cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:39898/0 (socket says 172.21.15.184:39898) 2024-02-05T07:18:34.237 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f7529c98700 1 -- 172.21.15.184:0/3163679315 learned_addr learned my addr 172.21.15.184:0/3163679315 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:34.237 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f7529497700 1 --1- 172.21.15.184:0/3163679315 >> v1:172.21.15.184:6790/0 conn(0x7f7524109860 0x7f75241a07e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:55938/0 (socket says 172.21.15.184:55938) 2024-02-05T07:18:34.237 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 442911241 0 0) 0x7f75241a7d70 con 0x7f7524109860 2024-02-05T07:18:34.237 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75100035b0 con 0x7f7524109860 2024-02-05T07:18:34.237 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304887742 0 0) 0x7f75241a5990 con 0x7f75241069b0 2024-02-05T07:18:34.237 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75241a7d70 con 0x7f75241069b0 2024-02-05T07:18:34.237 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1400684607 0 0) 0x7f75241a6b70 con 0x7f752410d430 2024-02-05T07:18:34.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75241a5990 con 0x7f752410d430 2024-02-05T07:18:34.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2487488428 0 0) 0x7f75100035b0 con 0x7f7524109860 2024-02-05T07:18:34.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f75241a6b70 con 0x7f7524109860 2024-02-05T07:18:34.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f7514001970 con 0x7f7524109860 2024-02-05T07:18:34.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1873917055 0 0) 0x7f75241a7d70 con 0x7f75241069b0 2024-02-05T07:18:34.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f75100035b0 con 0x7f75241069b0 2024-02-05T07:18:34.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f7520001b70 con 0x7f75241069b0 2024-02-05T07:18:34.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3545826919 0 0) 0x7f75241a6b70 con 0x7f7524109860 2024-02-05T07:18:34.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 >> v1:172.21.15.188:6789/0 conn(0x7f752410d430 legacy=0x7f75241a4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:34.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 >> v1:172.21.15.184:6789/0 conn(0x7f75241069b0 legacy=0x7f752410cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:34.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75241a8f70 con 0x7f7524109860 2024-02-05T07:18:34.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f752befc700 1 -- 172.21.15.184:0/3163679315 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75241a7f60 con 0x7f7524109860 2024-02-05T07:18:34.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f752befc700 1 -- 172.21.15.184:0/3163679315 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f75241a83e0 con 0x7f7524109860 2024-02-05T07:18:34.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f7514001020 con 0x7f7524109860 2024-02-05T07:18:34.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.156+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f7514005ab0 con 0x7f7524109860 2024-02-05T07:18:34.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.157+0000 7f752befc700 1 -- 172.21.15.184:0/3163679315 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7508005120 con 0x7f7524109860 2024-02-05T07:18:34.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.158+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f7514003680 con 0x7f7524109860 2024-02-05T07:18:34.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.158+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7f75140887e0 con 0x7f7524109860 2024-02-05T07:18:34.239 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.163+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f7514055ae0 con 0x7f7524109860 2024-02-05T07:18:34.367 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.365+0000 7f752befc700 1 -- 172.21.15.184:0/3163679315 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f75080053d0 con 0x7f7524109860 2024-02-05T07:18:34.368 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:34 smithi184 ceph-mon[29861]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:34.368 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:34 smithi184 ceph-mon[41609]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:34.368 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.365+0000 7f751affd700 1 -- 172.21.15.184:0/3163679315 <== mon.2 v1:172.21.15.184:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (unknown 1274345170 0 393369010) 0x7f7514053e50 con 0x7f7524109860 2024-02-05T07:18:34.368 INFO:teuthology.orchestra.run.smithi184.stdout:197568495639 2024-02-05T07:18:34.370 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.368+0000 7f752befc700 1 -- 172.21.15.184:0/3163679315 >> v1:172.21.15.184:6800/103463156 conn(0x7f7510070950 legacy=0x7f7510072e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:34.370 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.368+0000 7f752befc700 1 -- 172.21.15.184:0/3163679315 >> v1:172.21.15.184:6790/0 conn(0x7f7524109860 legacy=0x7f75241a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:34.370 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.368+0000 7f752befc700 1 -- 172.21.15.184:0/3163679315 shutdown_connections 2024-02-05T07:18:34.370 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.368+0000 7f752befc700 1 -- 172.21.15.184:0/3163679315 >> 172.21.15.184:0/3163679315 conn(0x7f75240fc4c0 msgr2=0x7f7524108f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:34.371 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.368+0000 7f752befc700 1 -- 172.21.15.184:0/3163679315 shutdown_connections 2024-02-05T07:18:34.371 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:34.368+0000 7f752befc700 1 -- 172.21.15.184:0/3163679315 wait complete. 2024-02-05T07:18:34.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:34 smithi188 ceph-mon[33283]: pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:34.665 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757273 got 163208757277 for osd.5 2024-02-05T07:18:34.666 DEBUG:teuthology.parallel:result is None 2024-02-05T07:18:35.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3163679315' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-05T07:18:35.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3163679315' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-05T07:18:35.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3163679315' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-05T07:18:35.589 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574895 got 55834574898 for osd.1 2024-02-05T07:18:35.589 DEBUG:teuthology.parallel:result is None 2024-02-05T07:18:35.943 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495634 got 197568495639 for osd.6 2024-02-05T07:18:35.944 DEBUG:teuthology.parallel:result is None 2024-02-05T07:18:36.243 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:36 smithi184 podman[77693]: 2024-02-05 07:18:36.031006884 +0000 UTC m=+6.744474870 container init ab9854627eb36e3d973eb18cbfcafe68e230ea8a232348db1b187d03fed69f5c (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-02-05T07:18:36.243 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:36 smithi184 podman[77693]: 2024-02-05 07:18:36.037605732 +0000 UTC m=+6.751073710 container start ab9854627eb36e3d973eb18cbfcafe68e230ea8a232348db1b187d03fed69f5c (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-02-05T07:18:36.243 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[78025]: ts=2024-02-05T07:18:36.051Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-02-05T07:18:36.243 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[78025]: ts=2024-02-05T07:18:36.051Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-02-05T07:18:36.243 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[78025]: ts=2024-02-05T07:18:36.052Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.184 port=9094 2024-02-05T07:18:36.243 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[78025]: ts=2024-02-05T07:18:36.053Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-05T07:18:36.243 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[78025]: ts=2024-02-05T07:18:36.076Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-05T07:18:36.244 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[78025]: ts=2024-02-05T07:18:36.077Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-05T07:18:36.244 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[78025]: ts=2024-02-05T07:18:36.079Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-02-05T07:18:36.244 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[78025]: ts=2024-02-05T07:18:36.079Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-02-05T07:18:36.244 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:36 smithi184 bash[77693]: ab9854627eb36e3d973eb18cbfcafe68e230ea8a232348db1b187d03fed69f5c 2024-02-05T07:18:36.244 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:36 smithi184 systemd[1]: Started Ceph alertmanager.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:18:36.395 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.390+0000 7ffad7c16700 1 -- 172.21.15.184:0/38277733 >> v1:172.21.15.184:6790/0 conn(0x7ffad010e660 legacy=0x7ffad0110a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:36.395 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.390+0000 7ffad7c16700 1 -- 172.21.15.184:0/38277733 shutdown_connections 2024-02-05T07:18:36.395 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.390+0000 7ffad7c16700 1 -- 172.21.15.184:0/38277733 >> 172.21.15.184:0/38277733 conn(0x7ffad00fc4b0 msgr2=0x7ffad00fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:36.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.390+0000 7ffad7c16700 1 -- 172.21.15.184:0/38277733 shutdown_connections 2024-02-05T07:18:36.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.390+0000 7ffad7c16700 1 -- 172.21.15.184:0/38277733 wait complete. 2024-02-05T07:18:36.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.391+0000 7ffad7c16700 1 Processor -- start 2024-02-05T07:18:36.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.391+0000 7ffad7c16700 1 -- start start 2024-02-05T07:18:36.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.391+0000 7ffad7c16700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ffad01a6ae0 con 0x7ffad010e660 2024-02-05T07:18:36.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.391+0000 7ffad7c16700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ffad01a7cc0 con 0x7ffad0102d40 2024-02-05T07:18:36.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.391+0000 7ffad7c16700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ffad01a8ec0 con 0x7ffad010ab50 2024-02-05T07:18:36.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.391+0000 7ffad51b1700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7ffad010ab50 0x7ffad01a18c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:55956/0 (socket says 172.21.15.184:55956) 2024-02-05T07:18:36.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.391+0000 7ffad61b3700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7ffad010e660 0x7ffad01a51a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:39912/0 (socket says 172.21.15.184:39912) 2024-02-05T07:18:36.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.391+0000 7ffad51b1700 1 -- 172.21.15.184:0/3145423417 learned_addr learned my addr 172.21.15.184:0/3145423417 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:36.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.391+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699555059 0 0) 0x7ffad01a6ae0 con 0x7ffad010e660 2024-02-05T07:18:36.396 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffabc0035b0 con 0x7ffad010e660 2024-02-05T07:18:36.397 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451936963 0 0) 0x7ffad01a8ec0 con 0x7ffad010ab50 2024-02-05T07:18:36.397 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffad01a6ae0 con 0x7ffad010ab50 2024-02-05T07:18:36.397 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028653457 0 0) 0x7ffad01a7cc0 con 0x7ffad0102d40 2024-02-05T07:18:36.397 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffad01a8ec0 con 0x7ffad0102d40 2024-02-05T07:18:36.397 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 872554585 0 0) 0x7ffabc0035b0 con 0x7ffad010e660 2024-02-05T07:18:36.397 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffad01a7cc0 con 0x7ffad010e660 2024-02-05T07:18:36.397 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7ffac8004670 con 0x7ffad010e660 2024-02-05T07:18:36.397 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 859049050 0 0) 0x7ffad01a6ae0 con 0x7ffad010ab50 2024-02-05T07:18:36.397 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffabc0035b0 con 0x7ffad010ab50 2024-02-05T07:18:36.397 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7ffacc001830 con 0x7ffad010ab50 2024-02-05T07:18:36.397 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2523476014 0 0) 0x7ffad01a8ec0 con 0x7ffad0102d40 2024-02-05T07:18:36.397 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffad01a6ae0 con 0x7ffad0102d40 2024-02-05T07:18:36.397 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7ffac00017e0 con 0x7ffad0102d40 2024-02-05T07:18:36.397 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2555706350 0 0) 0x7ffad01a7cc0 con 0x7ffad010e660 2024-02-05T07:18:36.397 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 >> v1:172.21.15.184:6790/0 conn(0x7ffad010ab50 legacy=0x7ffad01a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:36.398 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 >> v1:172.21.15.188:6789/0 conn(0x7ffad0102d40 legacy=0x7ffad010a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:36.398 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad01aa0c0 con 0x7ffad010e660 2024-02-05T07:18:36.398 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffad7c16700 1 -- 172.21.15.184:0/3145423417 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad01a90b0 con 0x7ffad010e660 2024-02-05T07:18:36.398 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffad7c16700 1 -- 172.21.15.184:0/3145423417 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad01a9530 con 0x7ffad010e660 2024-02-05T07:18:36.398 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7ffac8001de0 con 0x7ffad010e660 2024-02-05T07:18:36.398 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.392+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7ffac8005170 con 0x7ffad010e660 2024-02-05T07:18:36.398 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.393+0000 7ffad7c16700 1 -- 172.21.15.184:0/3145423417 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad006a850 con 0x7ffad010e660 2024-02-05T07:18:36.399 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.394+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7ffac80052d0 con 0x7ffad010e660 2024-02-05T07:18:36.399 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.394+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7ffac8088e50 con 0x7ffad010e660 2024-02-05T07:18:36.403 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.401+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7ffac8056150 con 0x7ffad010e660 2024-02-05T07:18:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:36 smithi188 ceph-mon[33283]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:36 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:36 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:36 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:36 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:36.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-mon[29861]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:36.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:36.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:36.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:36.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-mon[41609]: pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:36.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:36.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:36.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:36.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:36.522 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:18:36] ENGINE Bus STOPPING 2024-02-05T07:18:36.522 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:18:36] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-05T07:18:36.522 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:18:36] ENGINE Bus STOPPED 2024-02-05T07:18:36.522 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:18:36] ENGINE Bus STARTING 2024-02-05T07:18:36.522 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:18:36] ENGINE Serving on http://:::9283 2024-02-05T07:18:36.523 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:18:36 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:18:36] ENGINE Bus STARTED 2024-02-05T07:18:36.609 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.606+0000 7ffad7c16700 1 -- 172.21.15.184:0/3145423417 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ffad0068610 con 0x7ffad010e660 2024-02-05T07:18:36.609 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.606+0000 7ffac6ffd700 1 -- 172.21.15.184:0/3145423417 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 1451115110) 0x7ffac8050e60 con 0x7ffad010e660 2024-02-05T07:18:36.609 INFO:teuthology.orchestra.run.smithi184.stdout:34359738424 2024-02-05T07:18:36.611 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.608+0000 7ffad7c16700 1 -- 172.21.15.184:0/3145423417 >> v1:172.21.15.184:6800/103463156 conn(0x7ffabc06eb60 legacy=0x7ffabc071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:36.611 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.608+0000 7ffad7c16700 1 -- 172.21.15.184:0/3145423417 >> v1:172.21.15.184:6789/0 conn(0x7ffad010e660 legacy=0x7ffad01a51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:36.611 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.608+0000 7ffad7c16700 1 -- 172.21.15.184:0/3145423417 shutdown_connections 2024-02-05T07:18:36.612 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.608+0000 7ffad7c16700 1 -- 172.21.15.184:0/3145423417 >> 172.21.15.184:0/3145423417 conn(0x7ffad00fc4b0 msgr2=0x7ffad00fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:36.612 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.608+0000 7ffad7c16700 1 -- 172.21.15.184:0/3145423417 shutdown_connections 2024-02-05T07:18:36.612 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:36.608+0000 7ffad7c16700 1 -- 172.21.15.184:0/3145423417 wait complete. 2024-02-05T07:18:37.026 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.024+0000 7f5edae12700 1 -- 172.21.15.184:0/3263069366 >> v1:172.21.15.184:6789/0 conn(0x7f5ed4109860 legacy=0x7f5ed410bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:37.026 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.024+0000 7f5edae12700 1 -- 172.21.15.184:0/3263069366 shutdown_connections 2024-02-05T07:18:37.026 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.024+0000 7f5edae12700 1 -- 172.21.15.184:0/3263069366 >> 172.21.15.184:0/3263069366 conn(0x7f5ed40fc4c0 msgr2=0x7f5ed40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:37.026 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.024+0000 7f5edae12700 1 -- 172.21.15.184:0/3263069366 shutdown_connections 2024-02-05T07:18:37.026 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.024+0000 7f5edae12700 1 -- 172.21.15.184:0/3263069366 wait complete. 2024-02-05T07:18:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.024+0000 7f5edae12700 1 Processor -- start 2024-02-05T07:18:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.024+0000 7f5edae12700 1 -- start start 2024-02-05T07:18:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5edae12700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5ed41a5870 con 0x7f5ed41069b0 2024-02-05T07:18:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5edae12700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5ed41a6a50 con 0x7f5ed410d430 2024-02-05T07:18:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5edae12700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5ed41a7c50 con 0x7f5ed4109860 2024-02-05T07:18:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed8bae700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f5ed41069b0 0x7f5ed410cb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:39932/0 (socket says 172.21.15.184:39932) 2024-02-05T07:18:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed8bae700 1 -- 172.21.15.184:0/541171691 learned_addr learned my addr 172.21.15.184:0/541171691 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818110243 0 0) 0x7f5ed41a5870 con 0x7f5ed41069b0 2024-02-05T07:18:37.028 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ec40035b0 con 0x7f5ed41069b0 2024-02-05T07:18:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353352547 0 0) 0x7f5ed41a7c50 con 0x7f5ed4109860 2024-02-05T07:18:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed41a5870 con 0x7f5ed4109860 2024-02-05T07:18:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650980155 0 0) 0x7f5ed41a6a50 con 0x7f5ed410d430 2024-02-05T07:18:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed41a7c50 con 0x7f5ed410d430 2024-02-05T07:18:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4072195441 0 0) 0x7f5ec40035b0 con 0x7f5ed41069b0 2024-02-05T07:18:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5ed41a6a50 con 0x7f5ed41069b0 2024-02-05T07:18:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4073358100 0 0) 0x7f5ed41a5870 con 0x7f5ed4109860 2024-02-05T07:18:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5ec40035b0 con 0x7f5ed4109860 2024-02-05T07:18:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f5ec8001930 con 0x7f5ed41069b0 2024-02-05T07:18:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f5ec0004320 con 0x7f5ed4109860 2024-02-05T07:18:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3498732158 0 0) 0x7f5ed41a7c50 con 0x7f5ed410d430 2024-02-05T07:18:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5ed41a5870 con 0x7f5ed410d430 2024-02-05T07:18:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f5ecc001bb0 con 0x7f5ed410d430 2024-02-05T07:18:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3865140539 0 0) 0x7f5ed41a6a50 con 0x7f5ed41069b0 2024-02-05T07:18:37.029 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 >> v1:172.21.15.184:6790/0 conn(0x7f5ed4109860 legacy=0x7f5ed41a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:37.030 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.025+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 >> v1:172.21.15.188:6789/0 conn(0x7f5ed410d430 legacy=0x7f5ed41a3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:37.030 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.026+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed41a8e50 con 0x7f5ed41069b0 2024-02-05T07:18:37.030 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.026+0000 7f5edae12700 1 -- 172.21.15.184:0/541171691 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed41a7e40 con 0x7f5ed41069b0 2024-02-05T07:18:37.030 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.026+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f5ec8001c70 con 0x7f5ed41069b0 2024-02-05T07:18:37.030 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.026+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f5ec8005ca0 con 0x7f5ed41069b0 2024-02-05T07:18:37.030 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.026+0000 7f5edae12700 1 -- 172.21.15.184:0/541171691 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed41a82c0 con 0x7f5ed41069b0 2024-02-05T07:18:37.030 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.027+0000 7f5edae12700 1 -- 172.21.15.184:0/541171691 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed41020f0 con 0x7f5ed41069b0 2024-02-05T07:18:37.031 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.027+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f5ec8003fd0 con 0x7f5ed41069b0 2024-02-05T07:18:37.031 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.028+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7f5ec8088a20 con 0x7f5ed41069b0 2024-02-05T07:18:37.034 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.032+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f5ec8055d20 con 0x7f5ed41069b0 2024-02-05T07:18:37.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.238+0000 7f5edae12700 1 -- 172.21.15.184:0/541171691 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f5ed4068610 con 0x7f5ed41069b0 2024-02-05T07:18:37.240 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.238+0000 7f5ed1ffb700 1 -- 172.21.15.184:0/541171691 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (unknown 1482059429 0 397825816) 0x7f5ec8054090 con 0x7f5ed41069b0 2024-02-05T07:18:37.240 INFO:teuthology.orchestra.run.smithi184.stdout:236223201299 2024-02-05T07:18:37.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.240+0000 7f5edae12700 1 -- 172.21.15.184:0/541171691 >> v1:172.21.15.184:6800/103463156 conn(0x7f5ec406ecb0 legacy=0x7f5ec4071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:37.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.240+0000 7f5edae12700 1 -- 172.21.15.184:0/541171691 >> v1:172.21.15.184:6789/0 conn(0x7f5ed41069b0 legacy=0x7f5ed410cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:37.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.240+0000 7f5edae12700 1 -- 172.21.15.184:0/541171691 shutdown_connections 2024-02-05T07:18:37.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.241+0000 7f5edae12700 1 -- 172.21.15.184:0/541171691 >> 172.21.15.184:0/541171691 conn(0x7f5ed40fc4c0 msgr2=0x7f5ed4110710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:37.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.241+0000 7f5edae12700 1 -- 172.21.15.184:0/541171691 shutdown_connections 2024-02-05T07:18:37.243 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.241+0000 7f5edae12700 1 -- 172.21.15.184:0/541171691 wait complete. 2024-02-05T07:18:37.463 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[29861]: Regenerating cephadm self-signed grafana TLS certificates 2024-02-05T07:18:37.463 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:37.463 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:37.463 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-05T07:18:37.463 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[29861]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-05T07:18:37.463 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:37.463 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[29861]: Deploying daemon grafana.a on smithi188 2024-02-05T07:18:37.463 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:37.463 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3145423417' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-05T07:18:37.463 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/541171691' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-05T07:18:37.463 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[41609]: Regenerating cephadm self-signed grafana TLS certificates 2024-02-05T07:18:37.464 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:37.464 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:37.464 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-05T07:18:37.464 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[41609]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-05T07:18:37.464 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:37.464 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[41609]: Deploying daemon grafana.a on smithi188 2024-02-05T07:18:37.464 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:37.464 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3145423417' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-05T07:18:37.464 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/541171691' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-05T07:18:37.613 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738419 got 34359738424 for osd.0 2024-02-05T07:18:37.613 DEBUG:teuthology.parallel:result is None 2024-02-05T07:18:37.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:18:37 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:18:37.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:37 smithi188 ceph-mon[33283]: Regenerating cephadm self-signed grafana TLS certificates 2024-02-05T07:18:37.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:37 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:37.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:37 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:37.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:37 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-05T07:18:37.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:37 smithi188 ceph-mon[33283]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-05T07:18:37.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:37 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:37.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:37 smithi188 ceph-mon[33283]: Deploying daemon grafana.a on smithi188 2024-02-05T07:18:37.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:37 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:37.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3145423417' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-05T07:18:37.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/541171691' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-05T07:18:37.848 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.846+0000 7f550e837700 1 -- 172.21.15.184:0/2964832359 >> v1:172.21.15.184:6789/0 conn(0x7f550810a980 legacy=0x7f550810cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:37.849 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.846+0000 7f550e837700 1 -- 172.21.15.184:0/2964832359 shutdown_connections 2024-02-05T07:18:37.849 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.846+0000 7f550e837700 1 -- 172.21.15.184:0/2964832359 >> 172.21.15.184:0/2964832359 conn(0x7f55080fd600 msgr2=0x7f55080ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:37.849 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.846+0000 7f550e837700 1 -- 172.21.15.184:0/2964832359 shutdown_connections 2024-02-05T07:18:37.849 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.846+0000 7f550e837700 1 -- 172.21.15.184:0/2964832359 wait complete. 2024-02-05T07:18:37.849 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.847+0000 7f550e837700 1 Processor -- start 2024-02-05T07:18:37.849 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.847+0000 7f550e837700 1 -- start start 2024-02-05T07:18:37.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.847+0000 7f550e837700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f55081a6930 con 0x7f550810a980 2024-02-05T07:18:37.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.847+0000 7f550e837700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f55081a7b10 con 0x7f5508107b60 2024-02-05T07:18:37.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.847+0000 7f550e837700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f55081a8d10 con 0x7f550810e550 2024-02-05T07:18:37.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.847+0000 7f55077fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f550810a980 0x7f55081a1900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:47218/0 (socket says 172.21.15.184:47218) 2024-02-05T07:18:37.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.847+0000 7f55077fe700 1 -- 172.21.15.184:0/1164742717 learned_addr learned my addr 172.21.15.184:0/1164742717 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:37.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.847+0000 7f550cdd4700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f550810e550 0x7f55081a5030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:37454/0 (socket says 172.21.15.184:37454) 2024-02-05T07:18:37.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.847+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206596618 0 0) 0x7f55081a6930 con 0x7f550810a980 2024-02-05T07:18:37.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.847+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54f00035b0 con 0x7f550810a980 2024-02-05T07:18:37.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.847+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245380054 0 0) 0x7f55081a7b10 con 0x7f5508107b60 2024-02-05T07:18:37.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.847+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55081a6930 con 0x7f5508107b60 2024-02-05T07:18:37.851 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.847+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2009502033 0 0) 0x7f55081a8d10 con 0x7f550810e550 2024-02-05T07:18:37.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55081a7b10 con 0x7f550810e550 2024-02-05T07:18:37.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2839096084 0 0) 0x7f55081a6930 con 0x7f5508107b60 2024-02-05T07:18:37.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f55081a8d10 con 0x7f5508107b60 2024-02-05T07:18:37.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f54fc001830 con 0x7f5508107b60 2024-02-05T07:18:37.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4279624244 0 0) 0x7f55081a7b10 con 0x7f550810e550 2024-02-05T07:18:37.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f55081a6930 con 0x7f550810e550 2024-02-05T07:18:37.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f5500001bb0 con 0x7f550810e550 2024-02-05T07:18:37.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2590082144 0 0) 0x7f54f00035b0 con 0x7f550810a980 2024-02-05T07:18:37.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f55081a7b10 con 0x7f550810a980 2024-02-05T07:18:37.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f54f8004540 con 0x7f550810a980 2024-02-05T07:18:37.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.1 v1:172.21.15.188:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3364951882 0 0) 0x7f55081a8d10 con 0x7f5508107b60 2024-02-05T07:18:37.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 >> v1:172.21.15.184:6790/0 conn(0x7f550810e550 legacy=0x7f55081a5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:37.852 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 >> v1:172.21.15.184:6789/0 conn(0x7f550810a980 legacy=0x7f55081a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:37.853 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 --> v1:172.21.15.188:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55081a9f10 con 0x7f5508107b60 2024-02-05T07:18:37.853 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f550e837700 1 -- 172.21.15.184:0/1164742717 --> v1:172.21.15.188:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55081a7d00 con 0x7f5508107b60 2024-02-05T07:18:37.853 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f550e837700 1 -- 172.21.15.184:0/1164742717 --> v1:172.21.15.188:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f55081a8180 con 0x7f5508107b60 2024-02-05T07:18:37.853 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.1 v1:172.21.15.188:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f54fc003b10 con 0x7f5508107b60 2024-02-05T07:18:37.853 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.848+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.1 v1:172.21.15.188:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f54fc004a50 con 0x7f5508107b60 2024-02-05T07:18:37.853 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.849+0000 7f550e837700 1 -- 172.21.15.184:0/1164742717 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f4005150 con 0x7f5508107b60 2024-02-05T07:18:37.854 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.849+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.1 v1:172.21.15.188:6789/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f54fc003680 con 0x7f5508107b60 2024-02-05T07:18:37.854 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.850+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.1 v1:172.21.15.188:6789/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7f54fc087760 con 0x7f5508107b60 2024-02-05T07:18:37.856 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:37.855+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.1 v1:172.21.15.188:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f54fc054a00 con 0x7f5508107b60 2024-02-05T07:18:38.056 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:38.054+0000 7f550e837700 1 -- 172.21.15.184:0/1164742717 --> v1:172.21.15.188:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f54f4005400 con 0x7f5508107b60 2024-02-05T07:18:38.056 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:38.054+0000 7f55057fa700 1 -- 172.21.15.184:0/1164742717 <== mon.1 v1:172.21.15.188:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (unknown 383520633 0 1087398483) 0x7f54fc052d70 con 0x7f5508107b60 2024-02-05T07:18:38.056 INFO:teuthology.orchestra.run.smithi184.stdout:107374182440 2024-02-05T07:18:38.059 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:38.056+0000 7f550e837700 1 -- 172.21.15.184:0/1164742717 >> v1:172.21.15.184:6800/103463156 conn(0x7f54f006eb00 legacy=0x7f54f0070fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:38.059 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:38.056+0000 7f550e837700 1 -- 172.21.15.184:0/1164742717 >> v1:172.21.15.188:6789/0 conn(0x7f5508107b60 legacy=0x7f550810db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:38.059 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:38.057+0000 7f550e837700 1 -- 172.21.15.184:0/1164742717 shutdown_connections 2024-02-05T07:18:38.059 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:38.057+0000 7f550e837700 1 -- 172.21.15.184:0/1164742717 >> 172.21.15.184:0/1164742717 conn(0x7f55080fd600 msgr2=0x7f55081001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:38.059 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:38.057+0000 7f550e837700 1 -- 172.21.15.184:0/1164742717 shutdown_connections 2024-02-05T07:18:38.059 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:38.057+0000 7f550e837700 1 -- 172.21.15.184:0/1164742717 wait complete. 2024-02-05T07:18:38.342 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:38 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[78025]: ts=2024-02-05T07:18:38.054Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.001046422s 2024-02-05T07:18:38.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:38 smithi188 ceph-mon[33283]: pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:38.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1164742717' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-05T07:18:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:38 smithi184 ceph-mon[29861]: pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1164742717' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-05T07:18:38.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:38 smithi184 ceph-mon[41609]: pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:38.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1164742717' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-05T07:18:38.819 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201295 got 236223201299 for osd.7 2024-02-05T07:18:38.819 DEBUG:teuthology.parallel:result is None 2024-02-05T07:18:39.220 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182436 got 107374182440 for osd.3 2024-02-05T07:18:39.220 DEBUG:teuthology.parallel:result is None 2024-02-05T07:18:39.221 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-05T07:18:39.221 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph pg dump --format=json 2024-02-05T07:18:39.467 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:39.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:39.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:40.618 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:40 smithi184 ceph-mon[29861]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:40.618 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:40 smithi184 ceph-mon[41609]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:40.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:40 smithi188 ceph-mon[33283]: pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:41.101 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.098+0000 7fafc5578700 1 -- 172.21.15.184:0/906522773 >> v1:172.21.15.184:6790/0 conn(0x7fafc010e590 legacy=0x7fafc0110a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:41.101 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.098+0000 7fafc5578700 1 -- 172.21.15.184:0/906522773 shutdown_connections 2024-02-05T07:18:41.101 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.098+0000 7fafc5578700 1 -- 172.21.15.184:0/906522773 >> 172.21.15.184:0/906522773 conn(0x7fafc00fc4c0 msgr2=0x7fafc00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:41.101 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.098+0000 7fafc5578700 1 -- 172.21.15.184:0/906522773 shutdown_connections 2024-02-05T07:18:41.101 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.098+0000 7fafc5578700 1 -- 172.21.15.184:0/906522773 wait complete. 2024-02-05T07:18:41.101 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.099+0000 7fafc5578700 1 Processor -- start 2024-02-05T07:18:41.103 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.099+0000 7fafc5578700 1 -- start start 2024-02-05T07:18:41.103 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.099+0000 7fafc5578700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fafc01a6940 con 0x7fafc0102c70 2024-02-05T07:18:41.103 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.099+0000 7fafc5578700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fafc01a7b20 con 0x7fafc010e590 2024-02-05T07:18:41.103 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.099+0000 7fafc5578700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fafc01a8d20 con 0x7fafc010aa80 2024-02-05T07:18:41.103 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.099+0000 7fafbe7fc700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7fafc010aa80 0x7fafc01a18b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:37486/0 (socket says 172.21.15.184:37486) 2024-02-05T07:18:41.103 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.099+0000 7fafbe7fc700 1 -- 172.21.15.184:0/3635815075 learned_addr learned my addr 172.21.15.184:0/3635815075 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:41.103 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.099+0000 7fafbeffd700 1 --1- 172.21.15.184:0/3635815075 >> v1:172.21.15.184:6789/0 conn(0x7fafc0102c70 0x7fafc010a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:47236/0 (socket says 172.21.15.184:47236) 2024-02-05T07:18:41.104 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080504765 0 0) 0x7fafc01a6940 con 0x7fafc0102c70 2024-02-05T07:18:41.104 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafa80049e0 con 0x7fafc0102c70 2024-02-05T07:18:41.104 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 635706763 0 0) 0x7fafc01a8d20 con 0x7fafc010aa80 2024-02-05T07:18:41.104 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc01a6940 con 0x7fafc010aa80 2024-02-05T07:18:41.104 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751650506 0 0) 0x7fafc01a7b20 con 0x7fafc010e590 2024-02-05T07:18:41.104 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafc01a8d20 con 0x7fafc010e590 2024-02-05T07:18:41.104 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1754691199 0 0) 0x7fafa80049e0 con 0x7fafc0102c70 2024-02-05T07:18:41.104 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fafc01a7b20 con 0x7fafc0102c70 2024-02-05T07:18:41.104 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 507471802 0 0) 0x7fafc01a8d20 con 0x7fafc010e590 2024-02-05T07:18:41.104 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fafa80049e0 con 0x7fafc010e590 2024-02-05T07:18:41.104 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fafb00018d0 con 0x7fafc0102c70 2024-02-05T07:18:41.104 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3747181615 0 0) 0x7fafc01a6940 con 0x7fafc010aa80 2024-02-05T07:18:41.104 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fafc01a8d20 con 0x7fafc010aa80 2024-02-05T07:18:41.105 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fafb8003a00 con 0x7fafc010e590 2024-02-05T07:18:41.105 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fafb4001870 con 0x7fafc010aa80 2024-02-05T07:18:41.105 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2688084808 0 0) 0x7fafc01a7b20 con 0x7fafc0102c70 2024-02-05T07:18:41.105 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 >> v1:172.21.15.184:6790/0 conn(0x7fafc010aa80 legacy=0x7fafc01a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:41.105 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 >> v1:172.21.15.188:6789/0 conn(0x7fafc010e590 legacy=0x7fafc01a5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:41.105 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc01a9f20 con 0x7fafc0102c70 2024-02-05T07:18:41.105 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafc5578700 1 -- 172.21.15.184:0/3635815075 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc01a6b30 con 0x7fafc0102c70 2024-02-05T07:18:41.105 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafc5578700 1 -- 172.21.15.184:0/3635815075 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc01a6fb0 con 0x7fafc0102c70 2024-02-05T07:18:41.105 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fafb0003b10 con 0x7fafc0102c70 2024-02-05T07:18:41.105 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.100+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fafb0005b10 con 0x7fafc0102c70 2024-02-05T07:18:41.105 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.101+0000 7fafc5578700 1 -- 172.21.15.184:0/3635815075 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafac005120 con 0x7fafc0102c70 2024-02-05T07:18:41.106 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.102+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7fafb0003680 con 0x7fafc0102c70 2024-02-05T07:18:41.106 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.103+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7fafb0088840 con 0x7fafc0102c70 2024-02-05T07:18:41.109 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.107+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fafb0055b20 con 0x7fafc0102c70 2024-02-05T07:18:41.300 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.298+0000 7fafc5578700 1 -- 172.21.15.184:0/3635815075 --> v1:172.21.15.184:6800/103463156 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fafac000b90 con 0x7fafa806ea20 2024-02-05T07:18:41.311 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.309+0000 7fafa7fff700 1 -- 172.21.15.184:0/3635815075 <== mgr.14610 v1:172.21.15.184:6800/103463156 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+384546 (unknown 2965378022 0 3729036761) 0x7fafac000b90 con 0x7fafa806ea20 2024-02-05T07:18:41.317 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:18:41.319 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.313+0000 7fafc5578700 1 -- 172.21.15.184:0/3635815075 >> v1:172.21.15.184:6800/103463156 conn(0x7fafa806ea20 legacy=0x7fafa8070ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:41.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.313+0000 7fafc5578700 1 -- 172.21.15.184:0/3635815075 >> v1:172.21.15.184:6789/0 conn(0x7fafc0102c70 legacy=0x7fafc010a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:41.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.313+0000 7fafc5578700 1 -- 172.21.15.184:0/3635815075 shutdown_connections 2024-02-05T07:18:41.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.313+0000 7fafc5578700 1 -- 172.21.15.184:0/3635815075 >> 172.21.15.184:0/3635815075 conn(0x7fafc00fc4c0 msgr2=0x7fafc01109c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:41.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.313+0000 7fafc5578700 1 -- 172.21.15.184:0/3635815075 shutdown_connections 2024-02-05T07:18:41.320 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:41.313+0000 7fafc5578700 1 -- 172.21.15.184:0/3635815075 wait complete. 2024-02-05T07:18:41.320 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-02-05T07:18:41.909 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:18:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:18:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:18:41.936 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-02-05T07:18:40.407010+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596316,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":1007,"num_read_kb":853,"num_write":615,"num_write_kb":2461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1771434,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":600,"ondisk_log_size":600,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":244304,"kb_used_data":7356,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":749716912,"statfs":{"total":767960285184,"available":767710117888,"internally_reserved":0,"allocated":7532544,"data_stored":4022812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003105"},"pg_stats":[{"pgid":"6.1a","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387163+0000","last_change":"2024-02-05T07:17:24.306478+0000","last_active":"2024-02-05T07:17:56.387163+0000","last_peered":"2024-02-05T07:17:56.387163+0000","last_clean":"2024-02-05T07:17:56.387163+0000","last_became_active":"2024-02-05T07:17:24.305985+0000","last_became_peered":"2024-02-05T07:17:24.305985+0000","last_unstale":"2024-02-05T07:17:56.387163+0000","last_undegraded":"2024-02-05T07:17:56.387163+0000","last_fullsized":"2024-02-05T07:17:56.387163+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:00:50.626970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389547+0000","last_change":"2024-02-05T07:17:22.304640+0000","last_active":"2024-02-05T07:17:56.389547+0000","last_peered":"2024-02-05T07:17:56.389547+0000","last_clean":"2024-02-05T07:17:56.389547+0000","last_became_active":"2024-02-05T07:17:22.304340+0000","last_became_peered":"2024-02-05T07:17:22.304340+0000","last_unstale":"2024-02-05T07:17:56.389547+0000","last_undegraded":"2024-02-05T07:17:56.389547+0000","last_fullsized":"2024-02-05T07:17:56.389547+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:14:50.617495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"61'1","reported_seq":39,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193389+0000","last_change":"2024-02-05T07:17:18.283861+0000","last_active":"2024-02-05T07:17:57.193389+0000","last_peered":"2024-02-05T07:17:57.193389+0000","last_clean":"2024-02-05T07:17:57.193389+0000","last_became_active":"2024-02-05T07:17:18.283600+0000","last_became_peered":"2024-02-05T07:17:18.283600+0000","last_unstale":"2024-02-05T07:17:57.193389+0000","last_undegraded":"2024-02-05T07:17:57.193389+0000","last_fullsized":"2024-02-05T07:17:57.193389+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:09:34.840824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"68'9","reported_seq":61,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.386895+0000","last_change":"2024-02-05T07:17:46.496913+0000","last_active":"2024-02-05T07:17:56.386895+0000","last_peered":"2024-02-05T07:17:56.386895+0000","last_clean":"2024-02-05T07:17:56.386895+0000","last_became_active":"2024-02-05T07:17:46.492079+0000","last_became_peered":"2024-02-05T07:17:46.492079+0000","last_unstale":"2024-02-05T07:17:56.386895+0000","last_undegraded":"2024-02-05T07:17:56.386895+0000","last_fullsized":"2024-02-05T07:17:56.386895+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:29:18.384468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194585+0000","last_change":"2024-02-05T07:17:24.315755+0000","last_active":"2024-02-05T07:17:57.194585+0000","last_peered":"2024-02-05T07:17:57.194585+0000","last_clean":"2024-02-05T07:17:57.194585+0000","last_became_active":"2024-02-05T07:17:24.314925+0000","last_became_peered":"2024-02-05T07:17:24.314925+0000","last_unstale":"2024-02-05T07:17:57.194585+0000","last_undegraded":"2024-02-05T07:17:57.194585+0000","last_fullsized":"2024-02-05T07:17:57.194585+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:04:30.869275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.386898+0000","last_change":"2024-02-05T07:17:22.294838+0000","last_active":"2024-02-05T07:17:56.386898+0000","last_peered":"2024-02-05T07:17:56.386898+0000","last_clean":"2024-02-05T07:17:56.386898+0000","last_became_active":"2024-02-05T07:17:22.294515+0000","last_became_peered":"2024-02-05T07:17:22.294515+0000","last_unstale":"2024-02-05T07:17:56.386898+0000","last_undegraded":"2024-02-05T07:17:56.386898+0000","last_fullsized":"2024-02-05T07:17:56.386898+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:56:37.476629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194901+0000","last_change":"2024-02-05T07:17:18.279492+0000","last_active":"2024-02-05T07:17:57.194901+0000","last_peered":"2024-02-05T07:17:57.194901+0000","last_clean":"2024-02-05T07:17:57.194901+0000","last_became_active":"2024-02-05T07:17:18.279192+0000","last_became_peered":"2024-02-05T07:17:18.279192+0000","last_unstale":"2024-02-05T07:17:57.194901+0000","last_undegraded":"2024-02-05T07:17:57.194901+0000","last_fullsized":"2024-02-05T07:17:57.194901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T09:20:45.496212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"68'15","reported_seq":54,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194009+0000","last_change":"2024-02-05T07:17:20.295512+0000","last_active":"2024-02-05T07:17:57.194009+0000","last_peered":"2024-02-05T07:17:57.194009+0000","last_clean":"2024-02-05T07:17:57.194009+0000","last_became_active":"2024-02-05T07:17:20.295246+0000","last_became_peered":"2024-02-05T07:17:20.295246+0000","last_unstale":"2024-02-05T07:17:57.194009+0000","last_undegraded":"2024-02-05T07:17:57.194009+0000","last_fullsized":"2024-02-05T07:17:57.194009+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:40:08.765931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192978+0000","last_change":"2024-02-05T07:17:24.302001+0000","last_active":"2024-02-05T07:17:57.192978+0000","last_peered":"2024-02-05T07:17:57.192978+0000","last_clean":"2024-02-05T07:17:57.192978+0000","last_became_active":"2024-02-05T07:17:24.301659+0000","last_became_peered":"2024-02-05T07:17:24.301659+0000","last_unstale":"2024-02-05T07:17:57.192978+0000","last_undegraded":"2024-02-05T07:17:57.192978+0000","last_fullsized":"2024-02-05T07:17:57.192978+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:47:22.825251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481576+0000","last_change":"2024-02-05T07:17:22.301326+0000","last_active":"2024-02-05T07:17:56.481576+0000","last_peered":"2024-02-05T07:17:56.481576+0000","last_clean":"2024-02-05T07:17:56.481576+0000","last_became_active":"2024-02-05T07:17:22.300404+0000","last_became_peered":"2024-02-05T07:17:22.300404+0000","last_unstale":"2024-02-05T07:17:56.481576+0000","last_undegraded":"2024-02-05T07:17:56.481576+0000","last_fullsized":"2024-02-05T07:17:56.481576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:30:22.643579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481875+0000","last_change":"2024-02-05T07:17:18.280018+0000","last_active":"2024-02-05T07:17:56.481875+0000","last_peered":"2024-02-05T07:17:56.481875+0000","last_clean":"2024-02-05T07:17:56.481875+0000","last_became_active":"2024-02-05T07:17:18.279262+0000","last_became_peered":"2024-02-05T07:17:18.279262+0000","last_unstale":"2024-02-05T07:17:56.481875+0000","last_undegraded":"2024-02-05T07:17:56.481875+0000","last_fullsized":"2024-02-05T07:17:56.481875+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T18:47:28.659570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"68'9","reported_seq":45,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387579+0000","last_change":"2024-02-05T07:17:20.293491+0000","last_active":"2024-02-05T07:17:56.387579+0000","last_peered":"2024-02-05T07:17:56.387579+0000","last_clean":"2024-02-05T07:17:56.387579+0000","last_became_active":"2024-02-05T07:17:20.293212+0000","last_became_peered":"2024-02-05T07:17:20.293212+0000","last_unstale":"2024-02-05T07:17:56.387579+0000","last_undegraded":"2024-02-05T07:17:56.387579+0000","last_fullsized":"2024-02-05T07:17:56.387579+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:44:11.093107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481341+0000","last_change":"2024-02-05T07:17:24.304191+0000","last_active":"2024-02-05T07:17:56.481341+0000","last_peered":"2024-02-05T07:17:56.481341+0000","last_clean":"2024-02-05T07:17:56.481341+0000","last_became_active":"2024-02-05T07:17:24.303936+0000","last_became_peered":"2024-02-05T07:17:24.303936+0000","last_unstale":"2024-02-05T07:17:56.481341+0000","last_undegraded":"2024-02-05T07:17:56.481341+0000","last_fullsized":"2024-02-05T07:17:56.481341+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:17:50.501406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.429962+0000","last_change":"2024-02-05T07:17:22.298363+0000","last_active":"2024-02-05T07:17:56.429962+0000","last_peered":"2024-02-05T07:17:56.429962+0000","last_clean":"2024-02-05T07:17:56.429962+0000","last_became_active":"2024-02-05T07:17:22.298076+0000","last_became_peered":"2024-02-05T07:17:22.298076+0000","last_unstale":"2024-02-05T07:17:56.429962+0000","last_undegraded":"2024-02-05T07:17:56.429962+0000","last_fullsized":"2024-02-05T07:17:56.429962+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:32:14.863310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"61'1","reported_seq":39,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481777+0000","last_change":"2024-02-05T07:17:18.276215+0000","last_active":"2024-02-05T07:17:56.481777+0000","last_peered":"2024-02-05T07:17:56.481777+0000","last_clean":"2024-02-05T07:17:56.481777+0000","last_became_active":"2024-02-05T07:17:18.275799+0000","last_became_peered":"2024-02-05T07:17:18.275799+0000","last_unstale":"2024-02-05T07:17:56.481777+0000","last_undegraded":"2024-02-05T07:17:56.481777+0000","last_fullsized":"2024-02-05T07:17:56.481777+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:52:00.365305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"68'5","reported_seq":39,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387272+0000","last_change":"2024-02-05T07:17:20.290731+0000","last_active":"2024-02-05T07:17:56.387272+0000","last_peered":"2024-02-05T07:17:56.387272+0000","last_clean":"2024-02-05T07:17:56.387272+0000","last_became_active":"2024-02-05T07:17:20.290362+0000","last_became_peered":"2024-02-05T07:17:20.290362+0000","last_unstale":"2024-02-05T07:17:56.387272+0000","last_undegraded":"2024-02-05T07:17:56.387272+0000","last_fullsized":"2024-02-05T07:17:56.387272+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:32:49.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388775+0000","last_change":"2024-02-05T07:17:24.314824+0000","last_active":"2024-02-05T07:17:56.388775+0000","last_peered":"2024-02-05T07:17:56.388775+0000","last_clean":"2024-02-05T07:17:56.388775+0000","last_became_active":"2024-02-05T07:17:24.314250+0000","last_became_peered":"2024-02-05T07:17:24.314250+0000","last_unstale":"2024-02-05T07:17:56.388775+0000","last_undegraded":"2024-02-05T07:17:56.388775+0000","last_fullsized":"2024-02-05T07:17:56.388775+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:47:23.574823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388496+0000","last_change":"2024-02-05T07:17:22.297343+0000","last_active":"2024-02-05T07:17:56.388496+0000","last_peered":"2024-02-05T07:17:56.388496+0000","last_clean":"2024-02-05T07:17:56.388496+0000","last_became_active":"2024-02-05T07:17:22.297053+0000","last_became_peered":"2024-02-05T07:17:22.297053+0000","last_unstale":"2024-02-05T07:17:56.388496+0000","last_undegraded":"2024-02-05T07:17:56.388496+0000","last_fullsized":"2024-02-05T07:17:56.388496+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:39:28.800774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193424+0000","last_change":"2024-02-05T07:17:18.286244+0000","last_active":"2024-02-05T07:17:57.193424+0000","last_peered":"2024-02-05T07:17:57.193424+0000","last_clean":"2024-02-05T07:17:57.193424+0000","last_became_active":"2024-02-05T07:17:18.285815+0000","last_became_peered":"2024-02-05T07:17:18.285815+0000","last_unstale":"2024-02-05T07:17:57.193424+0000","last_undegraded":"2024-02-05T07:17:57.193424+0000","last_fullsized":"2024-02-05T07:17:57.193424+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:59:55.795328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"68'15","reported_seq":54,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.390264+0000","last_change":"2024-02-05T07:17:20.293813+0000","last_active":"2024-02-05T07:17:56.390264+0000","last_peered":"2024-02-05T07:17:56.390264+0000","last_clean":"2024-02-05T07:17:56.390264+0000","last_became_active":"2024-02-05T07:17:20.293485+0000","last_became_peered":"2024-02-05T07:17:20.293485+0000","last_unstale":"2024-02-05T07:17:56.390264+0000","last_undegraded":"2024-02-05T07:17:56.390264+0000","last_fullsized":"2024-02-05T07:17:56.390264+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T18:19:32.225679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.195001+0000","last_change":"2024-02-05T07:17:24.314980+0000","last_active":"2024-02-05T07:17:57.195001+0000","last_peered":"2024-02-05T07:17:57.195001+0000","last_clean":"2024-02-05T07:17:57.195001+0000","last_became_active":"2024-02-05T07:17:24.314655+0000","last_became_peered":"2024-02-05T07:17:24.314655+0000","last_unstale":"2024-02-05T07:17:57.195001+0000","last_undegraded":"2024-02-05T07:17:57.195001+0000","last_fullsized":"2024-02-05T07:17:57.195001+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:51:47.167883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387216+0000","last_change":"2024-02-05T07:17:22.297048+0000","last_active":"2024-02-05T07:17:56.387216+0000","last_peered":"2024-02-05T07:17:56.387216+0000","last_clean":"2024-02-05T07:17:56.387216+0000","last_became_active":"2024-02-05T07:17:22.296731+0000","last_became_peered":"2024-02-05T07:17:22.296731+0000","last_unstale":"2024-02-05T07:17:56.387216+0000","last_undegraded":"2024-02-05T07:17:56.387216+0000","last_fullsized":"2024-02-05T07:17:56.387216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:13:22.849034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387688+0000","last_change":"2024-02-05T07:17:18.282575+0000","last_active":"2024-02-05T07:17:56.387688+0000","last_peered":"2024-02-05T07:17:56.387688+0000","last_clean":"2024-02-05T07:17:56.387688+0000","last_became_active":"2024-02-05T07:17:18.282138+0000","last_became_peered":"2024-02-05T07:17:18.282138+0000","last_unstale":"2024-02-05T07:17:56.387688+0000","last_undegraded":"2024-02-05T07:17:56.387688+0000","last_fullsized":"2024-02-05T07:17:56.387688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:18:54.525107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"68'12","reported_seq":52,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194327+0000","last_change":"2024-02-05T07:17:20.293938+0000","last_active":"2024-02-05T07:17:57.194327+0000","last_peered":"2024-02-05T07:17:57.194327+0000","last_clean":"2024-02-05T07:17:57.194327+0000","last_became_active":"2024-02-05T07:17:20.293659+0000","last_became_peered":"2024-02-05T07:17:20.293659+0000","last_unstale":"2024-02-05T07:17:57.194327+0000","last_undegraded":"2024-02-05T07:17:57.194327+0000","last_fullsized":"2024-02-05T07:17:57.194327+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:44:12.213483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"68'1","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430195+0000","last_change":"2024-02-05T07:17:24.312709+0000","last_active":"2024-02-05T07:17:56.430195+0000","last_peered":"2024-02-05T07:17:56.430195+0000","last_clean":"2024-02-05T07:17:56.430195+0000","last_became_active":"2024-02-05T07:17:24.312348+0000","last_became_peered":"2024-02-05T07:17:24.312348+0000","last_unstale":"2024-02-05T07:17:56.430195+0000","last_undegraded":"2024-02-05T07:17:56.430195+0000","last_fullsized":"2024-02-05T07:17:56.430195+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:21:11.522895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"68'8","reported_seq":52,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:28.333435+0000","last_change":"2024-02-05T07:17:22.302691+0000","last_active":"2024-02-05T07:18:28.333435+0000","last_peered":"2024-02-05T07:18:28.333435+0000","last_clean":"2024-02-05T07:18:28.333435+0000","last_became_active":"2024-02-05T07:17:22.302372+0000","last_became_peered":"2024-02-05T07:17:22.302372+0000","last_unstale":"2024-02-05T07:18:28.333435+0000","last_undegraded":"2024-02-05T07:18:28.333435+0000","last_fullsized":"2024-02-05T07:18:28.333435+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:17:52.575941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"61'1","reported_seq":34,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389621+0000","last_change":"2024-02-05T07:17:18.277364+0000","last_active":"2024-02-05T07:17:56.389621+0000","last_peered":"2024-02-05T07:17:56.389621+0000","last_clean":"2024-02-05T07:17:56.389621+0000","last_became_active":"2024-02-05T07:17:18.276980+0000","last_became_peered":"2024-02-05T07:17:18.276980+0000","last_unstale":"2024-02-05T07:17:56.389621+0000","last_undegraded":"2024-02-05T07:17:56.389621+0000","last_fullsized":"2024-02-05T07:17:56.389621+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:54:40.778718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"68'10","reported_seq":44,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194078+0000","last_change":"2024-02-05T07:17:20.351797+0000","last_active":"2024-02-05T07:17:57.194078+0000","last_peered":"2024-02-05T07:17:57.194078+0000","last_clean":"2024-02-05T07:17:57.194078+0000","last_became_active":"2024-02-05T07:17:20.351378+0000","last_became_peered":"2024-02-05T07:17:20.351378+0000","last_unstale":"2024-02-05T07:17:57.194078+0000","last_undegraded":"2024-02-05T07:17:57.194078+0000","last_fullsized":"2024-02-05T07:17:57.194078+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:56:14.194292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388153+0000","last_change":"2024-02-05T07:17:24.307391+0000","last_active":"2024-02-05T07:17:56.388153+0000","last_peered":"2024-02-05T07:17:56.388153+0000","last_clean":"2024-02-05T07:17:56.388153+0000","last_became_active":"2024-02-05T07:17:24.306720+0000","last_became_peered":"2024-02-05T07:17:24.306720+0000","last_unstale":"2024-02-05T07:17:56.388153+0000","last_undegraded":"2024-02-05T07:17:56.388153+0000","last_fullsized":"2024-02-05T07:17:56.388153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:02:43.992849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194286+0000","last_change":"2024-02-05T07:17:22.303924+0000","last_active":"2024-02-05T07:17:57.194286+0000","last_peered":"2024-02-05T07:17:57.194286+0000","last_clean":"2024-02-05T07:17:57.194286+0000","last_became_active":"2024-02-05T07:17:22.303315+0000","last_became_peered":"2024-02-05T07:17:22.303315+0000","last_unstale":"2024-02-05T07:17:57.194286+0000","last_undegraded":"2024-02-05T07:17:57.194286+0000","last_fullsized":"2024-02-05T07:17:57.194286+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:59:49.071650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193241+0000","last_change":"2024-02-05T07:17:18.282796+0000","last_active":"2024-02-05T07:17:57.193241+0000","last_peered":"2024-02-05T07:17:57.193241+0000","last_clean":"2024-02-05T07:17:57.193241+0000","last_became_active":"2024-02-05T07:17:18.282533+0000","last_became_peered":"2024-02-05T07:17:18.282533+0000","last_unstale":"2024-02-05T07:17:57.193241+0000","last_undegraded":"2024-02-05T07:17:57.193241+0000","last_fullsized":"2024-02-05T07:17:57.193241+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:39:56.293780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"68'11","reported_seq":48,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193395+0000","last_change":"2024-02-05T07:17:20.288590+0000","last_active":"2024-02-05T07:17:57.193395+0000","last_peered":"2024-02-05T07:17:57.193395+0000","last_clean":"2024-02-05T07:17:57.193395+0000","last_became_active":"2024-02-05T07:17:20.288267+0000","last_became_peered":"2024-02-05T07:17:20.288267+0000","last_unstale":"2024-02-05T07:17:57.193395+0000","last_undegraded":"2024-02-05T07:17:57.193395+0000","last_fullsized":"2024-02-05T07:17:57.193395+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:25:37.842800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.429854+0000","last_change":"2024-02-05T07:17:24.310019+0000","last_active":"2024-02-05T07:17:56.429854+0000","last_peered":"2024-02-05T07:17:56.429854+0000","last_clean":"2024-02-05T07:17:56.429854+0000","last_became_active":"2024-02-05T07:17:24.309728+0000","last_became_peered":"2024-02-05T07:17:24.309728+0000","last_unstale":"2024-02-05T07:17:56.429854+0000","last_undegraded":"2024-02-05T07:17:56.429854+0000","last_fullsized":"2024-02-05T07:17:56.429854+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:58:07.383015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192721+0000","last_change":"2024-02-05T07:17:22.304817+0000","last_active":"2024-02-05T07:17:57.192721+0000","last_peered":"2024-02-05T07:17:57.192721+0000","last_clean":"2024-02-05T07:17:57.192721+0000","last_became_active":"2024-02-05T07:17:22.304507+0000","last_became_peered":"2024-02-05T07:17:22.304507+0000","last_unstale":"2024-02-05T07:17:57.192721+0000","last_undegraded":"2024-02-05T07:17:57.192721+0000","last_fullsized":"2024-02-05T07:17:57.192721+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:02:25.406918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193273+0000","last_change":"2024-02-05T07:17:18.283702+0000","last_active":"2024-02-05T07:17:57.193273+0000","last_peered":"2024-02-05T07:17:57.193273+0000","last_clean":"2024-02-05T07:17:57.193273+0000","last_became_active":"2024-02-05T07:17:18.282831+0000","last_became_peered":"2024-02-05T07:17:18.282831+0000","last_unstale":"2024-02-05T07:17:57.193273+0000","last_undegraded":"2024-02-05T07:17:57.193273+0000","last_fullsized":"2024-02-05T07:17:57.193273+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:53:09.477445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"68'4","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193332+0000","last_change":"2024-02-05T07:17:20.294459+0000","last_active":"2024-02-05T07:17:57.193332+0000","last_peered":"2024-02-05T07:17:57.193332+0000","last_clean":"2024-02-05T07:17:57.193332+0000","last_became_active":"2024-02-05T07:17:20.293704+0000","last_became_peered":"2024-02-05T07:17:20.293704+0000","last_unstale":"2024-02-05T07:17:57.193332+0000","last_undegraded":"2024-02-05T07:17:57.193332+0000","last_fullsized":"2024-02-05T07:17:57.193332+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:01:13.788106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194398+0000","last_change":"2024-02-05T07:17:24.315261+0000","last_active":"2024-02-05T07:17:57.194398+0000","last_peered":"2024-02-05T07:17:57.194398+0000","last_clean":"2024-02-05T07:17:57.194398+0000","last_became_active":"2024-02-05T07:17:24.314494+0000","last_became_peered":"2024-02-05T07:17:24.314494+0000","last_unstale":"2024-02-05T07:17:57.194398+0000","last_undegraded":"2024-02-05T07:17:57.194398+0000","last_fullsized":"2024-02-05T07:17:57.194398+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:55:14.395110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430009+0000","last_change":"2024-02-05T07:17:22.299891+0000","last_active":"2024-02-05T07:17:56.430009+0000","last_peered":"2024-02-05T07:17:56.430009+0000","last_clean":"2024-02-05T07:17:56.430009+0000","last_became_active":"2024-02-05T07:17:22.299559+0000","last_became_peered":"2024-02-05T07:17:22.299559+0000","last_unstale":"2024-02-05T07:17:56.430009+0000","last_undegraded":"2024-02-05T07:17:56.430009+0000","last_fullsized":"2024-02-05T07:17:56.430009+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:01:30.056714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.482004+0000","last_change":"2024-02-05T07:17:18.281788+0000","last_active":"2024-02-05T07:17:56.482004+0000","last_peered":"2024-02-05T07:17:56.482004+0000","last_clean":"2024-02-05T07:17:56.482004+0000","last_became_active":"2024-02-05T07:17:18.279308+0000","last_became_peered":"2024-02-05T07:17:18.279308+0000","last_unstale":"2024-02-05T07:17:56.482004+0000","last_undegraded":"2024-02-05T07:17:56.482004+0000","last_fullsized":"2024-02-05T07:17:56.482004+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:32:24.076872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"68'11","reported_seq":48,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193797+0000","last_change":"2024-02-05T07:17:20.352075+0000","last_active":"2024-02-05T07:17:57.193797+0000","last_peered":"2024-02-05T07:17:57.193797+0000","last_clean":"2024-02-05T07:17:57.193797+0000","last_became_active":"2024-02-05T07:17:20.351792+0000","last_became_peered":"2024-02-05T07:17:20.351792+0000","last_unstale":"2024-02-05T07:17:57.193797+0000","last_undegraded":"2024-02-05T07:17:57.193797+0000","last_fullsized":"2024-02-05T07:17:57.193797+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T18:48:18.529452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192692+0000","last_change":"2024-02-05T07:17:24.303246+0000","last_active":"2024-02-05T07:17:57.192692+0000","last_peered":"2024-02-05T07:17:57.192692+0000","last_clean":"2024-02-05T07:17:57.192692+0000","last_became_active":"2024-02-05T07:17:24.302926+0000","last_became_peered":"2024-02-05T07:17:24.302926+0000","last_unstale":"2024-02-05T07:17:57.192692+0000","last_undegraded":"2024-02-05T07:17:57.192692+0000","last_fullsized":"2024-02-05T07:17:57.192692+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:51:40.454724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194678+0000","last_change":"2024-02-05T07:17:22.300576+0000","last_active":"2024-02-05T07:17:57.194678+0000","last_peered":"2024-02-05T07:17:57.194678+0000","last_clean":"2024-02-05T07:17:57.194678+0000","last_became_active":"2024-02-05T07:17:22.300002+0000","last_became_peered":"2024-02-05T07:17:22.300002+0000","last_unstale":"2024-02-05T07:17:57.194678+0000","last_undegraded":"2024-02-05T07:17:57.194678+0000","last_fullsized":"2024-02-05T07:17:57.194678+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:19:58.854801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430244+0000","last_change":"2024-02-05T07:17:18.284733+0000","last_active":"2024-02-05T07:17:56.430244+0000","last_peered":"2024-02-05T07:17:56.430244+0000","last_clean":"2024-02-05T07:17:56.430244+0000","last_became_active":"2024-02-05T07:17:18.283946+0000","last_became_peered":"2024-02-05T07:17:18.283946+0000","last_unstale":"2024-02-05T07:17:56.430244+0000","last_undegraded":"2024-02-05T07:17:56.430244+0000","last_fullsized":"2024-02-05T07:17:56.430244+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:19:05.818581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"68'9","reported_seq":45,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388769+0000","last_change":"2024-02-05T07:17:20.294373+0000","last_active":"2024-02-05T07:17:56.388769+0000","last_peered":"2024-02-05T07:17:56.388769+0000","last_clean":"2024-02-05T07:17:56.388769+0000","last_became_active":"2024-02-05T07:17:20.294098+0000","last_became_peered":"2024-02-05T07:17:20.294098+0000","last_unstale":"2024-02-05T07:17:56.388769+0000","last_undegraded":"2024-02-05T07:17:56.388769+0000","last_fullsized":"2024-02-05T07:17:56.388769+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:49:15.846839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193378+0000","last_change":"2024-02-05T07:17:24.310050+0000","last_active":"2024-02-05T07:17:57.193378+0000","last_peered":"2024-02-05T07:17:57.193378+0000","last_clean":"2024-02-05T07:17:57.193378+0000","last_became_active":"2024-02-05T07:17:24.309694+0000","last_became_peered":"2024-02-05T07:17:24.309694+0000","last_unstale":"2024-02-05T07:17:57.193378+0000","last_undegraded":"2024-02-05T07:17:57.193378+0000","last_fullsized":"2024-02-05T07:17:57.193378+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:48:22.983843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388560+0000","last_change":"2024-02-05T07:17:22.301278+0000","last_active":"2024-02-05T07:17:56.388560+0000","last_peered":"2024-02-05T07:17:56.388560+0000","last_clean":"2024-02-05T07:17:56.388560+0000","last_became_active":"2024-02-05T07:17:22.300935+0000","last_became_peered":"2024-02-05T07:17:22.300935+0000","last_unstale":"2024-02-05T07:17:56.388560+0000","last_undegraded":"2024-02-05T07:17:56.388560+0000","last_fullsized":"2024-02-05T07:17:56.388560+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:54:43.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387472+0000","last_change":"2024-02-05T07:17:18.285057+0000","last_active":"2024-02-05T07:17:56.387472+0000","last_peered":"2024-02-05T07:17:56.387472+0000","last_clean":"2024-02-05T07:17:56.387472+0000","last_became_active":"2024-02-05T07:17:18.284775+0000","last_became_peered":"2024-02-05T07:17:18.284775+0000","last_unstale":"2024-02-05T07:17:56.387472+0000","last_undegraded":"2024-02-05T07:17:56.387472+0000","last_fullsized":"2024-02-05T07:17:56.387472+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:30:07.132043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"68'11","reported_seq":48,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387222+0000","last_change":"2024-02-05T07:17:20.287540+0000","last_active":"2024-02-05T07:17:56.387222+0000","last_peered":"2024-02-05T07:17:56.387222+0000","last_clean":"2024-02-05T07:17:56.387222+0000","last_became_active":"2024-02-05T07:17:20.287243+0000","last_became_peered":"2024-02-05T07:17:20.287243+0000","last_unstale":"2024-02-05T07:17:56.387222+0000","last_undegraded":"2024-02-05T07:17:56.387222+0000","last_fullsized":"2024-02-05T07:17:56.387222+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:26:01.221883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193208+0000","last_change":"2024-02-05T07:17:24.313181+0000","last_active":"2024-02-05T07:17:57.193208+0000","last_peered":"2024-02-05T07:17:57.193208+0000","last_clean":"2024-02-05T07:17:57.193208+0000","last_became_active":"2024-02-05T07:17:24.312815+0000","last_became_peered":"2024-02-05T07:17:24.312815+0000","last_unstale":"2024-02-05T07:17:57.193208+0000","last_undegraded":"2024-02-05T07:17:57.193208+0000","last_fullsized":"2024-02-05T07:17:57.193208+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:18:15.404548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"68'8","reported_seq":49,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:28.333452+0000","last_change":"2024-02-05T07:17:22.299245+0000","last_active":"2024-02-05T07:18:28.333452+0000","last_peered":"2024-02-05T07:18:28.333452+0000","last_clean":"2024-02-05T07:18:28.333452+0000","last_became_active":"2024-02-05T07:17:22.298901+0000","last_became_peered":"2024-02-05T07:17:22.298901+0000","last_unstale":"2024-02-05T07:18:28.333452+0000","last_undegraded":"2024-02-05T07:18:28.333452+0000","last_fullsized":"2024-02-05T07:18:28.333452+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:38:25.680101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430085+0000","last_change":"2024-02-05T07:17:18.284639+0000","last_active":"2024-02-05T07:17:56.430085+0000","last_peered":"2024-02-05T07:17:56.430085+0000","last_clean":"2024-02-05T07:17:56.430085+0000","last_became_active":"2024-02-05T07:17:18.284362+0000","last_became_peered":"2024-02-05T07:17:18.284362+0000","last_unstale":"2024-02-05T07:17:56.430085+0000","last_undegraded":"2024-02-05T07:17:56.430085+0000","last_fullsized":"2024-02-05T07:17:56.430085+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:16:37.058264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"68'10","reported_seq":44,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193696+0000","last_change":"2024-02-05T07:17:20.351558+0000","last_active":"2024-02-05T07:17:57.193696+0000","last_peered":"2024-02-05T07:17:57.193696+0000","last_clean":"2024-02-05T07:17:57.193696+0000","last_became_active":"2024-02-05T07:17:20.351282+0000","last_became_peered":"2024-02-05T07:17:20.351282+0000","last_unstale":"2024-02-05T07:17:57.193696+0000","last_undegraded":"2024-02-05T07:17:57.193696+0000","last_fullsized":"2024-02-05T07:17:57.193696+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:54:39.199280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388225+0000","last_change":"2024-02-05T07:17:24.309287+0000","last_active":"2024-02-05T07:17:56.388225+0000","last_peered":"2024-02-05T07:17:56.388225+0000","last_clean":"2024-02-05T07:17:56.388225+0000","last_became_active":"2024-02-05T07:17:24.309006+0000","last_became_peered":"2024-02-05T07:17:24.309006+0000","last_unstale":"2024-02-05T07:17:56.388225+0000","last_undegraded":"2024-02-05T07:17:56.388225+0000","last_fullsized":"2024-02-05T07:17:56.388225+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:23:54.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"68'8","reported_seq":52,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:28.333554+0000","last_change":"2024-02-05T07:17:22.301348+0000","last_active":"2024-02-05T07:18:28.333554+0000","last_peered":"2024-02-05T07:18:28.333554+0000","last_clean":"2024-02-05T07:18:28.333554+0000","last_became_active":"2024-02-05T07:17:22.301023+0000","last_became_peered":"2024-02-05T07:17:22.301023+0000","last_unstale":"2024-02-05T07:18:28.333554+0000","last_undegraded":"2024-02-05T07:18:28.333554+0000","last_fullsized":"2024-02-05T07:18:28.333554+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:29:38.330165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192952+0000","last_change":"2024-02-05T07:17:18.283169+0000","last_active":"2024-02-05T07:17:57.192952+0000","last_peered":"2024-02-05T07:17:57.192952+0000","last_clean":"2024-02-05T07:17:57.192952+0000","last_became_active":"2024-02-05T07:17:18.282786+0000","last_became_peered":"2024-02-05T07:17:18.282786+0000","last_unstale":"2024-02-05T07:17:57.192952+0000","last_undegraded":"2024-02-05T07:17:57.192952+0000","last_fullsized":"2024-02-05T07:17:57.192952+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:51:37.157602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"68'9","reported_seq":45,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.482070+0000","last_change":"2024-02-05T07:17:20.351856+0000","last_active":"2024-02-05T07:17:56.482070+0000","last_peered":"2024-02-05T07:17:56.482070+0000","last_clean":"2024-02-05T07:17:56.482070+0000","last_became_active":"2024-02-05T07:17:20.351550+0000","last_became_peered":"2024-02-05T07:17:20.351550+0000","last_unstale":"2024-02-05T07:17:56.482070+0000","last_undegraded":"2024-02-05T07:17:56.482070+0000","last_fullsized":"2024-02-05T07:17:56.482070+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:53:55.600488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.390575+0000","last_change":"2024-02-05T07:17:24.310394+0000","last_active":"2024-02-05T07:17:56.390575+0000","last_peered":"2024-02-05T07:17:56.390575+0000","last_clean":"2024-02-05T07:17:56.390575+0000","last_became_active":"2024-02-05T07:17:24.309264+0000","last_became_peered":"2024-02-05T07:17:24.309264+0000","last_unstale":"2024-02-05T07:17:56.390575+0000","last_undegraded":"2024-02-05T07:17:56.390575+0000","last_fullsized":"2024-02-05T07:17:56.390575+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T09:14:38.679802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.195188+0000","last_change":"2024-02-05T07:17:22.300384+0000","last_active":"2024-02-05T07:17:57.195188+0000","last_peered":"2024-02-05T07:17:57.195188+0000","last_clean":"2024-02-05T07:17:57.195188+0000","last_became_active":"2024-02-05T07:17:22.300069+0000","last_became_peered":"2024-02-05T07:17:22.300069+0000","last_unstale":"2024-02-05T07:17:57.195188+0000","last_undegraded":"2024-02-05T07:17:57.195188+0000","last_fullsized":"2024-02-05T07:17:57.195188+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:55:38.595092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.429923+0000","last_change":"2024-02-05T07:17:18.284841+0000","last_active":"2024-02-05T07:17:56.429923+0000","last_peered":"2024-02-05T07:17:56.429923+0000","last_clean":"2024-02-05T07:17:56.429923+0000","last_became_active":"2024-02-05T07:17:18.283993+0000","last_became_peered":"2024-02-05T07:17:18.283993+0000","last_unstale":"2024-02-05T07:17:56.429923+0000","last_undegraded":"2024-02-05T07:17:56.429923+0000","last_fullsized":"2024-02-05T07:17:56.429923+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:09:32.666577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"68'9","reported_seq":45,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194208+0000","last_change":"2024-02-05T07:17:20.352186+0000","last_active":"2024-02-05T07:17:57.194208+0000","last_peered":"2024-02-05T07:17:57.194208+0000","last_clean":"2024-02-05T07:17:57.194208+0000","last_became_active":"2024-02-05T07:17:20.351726+0000","last_became_peered":"2024-02-05T07:17:20.351726+0000","last_unstale":"2024-02-05T07:17:57.194208+0000","last_undegraded":"2024-02-05T07:17:57.194208+0000","last_fullsized":"2024-02-05T07:17:57.194208+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:40:19.483725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430215+0000","last_change":"2024-02-05T07:17:24.314449+0000","last_active":"2024-02-05T07:17:56.430215+0000","last_peered":"2024-02-05T07:17:56.430215+0000","last_clean":"2024-02-05T07:17:56.430215+0000","last_became_active":"2024-02-05T07:17:24.314169+0000","last_became_peered":"2024-02-05T07:17:24.314169+0000","last_unstale":"2024-02-05T07:17:56.430215+0000","last_undegraded":"2024-02-05T07:17:56.430215+0000","last_fullsized":"2024-02-05T07:17:56.430215+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:50:55.155116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.482075+0000","last_change":"2024-02-05T07:17:22.304455+0000","last_active":"2024-02-05T07:17:56.482075+0000","last_peered":"2024-02-05T07:17:56.482075+0000","last_clean":"2024-02-05T07:17:56.482075+0000","last_became_active":"2024-02-05T07:17:22.301041+0000","last_became_peered":"2024-02-05T07:17:22.301041+0000","last_unstale":"2024-02-05T07:17:56.482075+0000","last_undegraded":"2024-02-05T07:17:56.482075+0000","last_fullsized":"2024-02-05T07:17:56.482075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:52:18.005230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192758+0000","last_change":"2024-02-05T07:17:18.282468+0000","last_active":"2024-02-05T07:17:57.192758+0000","last_peered":"2024-02-05T07:17:57.192758+0000","last_clean":"2024-02-05T07:17:57.192758+0000","last_became_active":"2024-02-05T07:17:18.282200+0000","last_became_peered":"2024-02-05T07:17:18.282200+0000","last_unstale":"2024-02-05T07:17:57.192758+0000","last_undegraded":"2024-02-05T07:17:57.192758+0000","last_fullsized":"2024-02-05T07:17:57.192758+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T09:50:02.876019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"68'6","reported_seq":38,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.195247+0000","last_change":"2024-02-05T07:17:20.352217+0000","last_active":"2024-02-05T07:17:57.195247+0000","last_peered":"2024-02-05T07:17:57.195247+0000","last_clean":"2024-02-05T07:17:57.195247+0000","last_became_active":"2024-02-05T07:17:20.351501+0000","last_became_peered":"2024-02-05T07:17:20.351501+0000","last_unstale":"2024-02-05T07:17:57.195247+0000","last_undegraded":"2024-02-05T07:17:57.195247+0000","last_fullsized":"2024-02-05T07:17:57.195247+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:26:21.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481679+0000","last_change":"2024-02-05T07:17:24.314522+0000","last_active":"2024-02-05T07:17:56.481679+0000","last_peered":"2024-02-05T07:17:56.481679+0000","last_clean":"2024-02-05T07:17:56.481679+0000","last_became_active":"2024-02-05T07:17:24.314190+0000","last_became_peered":"2024-02-05T07:17:24.314190+0000","last_unstale":"2024-02-05T07:17:56.481679+0000","last_undegraded":"2024-02-05T07:17:56.481679+0000","last_fullsized":"2024-02-05T07:17:56.481679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:41:24.699343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"61'2","reported_seq":45,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430574+0000","last_change":"2024-02-05T07:17:18.285647+0000","last_active":"2024-02-05T07:17:56.430574+0000","last_peered":"2024-02-05T07:17:56.430574+0000","last_clean":"2024-02-05T07:17:56.430574+0000","last_became_active":"2024-02-05T07:17:18.284332+0000","last_became_peered":"2024-02-05T07:17:18.284332+0000","last_unstale":"2024-02-05T07:17:56.430574+0000","last_undegraded":"2024-02-05T07:17:56.430574+0000","last_fullsized":"2024-02-05T07:17:56.430574+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:13:01.326717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"68'15","reported_seq":54,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481376+0000","last_change":"2024-02-05T07:17:20.351773+0000","last_active":"2024-02-05T07:17:56.481376+0000","last_peered":"2024-02-05T07:17:56.481376+0000","last_clean":"2024-02-05T07:17:56.481376+0000","last_became_active":"2024-02-05T07:17:20.351413+0000","last_became_peered":"2024-02-05T07:17:20.351413+0000","last_unstale":"2024-02-05T07:17:56.481376+0000","last_undegraded":"2024-02-05T07:17:56.481376+0000","last_fullsized":"2024-02-05T07:17:56.481376+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:54:21.716606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"68'8","reported_seq":49,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:28.333712+0000","last_change":"2024-02-05T07:17:22.305432+0000","last_active":"2024-02-05T07:18:28.333712+0000","last_peered":"2024-02-05T07:18:28.333712+0000","last_clean":"2024-02-05T07:18:28.333712+0000","last_became_active":"2024-02-05T07:17:22.305139+0000","last_became_peered":"2024-02-05T07:17:22.305139+0000","last_unstale":"2024-02-05T07:18:28.333712+0000","last_undegraded":"2024-02-05T07:18:28.333712+0000","last_fullsized":"2024-02-05T07:18:28.333712+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:42:41.836804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194494+0000","last_change":"2024-02-05T07:17:24.311380+0000","last_active":"2024-02-05T07:17:57.194494+0000","last_peered":"2024-02-05T07:17:57.194494+0000","last_clean":"2024-02-05T07:17:57.194494+0000","last_became_active":"2024-02-05T07:17:24.311085+0000","last_became_peered":"2024-02-05T07:17:24.311085+0000","last_unstale":"2024-02-05T07:17:57.194494+0000","last_undegraded":"2024-02-05T07:17:57.194494+0000","last_fullsized":"2024-02-05T07:17:57.194494+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:32:16.774283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430521+0000","last_change":"2024-02-05T07:17:18.285693+0000","last_active":"2024-02-05T07:17:56.430521+0000","last_peered":"2024-02-05T07:17:56.430521+0000","last_clean":"2024-02-05T07:17:56.430521+0000","last_became_active":"2024-02-05T07:17:18.285414+0000","last_became_peered":"2024-02-05T07:17:18.285414+0000","last_unstale":"2024-02-05T07:17:56.430521+0000","last_undegraded":"2024-02-05T07:17:56.430521+0000","last_fullsized":"2024-02-05T07:17:56.430521+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:51:39.651170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"68'12","reported_seq":52,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387476+0000","last_change":"2024-02-05T07:17:20.290162+0000","last_active":"2024-02-05T07:17:56.387476+0000","last_peered":"2024-02-05T07:17:56.387476+0000","last_clean":"2024-02-05T07:17:56.387476+0000","last_became_active":"2024-02-05T07:17:20.289823+0000","last_became_peered":"2024-02-05T07:17:20.289823+0000","last_unstale":"2024-02-05T07:17:56.387476+0000","last_undegraded":"2024-02-05T07:17:56.387476+0000","last_fullsized":"2024-02-05T07:17:56.387476+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:09:15.372720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.390027+0000","last_change":"2024-02-05T07:17:22.297137+0000","last_active":"2024-02-05T07:17:56.390027+0000","last_peered":"2024-02-05T07:17:56.390027+0000","last_clean":"2024-02-05T07:17:56.390027+0000","last_became_active":"2024-02-05T07:17:22.296534+0000","last_became_peered":"2024-02-05T07:17:22.296534+0000","last_unstale":"2024-02-05T07:17:56.390027+0000","last_undegraded":"2024-02-05T07:17:56.390027+0000","last_fullsized":"2024-02-05T07:17:56.390027+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:57:35.162801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.429732+0000","last_change":"2024-02-05T07:17:24.310790+0000","last_active":"2024-02-05T07:17:56.429732+0000","last_peered":"2024-02-05T07:17:56.429732+0000","last_clean":"2024-02-05T07:17:56.429732+0000","last_became_active":"2024-02-05T07:17:24.310505+0000","last_became_peered":"2024-02-05T07:17:24.310505+0000","last_unstale":"2024-02-05T07:17:56.429732+0000","last_undegraded":"2024-02-05T07:17:56.429732+0000","last_fullsized":"2024-02-05T07:17:56.429732+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:28:50.294617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389763+0000","last_change":"2024-02-05T07:17:22.298950+0000","last_active":"2024-02-05T07:17:56.389763+0000","last_peered":"2024-02-05T07:17:56.389763+0000","last_clean":"2024-02-05T07:17:56.389763+0000","last_became_active":"2024-02-05T07:17:22.298172+0000","last_became_peered":"2024-02-05T07:17:22.298172+0000","last_unstale":"2024-02-05T07:17:56.389763+0000","last_undegraded":"2024-02-05T07:17:56.389763+0000","last_fullsized":"2024-02-05T07:17:56.389763+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:49:14.813892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430415+0000","last_change":"2024-02-05T07:17:18.282178+0000","last_active":"2024-02-05T07:17:56.430415+0000","last_peered":"2024-02-05T07:17:56.430415+0000","last_clean":"2024-02-05T07:17:56.430415+0000","last_became_active":"2024-02-05T07:17:18.281721+0000","last_became_peered":"2024-02-05T07:17:18.281721+0000","last_unstale":"2024-02-05T07:17:56.430415+0000","last_undegraded":"2024-02-05T07:17:56.430415+0000","last_fullsized":"2024-02-05T07:17:56.430415+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:49:44.461053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"68'19","reported_seq":86,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192972+0000","last_change":"2024-02-05T07:17:46.203531+0000","last_active":"2024-02-05T07:17:57.192972+0000","last_peered":"2024-02-05T07:17:57.192972+0000","last_clean":"2024-02-05T07:17:57.192972+0000","last_became_active":"2024-02-05T07:17:46.193635+0000","last_became_peered":"2024-02-05T07:17:46.193635+0000","last_unstale":"2024-02-05T07:17:57.192972+0000","last_undegraded":"2024-02-05T07:17:57.192972+0000","last_fullsized":"2024-02-05T07:17:57.192972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T18:57:23.978978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,7],"acting":[6,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192746+0000","last_change":"2024-02-05T07:17:24.310131+0000","last_active":"2024-02-05T07:17:57.192746+0000","last_peered":"2024-02-05T07:17:57.192746+0000","last_clean":"2024-02-05T07:17:57.192746+0000","last_became_active":"2024-02-05T07:17:24.309745+0000","last_became_peered":"2024-02-05T07:17:24.309745+0000","last_unstale":"2024-02-05T07:17:57.192746+0000","last_undegraded":"2024-02-05T07:17:57.192746+0000","last_fullsized":"2024-02-05T07:17:57.192746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:26:00.361411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388919+0000","last_change":"2024-02-05T07:17:22.296514+0000","last_active":"2024-02-05T07:17:56.388919+0000","last_peered":"2024-02-05T07:17:56.388919+0000","last_clean":"2024-02-05T07:17:56.388919+0000","last_became_active":"2024-02-05T07:17:22.295945+0000","last_became_peered":"2024-02-05T07:17:22.295945+0000","last_unstale":"2024-02-05T07:17:56.388919+0000","last_undegraded":"2024-02-05T07:17:56.388919+0000","last_fullsized":"2024-02-05T07:17:56.388919+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:39:35.431560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481676+0000","last_change":"2024-02-05T07:17:18.278790+0000","last_active":"2024-02-05T07:17:56.481676+0000","last_peered":"2024-02-05T07:17:56.481676+0000","last_clean":"2024-02-05T07:17:56.481676+0000","last_became_active":"2024-02-05T07:17:18.278493+0000","last_became_peered":"2024-02-05T07:17:18.278493+0000","last_unstale":"2024-02-05T07:17:56.481676+0000","last_undegraded":"2024-02-05T07:17:56.481676+0000","last_fullsized":"2024-02-05T07:17:56.481676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:08:02.218462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"68'9","reported_seq":45,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193237+0000","last_change":"2024-02-05T07:17:20.296231+0000","last_active":"2024-02-05T07:17:57.193237+0000","last_peered":"2024-02-05T07:17:57.193237+0000","last_clean":"2024-02-05T07:17:57.193237+0000","last_became_active":"2024-02-05T07:17:20.295933+0000","last_became_peered":"2024-02-05T07:17:20.295933+0000","last_unstale":"2024-02-05T07:17:57.193237+0000","last_undegraded":"2024-02-05T07:17:57.193237+0000","last_fullsized":"2024-02-05T07:17:57.193237+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:05:22.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194628+0000","last_change":"2024-02-05T07:17:24.305343+0000","last_active":"2024-02-05T07:17:57.194628+0000","last_peered":"2024-02-05T07:17:57.194628+0000","last_clean":"2024-02-05T07:17:57.194628+0000","last_became_active":"2024-02-05T07:17:24.305061+0000","last_became_peered":"2024-02-05T07:17:24.305061+0000","last_unstale":"2024-02-05T07:17:57.194628+0000","last_undegraded":"2024-02-05T07:17:57.194628+0000","last_fullsized":"2024-02-05T07:17:57.194628+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:52:29.185052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"65'2","reported_seq":42,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481472+0000","last_change":"2024-02-05T07:17:22.296367+0000","last_active":"2024-02-05T07:17:56.481472+0000","last_peered":"2024-02-05T07:17:56.481472+0000","last_clean":"2024-02-05T07:17:56.481472+0000","last_became_active":"2024-02-05T07:17:18.279484+0000","last_became_peered":"2024-02-05T07:17:18.279484+0000","last_unstale":"2024-02-05T07:17:56.481472+0000","last_undegraded":"2024-02-05T07:17:56.481472+0000","last_fullsized":"2024-02-05T07:17:56.481472+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:46:40.612314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034039439999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387020+0000","last_change":"2024-02-05T07:17:18.282723+0000","last_active":"2024-02-05T07:17:56.387020+0000","last_peered":"2024-02-05T07:17:56.387020+0000","last_clean":"2024-02-05T07:17:56.387020+0000","last_became_active":"2024-02-05T07:17:18.282337+0000","last_became_peered":"2024-02-05T07:17:18.282337+0000","last_unstale":"2024-02-05T07:17:56.387020+0000","last_undegraded":"2024-02-05T07:17:56.387020+0000","last_fullsized":"2024-02-05T07:17:56.387020+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:40:22.934781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"68'28","reported_seq":93,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:28.333548+0000","last_change":"2024-02-05T07:17:20.291669+0000","last_active":"2024-02-05T07:18:28.333548+0000","last_peered":"2024-02-05T07:18:28.333548+0000","last_clean":"2024-02-05T07:18:28.333548+0000","last_became_active":"2024-02-05T07:17:20.291407+0000","last_became_peered":"2024-02-05T07:17:20.291407+0000","last_unstale":"2024-02-05T07:18:28.333548+0000","last_undegraded":"2024-02-05T07:18:28.333548+0000","last_fullsized":"2024-02-05T07:18:28.333548+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T18:49:58.523217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193356+0000","last_change":"2024-02-05T07:17:22.307994+0000","last_active":"2024-02-05T07:17:57.193356+0000","last_peered":"2024-02-05T07:17:57.193356+0000","last_clean":"2024-02-05T07:17:57.193356+0000","last_became_active":"2024-02-05T07:17:22.307688+0000","last_became_peered":"2024-02-05T07:17:22.307688+0000","last_unstale":"2024-02-05T07:17:57.193356+0000","last_undegraded":"2024-02-05T07:17:57.193356+0000","last_fullsized":"2024-02-05T07:17:57.193356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:37:57.528755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430479+0000","last_change":"2024-02-05T07:17:24.316753+0000","last_active":"2024-02-05T07:17:56.430479+0000","last_peered":"2024-02-05T07:17:56.430479+0000","last_clean":"2024-02-05T07:17:56.430479+0000","last_became_active":"2024-02-05T07:17:24.316383+0000","last_became_peered":"2024-02-05T07:17:24.316383+0000","last_unstale":"2024-02-05T07:17:56.430479+0000","last_undegraded":"2024-02-05T07:17:56.430479+0000","last_fullsized":"2024-02-05T07:17:56.430479+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:30:02.882849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387479+0000","last_change":"2024-02-05T07:17:18.280769+0000","last_active":"2024-02-05T07:17:56.387479+0000","last_peered":"2024-02-05T07:17:56.387479+0000","last_clean":"2024-02-05T07:17:56.387479+0000","last_became_active":"2024-02-05T07:17:18.278822+0000","last_became_peered":"2024-02-05T07:17:18.278822+0000","last_unstale":"2024-02-05T07:17:56.387479+0000","last_undegraded":"2024-02-05T07:17:56.387479+0000","last_fullsized":"2024-02-05T07:17:56.387479+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:11:42.178566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389055+0000","last_change":"2024-02-05T07:17:22.287014+0000","last_active":"2024-02-05T07:17:56.389055+0000","last_peered":"2024-02-05T07:17:56.389055+0000","last_clean":"2024-02-05T07:17:56.389055+0000","last_became_active":"2024-02-05T07:17:18.280417+0000","last_became_peered":"2024-02-05T07:17:18.280417+0000","last_unstale":"2024-02-05T07:17:56.389055+0000","last_undegraded":"2024-02-05T07:17:56.389055+0000","last_fullsized":"2024-02-05T07:17:56.389055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:26:42.166363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057931900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"68'13","reported_seq":56,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389260+0000","last_change":"2024-02-05T07:17:20.292585+0000","last_active":"2024-02-05T07:17:56.389260+0000","last_peered":"2024-02-05T07:17:56.389260+0000","last_clean":"2024-02-05T07:17:56.389260+0000","last_became_active":"2024-02-05T07:17:20.292310+0000","last_became_peered":"2024-02-05T07:17:20.292310+0000","last_unstale":"2024-02-05T07:17:56.389260+0000","last_undegraded":"2024-02-05T07:17:56.389260+0000","last_fullsized":"2024-02-05T07:17:56.389260+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:28:03.081404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389375+0000","last_change":"2024-02-05T07:17:22.301480+0000","last_active":"2024-02-05T07:17:56.389375+0000","last_peered":"2024-02-05T07:17:56.389375+0000","last_clean":"2024-02-05T07:17:56.389375+0000","last_became_active":"2024-02-05T07:17:22.301190+0000","last_became_peered":"2024-02-05T07:17:22.301190+0000","last_unstale":"2024-02-05T07:17:56.389375+0000","last_undegraded":"2024-02-05T07:17:56.389375+0000","last_fullsized":"2024-02-05T07:17:56.389375+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:52:55.355321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.482057+0000","last_change":"2024-02-05T07:17:24.307216+0000","last_active":"2024-02-05T07:17:56.482057+0000","last_peered":"2024-02-05T07:17:56.482057+0000","last_clean":"2024-02-05T07:17:56.482057+0000","last_became_active":"2024-02-05T07:17:24.306911+0000","last_became_peered":"2024-02-05T07:17:24.306911+0000","last_unstale":"2024-02-05T07:17:56.482057+0000","last_undegraded":"2024-02-05T07:17:56.482057+0000","last_fullsized":"2024-02-05T07:17:56.482057+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:52:33.615795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":276,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:58.483905+0000","last_change":"2024-02-05T07:17:09.287720+0000","last_active":"2024-02-05T07:17:58.483905+0000","last_peered":"2024-02-05T07:17:58.483905+0000","last_clean":"2024-02-05T07:17:58.483905+0000","last_became_active":"2024-02-05T07:17:09.287395+0000","last_became_peered":"2024-02-05T07:17:09.287395+0000","last_unstale":"2024-02-05T07:17:58.483905+0000","last_undegraded":"2024-02-05T07:17:58.483905+0000","last_fullsized":"2024-02-05T07:17:58.483905+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:14:58.589269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:14:58.589269+0000","last_clean_scrub_stamp":"2024-02-05T07:14:58.589269+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:15:29.709923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194048+0000","last_change":"2024-02-05T07:17:18.279541+0000","last_active":"2024-02-05T07:17:57.194048+0000","last_peered":"2024-02-05T07:17:57.194048+0000","last_clean":"2024-02-05T07:17:57.194048+0000","last_became_active":"2024-02-05T07:17:18.279257+0000","last_became_peered":"2024-02-05T07:17:18.279257+0000","last_unstale":"2024-02-05T07:17:57.194048+0000","last_undegraded":"2024-02-05T07:17:57.194048+0000","last_fullsized":"2024-02-05T07:17:57.194048+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:52:36.484973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"68'16","reported_seq":67,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:28.333444+0000","last_change":"2024-02-05T07:17:20.351595+0000","last_active":"2024-02-05T07:18:28.333444+0000","last_peered":"2024-02-05T07:18:28.333444+0000","last_clean":"2024-02-05T07:18:28.333444+0000","last_became_active":"2024-02-05T07:17:20.351211+0000","last_became_peered":"2024-02-05T07:17:20.351211+0000","last_unstale":"2024-02-05T07:18:28.333444+0000","last_undegraded":"2024-02-05T07:18:28.333444+0000","last_fullsized":"2024-02-05T07:18:28.333444+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:16:40.996275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430301+0000","last_change":"2024-02-05T07:17:22.301346+0000","last_active":"2024-02-05T07:17:56.430301+0000","last_peered":"2024-02-05T07:17:56.430301+0000","last_clean":"2024-02-05T07:17:56.430301+0000","last_became_active":"2024-02-05T07:17:22.301053+0000","last_became_peered":"2024-02-05T07:17:22.301053+0000","last_unstale":"2024-02-05T07:17:56.430301+0000","last_undegraded":"2024-02-05T07:17:56.430301+0000","last_fullsized":"2024-02-05T07:17:56.430301+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:46:59.317068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387835+0000","last_change":"2024-02-05T07:17:24.312065+0000","last_active":"2024-02-05T07:17:56.387835+0000","last_peered":"2024-02-05T07:17:56.387835+0000","last_clean":"2024-02-05T07:17:56.387835+0000","last_became_active":"2024-02-05T07:17:24.311676+0000","last_became_peered":"2024-02-05T07:17:24.311676+0000","last_unstale":"2024-02-05T07:17:56.387835+0000","last_undegraded":"2024-02-05T07:17:56.387835+0000","last_fullsized":"2024-02-05T07:17:56.387835+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:18:00.222888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192897+0000","last_change":"2024-02-05T07:17:18.285493+0000","last_active":"2024-02-05T07:17:57.192897+0000","last_peered":"2024-02-05T07:17:57.192897+0000","last_clean":"2024-02-05T07:17:57.192897+0000","last_became_active":"2024-02-05T07:17:18.285208+0000","last_became_peered":"2024-02-05T07:17:18.285208+0000","last_unstale":"2024-02-05T07:17:57.192897+0000","last_undegraded":"2024-02-05T07:17:57.192897+0000","last_fullsized":"2024-02-05T07:17:57.192897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:00:57.885970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"69'5","reported_seq":116,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:35.642207+0000","last_change":"2024-02-05T07:17:22.295737+0000","last_active":"2024-02-05T07:18:35.642207+0000","last_peered":"2024-02-05T07:18:35.642207+0000","last_clean":"2024-02-05T07:18:35.642207+0000","last_became_active":"2024-02-05T07:17:18.285184+0000","last_became_peered":"2024-02-05T07:17:18.285184+0000","last_unstale":"2024-02-05T07:18:35.642207+0000","last_undegraded":"2024-02-05T07:18:35.642207+0000","last_fullsized":"2024-02-05T07:18:35.642207+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:21:21.797689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090368800000000004,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":73,"num_read_kb":68,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"68'12","reported_seq":47,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193295+0000","last_change":"2024-02-05T07:17:20.294445+0000","last_active":"2024-02-05T07:17:57.193295+0000","last_peered":"2024-02-05T07:17:57.193295+0000","last_clean":"2024-02-05T07:17:57.193295+0000","last_became_active":"2024-02-05T07:17:20.293445+0000","last_became_peered":"2024-02-05T07:17:20.293445+0000","last_unstale":"2024-02-05T07:17:57.193295+0000","last_undegraded":"2024-02-05T07:17:57.193295+0000","last_fullsized":"2024-02-05T07:17:57.193295+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:11:57.923653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.482239+0000","last_change":"2024-02-05T07:17:22.300440+0000","last_active":"2024-02-05T07:17:56.482239+0000","last_peered":"2024-02-05T07:17:56.482239+0000","last_clean":"2024-02-05T07:17:56.482239+0000","last_became_active":"2024-02-05T07:17:22.299605+0000","last_became_peered":"2024-02-05T07:17:22.299605+0000","last_unstale":"2024-02-05T07:17:56.482239+0000","last_undegraded":"2024-02-05T07:17:56.482239+0000","last_fullsized":"2024-02-05T07:17:56.482239+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:02:19.911184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389466+0000","last_change":"2024-02-05T07:17:24.314867+0000","last_active":"2024-02-05T07:17:56.389466+0000","last_peered":"2024-02-05T07:17:56.389466+0000","last_clean":"2024-02-05T07:17:56.389466+0000","last_became_active":"2024-02-05T07:17:24.314523+0000","last_became_peered":"2024-02-05T07:17:24.314523+0000","last_unstale":"2024-02-05T07:17:56.389466+0000","last_undegraded":"2024-02-05T07:17:56.389466+0000","last_fullsized":"2024-02-05T07:17:56.389466+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:33:22.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387952+0000","last_change":"2024-02-05T07:17:18.273405+0000","last_active":"2024-02-05T07:17:56.387952+0000","last_peered":"2024-02-05T07:17:56.387952+0000","last_clean":"2024-02-05T07:17:56.387952+0000","last_became_active":"2024-02-05T07:17:18.273047+0000","last_became_peered":"2024-02-05T07:17:18.273047+0000","last_unstale":"2024-02-05T07:17:56.387952+0000","last_undegraded":"2024-02-05T07:17:56.387952+0000","last_fullsized":"2024-02-05T07:17:56.387952+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T09:39:28.815608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"68'19","reported_seq":65,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193514+0000","last_change":"2024-02-05T07:17:20.351546+0000","last_active":"2024-02-05T07:17:57.193514+0000","last_peered":"2024-02-05T07:17:57.193514+0000","last_clean":"2024-02-05T07:17:57.193514+0000","last_became_active":"2024-02-05T07:17:20.351268+0000","last_became_peered":"2024-02-05T07:17:20.351268+0000","last_unstale":"2024-02-05T07:17:57.193514+0000","last_undegraded":"2024-02-05T07:17:57.193514+0000","last_fullsized":"2024-02-05T07:17:57.193514+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:12:57.361127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192995+0000","last_change":"2024-02-05T07:17:22.301640+0000","last_active":"2024-02-05T07:17:57.192995+0000","last_peered":"2024-02-05T07:17:57.192995+0000","last_clean":"2024-02-05T07:17:57.192995+0000","last_became_active":"2024-02-05T07:17:22.301286+0000","last_became_peered":"2024-02-05T07:17:22.301286+0000","last_unstale":"2024-02-05T07:17:57.192995+0000","last_undegraded":"2024-02-05T07:17:57.192995+0000","last_fullsized":"2024-02-05T07:17:57.192995+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:53:39.146281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192699+0000","last_change":"2024-02-05T07:17:24.313326+0000","last_active":"2024-02-05T07:17:57.192699+0000","last_peered":"2024-02-05T07:17:57.192699+0000","last_clean":"2024-02-05T07:17:57.192699+0000","last_became_active":"2024-02-05T07:17:24.313036+0000","last_became_peered":"2024-02-05T07:17:24.313036+0000","last_unstale":"2024-02-05T07:17:57.192699+0000","last_undegraded":"2024-02-05T07:17:57.192699+0000","last_fullsized":"2024-02-05T07:17:57.192699+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:35:36.860137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481965+0000","last_change":"2024-02-05T07:17:18.276186+0000","last_active":"2024-02-05T07:17:56.481965+0000","last_peered":"2024-02-05T07:17:56.481965+0000","last_clean":"2024-02-05T07:17:56.481965+0000","last_became_active":"2024-02-05T07:17:18.275906+0000","last_became_peered":"2024-02-05T07:17:18.275906+0000","last_unstale":"2024-02-05T07:17:56.481965+0000","last_undegraded":"2024-02-05T07:17:56.481965+0000","last_fullsized":"2024-02-05T07:17:56.481965+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:22:39.768474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"68'10","reported_seq":44,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388647+0000","last_change":"2024-02-05T07:17:20.288364+0000","last_active":"2024-02-05T07:17:56.388647+0000","last_peered":"2024-02-05T07:17:56.388647+0000","last_clean":"2024-02-05T07:17:56.388647+0000","last_became_active":"2024-02-05T07:17:20.288005+0000","last_became_peered":"2024-02-05T07:17:20.288005+0000","last_unstale":"2024-02-05T07:17:56.388647+0000","last_undegraded":"2024-02-05T07:17:56.388647+0000","last_fullsized":"2024-02-05T07:17:56.388647+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:48:48.033639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"68'8","reported_seq":49,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:28.333473+0000","last_change":"2024-02-05T07:17:22.301631+0000","last_active":"2024-02-05T07:18:28.333473+0000","last_peered":"2024-02-05T07:18:28.333473+0000","last_clean":"2024-02-05T07:18:28.333473+0000","last_became_active":"2024-02-05T07:17:22.301330+0000","last_became_peered":"2024-02-05T07:17:22.301330+0000","last_unstale":"2024-02-05T07:18:28.333473+0000","last_undegraded":"2024-02-05T07:18:28.333473+0000","last_fullsized":"2024-02-05T07:18:28.333473+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:39:25.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430250+0000","last_change":"2024-02-05T07:17:24.315442+0000","last_active":"2024-02-05T07:17:56.430250+0000","last_peered":"2024-02-05T07:17:56.430250+0000","last_clean":"2024-02-05T07:17:56.430250+0000","last_became_active":"2024-02-05T07:17:24.314563+0000","last_became_peered":"2024-02-05T07:17:24.314563+0000","last_unstale":"2024-02-05T07:17:56.430250+0000","last_undegraded":"2024-02-05T07:17:56.430250+0000","last_fullsized":"2024-02-05T07:17:56.430250+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:35:01.917095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"61'1","reported_seq":34,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193975+0000","last_change":"2024-02-05T07:17:18.285637+0000","last_active":"2024-02-05T07:17:57.193975+0000","last_peered":"2024-02-05T07:17:57.193975+0000","last_clean":"2024-02-05T07:17:57.193975+0000","last_became_active":"2024-02-05T07:17:18.285357+0000","last_became_peered":"2024-02-05T07:17:18.285357+0000","last_unstale":"2024-02-05T07:17:57.193975+0000","last_undegraded":"2024-02-05T07:17:57.193975+0000","last_fullsized":"2024-02-05T07:17:57.193975+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:27:55.572167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'14","reported_seq":50,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387026+0000","last_change":"2024-02-05T07:17:20.285101+0000","last_active":"2024-02-05T07:17:56.387026+0000","last_peered":"2024-02-05T07:17:56.387026+0000","last_clean":"2024-02-05T07:17:56.387026+0000","last_became_active":"2024-02-05T07:17:20.284055+0000","last_became_peered":"2024-02-05T07:17:20.284055+0000","last_unstale":"2024-02-05T07:17:56.387026+0000","last_undegraded":"2024-02-05T07:17:56.387026+0000","last_fullsized":"2024-02-05T07:17:56.387026+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:46:13.090149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"68'8","reported_seq":49,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:28.333488+0000","last_change":"2024-02-05T07:17:22.299150+0000","last_active":"2024-02-05T07:18:28.333488+0000","last_peered":"2024-02-05T07:18:28.333488+0000","last_clean":"2024-02-05T07:18:28.333488+0000","last_became_active":"2024-02-05T07:17:22.298853+0000","last_became_peered":"2024-02-05T07:17:22.298853+0000","last_unstale":"2024-02-05T07:18:28.333488+0000","last_undegraded":"2024-02-05T07:18:28.333488+0000","last_fullsized":"2024-02-05T07:18:28.333488+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:41:19.392977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387254+0000","last_change":"2024-02-05T07:17:24.309759+0000","last_active":"2024-02-05T07:17:56.387254+0000","last_peered":"2024-02-05T07:17:56.387254+0000","last_clean":"2024-02-05T07:17:56.387254+0000","last_became_active":"2024-02-05T07:17:24.309486+0000","last_became_peered":"2024-02-05T07:17:24.309486+0000","last_unstale":"2024-02-05T07:17:56.387254+0000","last_undegraded":"2024-02-05T07:17:56.387254+0000","last_fullsized":"2024-02-05T07:17:56.387254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T19:16:44.544180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.195093+0000","last_change":"2024-02-05T07:17:18.282345+0000","last_active":"2024-02-05T07:17:57.195093+0000","last_peered":"2024-02-05T07:17:57.195093+0000","last_clean":"2024-02-05T07:17:57.195093+0000","last_became_active":"2024-02-05T07:17:18.282038+0000","last_became_peered":"2024-02-05T07:17:18.282038+0000","last_unstale":"2024-02-05T07:17:57.195093+0000","last_undegraded":"2024-02-05T07:17:57.195093+0000","last_fullsized":"2024-02-05T07:17:57.195093+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:45:02.469086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"68'18","reported_seq":61,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193532+0000","last_change":"2024-02-05T07:17:20.352282+0000","last_active":"2024-02-05T07:17:57.193532+0000","last_peered":"2024-02-05T07:17:57.193532+0000","last_clean":"2024-02-05T07:17:57.193532+0000","last_became_active":"2024-02-05T07:17:20.351809+0000","last_became_peered":"2024-02-05T07:17:20.351809+0000","last_unstale":"2024-02-05T07:17:57.193532+0000","last_undegraded":"2024-02-05T07:17:57.193532+0000","last_fullsized":"2024-02-05T07:17:57.193532+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:39:22.322069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.386927+0000","last_change":"2024-02-05T07:17:22.302893+0000","last_active":"2024-02-05T07:17:56.386927+0000","last_peered":"2024-02-05T07:17:56.386927+0000","last_clean":"2024-02-05T07:17:56.386927+0000","last_became_active":"2024-02-05T07:17:22.302344+0000","last_became_peered":"2024-02-05T07:17:22.302344+0000","last_unstale":"2024-02-05T07:17:56.386927+0000","last_undegraded":"2024-02-05T07:17:56.386927+0000","last_fullsized":"2024-02-05T07:17:56.386927+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T19:16:17.092730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481865+0000","last_change":"2024-02-05T07:17:24.304379+0000","last_active":"2024-02-05T07:17:56.481865+0000","last_peered":"2024-02-05T07:17:56.481865+0000","last_clean":"2024-02-05T07:17:56.481865+0000","last_became_active":"2024-02-05T07:17:24.303905+0000","last_became_peered":"2024-02-05T07:17:24.303905+0000","last_unstale":"2024-02-05T07:17:56.481865+0000","last_undegraded":"2024-02-05T07:17:56.481865+0000","last_fullsized":"2024-02-05T07:17:56.481865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:35:44.103501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"68'8","reported_seq":49,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:28.333441+0000","last_change":"2024-02-05T07:17:22.304951+0000","last_active":"2024-02-05T07:18:28.333441+0000","last_peered":"2024-02-05T07:18:28.333441+0000","last_clean":"2024-02-05T07:18:28.333441+0000","last_became_active":"2024-02-05T07:17:22.304655+0000","last_became_peered":"2024-02-05T07:17:22.304655+0000","last_unstale":"2024-02-05T07:18:28.333441+0000","last_undegraded":"2024-02-05T07:18:28.333441+0000","last_fullsized":"2024-02-05T07:18:28.333441+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:32:35.144503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193443+0000","last_change":"2024-02-05T07:17:18.281920+0000","last_active":"2024-02-05T07:17:57.193443+0000","last_peered":"2024-02-05T07:17:57.193443+0000","last_clean":"2024-02-05T07:17:57.193443+0000","last_became_active":"2024-02-05T07:17:18.281614+0000","last_became_peered":"2024-02-05T07:17:18.281614+0000","last_unstale":"2024-02-05T07:17:57.193443+0000","last_undegraded":"2024-02-05T07:17:57.193443+0000","last_fullsized":"2024-02-05T07:17:57.193443+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:01:53.304921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"68'15","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.390135+0000","last_change":"2024-02-05T07:17:46.200946+0000","last_active":"2024-02-05T07:17:56.390135+0000","last_peered":"2024-02-05T07:17:56.390135+0000","last_clean":"2024-02-05T07:17:56.390135+0000","last_became_active":"2024-02-05T07:17:46.191356+0000","last_became_peered":"2024-02-05T07:17:46.191356+0000","last_unstale":"2024-02-05T07:17:56.390135+0000","last_undegraded":"2024-02-05T07:17:56.390135+0000","last_fullsized":"2024-02-05T07:17:56.390135+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:39:01.691243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193606+0000","last_change":"2024-02-05T07:17:24.314899+0000","last_active":"2024-02-05T07:17:57.193606+0000","last_peered":"2024-02-05T07:17:57.193606+0000","last_clean":"2024-02-05T07:17:57.193606+0000","last_became_active":"2024-02-05T07:17:24.314562+0000","last_became_peered":"2024-02-05T07:17:24.314562+0000","last_unstale":"2024-02-05T07:17:57.193606+0000","last_undegraded":"2024-02-05T07:17:57.193606+0000","last_fullsized":"2024-02-05T07:17:57.193606+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T09:51:53.155955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.482235+0000","last_change":"2024-02-05T07:17:22.304008+0000","last_active":"2024-02-05T07:17:56.482235+0000","last_peered":"2024-02-05T07:17:56.482235+0000","last_clean":"2024-02-05T07:17:56.482235+0000","last_became_active":"2024-02-05T07:17:22.303304+0000","last_became_peered":"2024-02-05T07:17:22.303304+0000","last_unstale":"2024-02-05T07:17:56.482235+0000","last_undegraded":"2024-02-05T07:17:56.482235+0000","last_fullsized":"2024-02-05T07:17:56.482235+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:22:45.841141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387379+0000","last_change":"2024-02-05T07:17:18.285673+0000","last_active":"2024-02-05T07:17:56.387379+0000","last_peered":"2024-02-05T07:17:56.387379+0000","last_clean":"2024-02-05T07:17:56.387379+0000","last_became_active":"2024-02-05T07:17:18.285326+0000","last_became_peered":"2024-02-05T07:17:18.285326+0000","last_unstale":"2024-02-05T07:17:56.387379+0000","last_undegraded":"2024-02-05T07:17:56.387379+0000","last_fullsized":"2024-02-05T07:17:56.387379+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:37:22.454481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"68'11","reported_seq":48,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389419+0000","last_change":"2024-02-05T07:17:20.287695+0000","last_active":"2024-02-05T07:17:56.389419+0000","last_peered":"2024-02-05T07:17:56.389419+0000","last_clean":"2024-02-05T07:17:56.389419+0000","last_became_active":"2024-02-05T07:17:20.287333+0000","last_became_peered":"2024-02-05T07:17:20.287333+0000","last_unstale":"2024-02-05T07:17:56.389419+0000","last_undegraded":"2024-02-05T07:17:56.389419+0000","last_fullsized":"2024-02-05T07:17:56.389419+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:37:47.761670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.390366+0000","last_change":"2024-02-05T07:17:24.309836+0000","last_active":"2024-02-05T07:17:56.390366+0000","last_peered":"2024-02-05T07:17:56.390366+0000","last_clean":"2024-02-05T07:17:56.390366+0000","last_became_active":"2024-02-05T07:17:24.309385+0000","last_became_peered":"2024-02-05T07:17:24.309385+0000","last_unstale":"2024-02-05T07:17:56.390366+0000","last_undegraded":"2024-02-05T07:17:56.390366+0000","last_fullsized":"2024-02-05T07:17:56.390366+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:24:03.993047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388108+0000","last_change":"2024-02-05T07:17:22.298197+0000","last_active":"2024-02-05T07:17:56.388108+0000","last_peered":"2024-02-05T07:17:56.388108+0000","last_clean":"2024-02-05T07:17:56.388108+0000","last_became_active":"2024-02-05T07:17:22.297885+0000","last_became_peered":"2024-02-05T07:17:22.297885+0000","last_unstale":"2024-02-05T07:17:56.388108+0000","last_undegraded":"2024-02-05T07:17:56.388108+0000","last_fullsized":"2024-02-05T07:17:56.388108+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:18:23.167469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192893+0000","last_change":"2024-02-05T07:17:18.280870+0000","last_active":"2024-02-05T07:17:57.192893+0000","last_peered":"2024-02-05T07:17:57.192893+0000","last_clean":"2024-02-05T07:17:57.192893+0000","last_became_active":"2024-02-05T07:17:18.280599+0000","last_became_peered":"2024-02-05T07:17:18.280599+0000","last_unstale":"2024-02-05T07:17:57.192893+0000","last_undegraded":"2024-02-05T07:17:57.192893+0000","last_fullsized":"2024-02-05T07:17:57.192893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T18:11:54.290981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"68'17","reported_seq":57,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388485+0000","last_change":"2024-02-05T07:17:20.286369+0000","last_active":"2024-02-05T07:17:56.388485+0000","last_peered":"2024-02-05T07:17:56.388485+0000","last_clean":"2024-02-05T07:17:56.388485+0000","last_became_active":"2024-02-05T07:17:20.285951+0000","last_became_peered":"2024-02-05T07:17:20.285951+0000","last_unstale":"2024-02-05T07:17:56.388485+0000","last_undegraded":"2024-02-05T07:17:56.388485+0000","last_fullsized":"2024-02-05T07:17:56.388485+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:18:50.003842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"68'1","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388985+0000","last_change":"2024-02-05T07:17:24.309350+0000","last_active":"2024-02-05T07:17:56.388985+0000","last_peered":"2024-02-05T07:17:56.388985+0000","last_clean":"2024-02-05T07:17:56.388985+0000","last_became_active":"2024-02-05T07:17:24.308867+0000","last_became_peered":"2024-02-05T07:17:24.308867+0000","last_unstale":"2024-02-05T07:17:56.388985+0000","last_undegraded":"2024-02-05T07:17:56.388985+0000","last_fullsized":"2024-02-05T07:17:56.388985+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:41:12.369837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"68'8","reported_seq":49,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:28.333504+0000","last_change":"2024-02-05T07:17:22.299783+0000","last_active":"2024-02-05T07:18:28.333504+0000","last_peered":"2024-02-05T07:18:28.333504+0000","last_clean":"2024-02-05T07:18:28.333504+0000","last_became_active":"2024-02-05T07:17:22.299462+0000","last_became_peered":"2024-02-05T07:17:22.299462+0000","last_unstale":"2024-02-05T07:18:28.333504+0000","last_undegraded":"2024-02-05T07:18:28.333504+0000","last_fullsized":"2024-02-05T07:18:28.333504+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:56:10.180299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194765+0000","last_change":"2024-02-05T07:17:18.283543+0000","last_active":"2024-02-05T07:17:57.194765+0000","last_peered":"2024-02-05T07:17:57.194765+0000","last_clean":"2024-02-05T07:17:57.194765+0000","last_became_active":"2024-02-05T07:17:18.283192+0000","last_became_peered":"2024-02-05T07:17:18.283192+0000","last_unstale":"2024-02-05T07:17:57.194765+0000","last_undegraded":"2024-02-05T07:17:57.194765+0000","last_fullsized":"2024-02-05T07:17:57.194765+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:23:42.113995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"68'10","reported_seq":44,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387305+0000","last_change":"2024-02-05T07:17:20.289956+0000","last_active":"2024-02-05T07:17:56.387305+0000","last_peered":"2024-02-05T07:17:56.387305+0000","last_clean":"2024-02-05T07:17:56.387305+0000","last_became_active":"2024-02-05T07:17:20.289648+0000","last_became_peered":"2024-02-05T07:17:20.289648+0000","last_unstale":"2024-02-05T07:17:56.387305+0000","last_undegraded":"2024-02-05T07:17:56.387305+0000","last_fullsized":"2024-02-05T07:17:56.387305+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:46:46.396570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":393,"ondisk_log_size":393,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":73,"num_read_kb":68,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":9,"acting":9,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201300,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32452,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712700,"statfs":{"total":95995035648,"available":95961804800,"internally_reserved":0,"allocated":1306624,"data_stored":871705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.44},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47399999999999998}]},{"osd":3,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.50600000000000001}]},{"osd":4,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.312},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.40899999999999997}]},{"osd":5,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.38}]},{"osd":6,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.46000000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495640,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28272,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716880,"statfs":{"total":95995035648,"available":95966085120,"internally_reserved":0,"allocated":1286144,"data_stored":870654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 5 07:17:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.33800000000000002}]},{"osd":1,"last update":"Mon Feb 5 07:17:40 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.438},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.55900000000000005}]},{"osd":2,"last update":"Mon Feb 5 07:17:40 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.45400000000000001}]},{"osd":3,"last update":"Mon Feb 5 07:17:40 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47299999999999998}]},{"osd":4,"last update":"Mon Feb 5 07:17:40 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"last":0.58899999999999997}]},{"osd":5,"last update":"Mon Feb 5 07:17:40 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.53900000000000003}]},{"osd":7,"last update":"Mon Feb 5 07:18:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.499},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.61499999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31916,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713236,"statfs":{"total":95995035648,"available":95962353664,"internally_reserved":0,"allocated":753664,"data_stored":282628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 5 07:17:39 2024","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.33500000000000002,"15min":0.32000000000000001},"min":{"1min":0.20699999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.35899999999999999,"15min":0.33300000000000002},"min":{"1min":0.246,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55600000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.52000000000000002}]},{"osd":2,"last update":"Mon Feb 5 07:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.64400000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.501},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.41199999999999998,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.56100000000000005}]},{"osd":3,"last update":"Mon Feb 5 07:18:30 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47599999999999998,"15min":0.48999999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61699999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.433},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.434,"15min":0.443},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54600000000000004,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.46700000000000003}]},{"osd":4,"last update":"Mon Feb 5 07:17:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.372,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.83899999999999997}]},{"osd":5,"last update":"Mon Feb 5 07:18:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.878},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.91500000000000004}]},{"osd":6,"last update":"Mon Feb 5 07:17:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":1.012}]},{"osd":7,"last update":"Mon Feb 5 07:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.92700000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738425,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28300,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716852,"statfs":{"total":95995035648,"available":95966056448,"internally_reserved":0,"allocated":1314816,"data_stored":871846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 5 07:17:39 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.34999999999999998,"15min":0.307},"min":{"1min":0.23899999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.54300000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.35299999999999998,"15min":0.315},"min":{"1min":0.21099999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.65400000000000003}]},{"osd":2,"last update":"Mon Feb 5 07:18:04 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.44700000000000001,"15min":0.44600000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41699999999999998,"15min":0.40999999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57099999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.53400000000000003}]},{"osd":3,"last update":"Mon Feb 5 07:18:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.45600000000000002,"15min":0.47599999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57799999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.504,"15min":0.52500000000000002},"min":{"1min":0.25700000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63500000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.59499999999999997}]},{"osd":4,"last update":"Mon Feb 5 07:17:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83499999999999996,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.67300000000000004}]},{"osd":5,"last update":"Mon Feb 5 07:18:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.752,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61699999999999999,"15min":0.627},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73299999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64300000000000002}]},{"osd":6,"last update":"Mon Feb 5 07:17:39 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.80800000000000005}]},{"osd":7,"last update":"Mon Feb 5 07:18:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.72799999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411375,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31868,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713284,"statfs":{"total":95995035648,"available":95962402816,"internally_reserved":0,"allocated":704512,"data_stored":281031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 5 07:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36399999999999999,"15min":0.35499999999999998},"min":{"1min":0.23000000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.436},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.38800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59899999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.55900000000000005}]},{"osd":1,"last update":"Mon Feb 5 07:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39700000000000002,"15min":0.39300000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53800000000000003,"5min":0.62,"15min":0.62},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41199999999999998,"15min":0.40799999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59299999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.54000000000000004}]},{"osd":3,"last update":"Mon Feb 5 07:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.432,"15min":0.438},"min":{"1min":0.25900000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.60099999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.44600000000000001,"15min":0.44800000000000001},"min":{"1min":0.28399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.58199999999999996,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.57099999999999995}]},{"osd":4,"last update":"Mon Feb 5 07:17:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65200000000000002}]},{"osd":5,"last update":"Mon Feb 5 07:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.875,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58399999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.67400000000000004}]},{"osd":6,"last update":"Mon Feb 5 07:17:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.63200000000000001}]},{"osd":7,"last update":"Mon Feb 5 07:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.68400000000000005}]}]},{"osd":3,"up_from":25,"seq":107374182441,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31892,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713260,"statfs":{"total":95995035648,"available":95962378240,"internally_reserved":0,"allocated":729088,"data_stored":281177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 5 07:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.39000000000000001,"15min":0.39600000000000002},"min":{"1min":0.248,"5min":0.245,"15min":0.245},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.22},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.436,"15min":0.44400000000000001},"min":{"1min":0.28000000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56599999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.33900000000000002}]},{"osd":1,"last update":"Mon Feb 5 07:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.441,"15min":0.45300000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61699999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.35899999999999999}]},{"osd":2,"last update":"Mon Feb 5 07:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46100000000000002,"15min":0.46800000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.58999999999999997,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.312},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.44900000000000001,"15min":0.46400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.57899999999999996,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.27400000000000002}]},{"osd":4,"last update":"Mon Feb 5 07:17:48 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55500000000000005},"min":{"1min":0.41699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.69999999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.44,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.74399999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.53800000000000003}]},{"osd":5,"last update":"Mon Feb 5 07:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.503},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Feb 5 07:17:39 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.47599999999999998}]},{"osd":7,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.51000000000000001}]}]},{"osd":4,"up_from":30,"seq":128849018916,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717420,"statfs":{"total":95995035648,"available":95966638080,"internally_reserved":0,"allocated":729088,"data_stored":281778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 5 07:17:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.52700000000000002,"15min":0.51100000000000001},"min":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.31}]},{"osd":1,"last update":"Mon Feb 5 07:17:48 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.48699999999999999,"15min":0.48099999999999998},"min":{"1min":0.34599999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.48299999999999998}]},{"osd":2,"last update":"Mon Feb 5 07:17:48 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.501,"15min":0.498},"min":{"1min":0.39700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.39600000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.42599999999999999}]},{"osd":3,"last update":"Mon Feb 5 07:17:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.39200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.53900000000000003,"15min":0.52500000000000002},"min":{"1min":0.41499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.6789999999999998,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.40500000000000003}]},{"osd":5,"last update":"Mon Feb 5 07:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.39400000000000002,"15min":0.379},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.5},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.435,"15min":0.42699999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.38100000000000001}]},{"osd":6,"last update":"Mon Feb 5 07:17:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.51500000000000001}]},{"osd":7,"last update":"Mon Feb 5 07:18:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.44500000000000001}]}]},{"osd":5,"up_from":38,"seq":163208757279,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713280,"statfs":{"total":95995035648,"available":95962398720,"internally_reserved":0,"allocated":708608,"data_stored":281993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 5 07:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54200000000000004,"15min":0.54500000000000004},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.46500000000000002}]},{"osd":1,"last update":"Mon Feb 5 07:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.54400000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.39100000000000001}]},{"osd":2,"last update":"Mon Feb 5 07:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86599999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.498}]},{"osd":3,"last update":"Mon Feb 5 07:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57099999999999995,"15min":0.57599999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81599999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.53700000000000003}]},{"osd":4,"last update":"Mon Feb 5 07:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.436,"15min":0.435},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68500000000000005,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64800000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.34699999999999998}]},{"osd":6,"last update":"Mon Feb 5 07:17:40 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.58599999999999997}]},{"osd":7,"last update":"Mon Feb 5 07:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.36699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-05T07:18:41.942 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph pg dump --format=json 2024-02-05T07:18:42.180 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:42.578 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:42 smithi184 ceph-mon[29861]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:42.578 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:42 smithi184 ceph-mon[29861]: from='client.14754 v1:172.21.15.184:0/3635815075' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-05T07:18:42.578 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:42 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:18:42.579 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:42 smithi184 ceph-mon[41609]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:42.579 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:42 smithi184 ceph-mon[41609]: from='client.14754 v1:172.21.15.184:0/3635815075' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-05T07:18:42.579 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:42 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:18:42.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:42 smithi188 ceph-mon[33283]: pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:42.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:42 smithi188 ceph-mon[33283]: from='client.14754 v1:172.21.15.184:0/3635815075' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-05T07:18:42.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:42 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:18:43.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.909+0000 7f64c6aeb700 1 -- 172.21.15.184:0/3317081455 >> v1:172.21.15.184:6790/0 conn(0x7f64c010a980 legacy=0x7f64c010cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:43.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.909+0000 7f64c6aeb700 1 -- 172.21.15.184:0/3317081455 shutdown_connections 2024-02-05T07:18:43.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.909+0000 7f64c6aeb700 1 -- 172.21.15.184:0/3317081455 >> 172.21.15.184:0/3317081455 conn(0x7f64c00fd600 msgr2=0x7f64c00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:43.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.909+0000 7f64c6aeb700 1 -- 172.21.15.184:0/3317081455 shutdown_connections 2024-02-05T07:18:43.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.909+0000 7f64c6aeb700 1 -- 172.21.15.184:0/3317081455 wait complete. 2024-02-05T07:18:43.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.909+0000 7f64c6aeb700 1 Processor -- start 2024-02-05T07:18:43.913 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.909+0000 7f64c6aeb700 1 -- start start 2024-02-05T07:18:43.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64c6aeb700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f64c01a8bd0 con 0x7f64c0107b60 2024-02-05T07:18:43.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64c6aeb700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f64c01a9d70 con 0x7f64c010e550 2024-02-05T07:18:43.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64c6aeb700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f64c01aaf50 con 0x7f64c010a980 2024-02-05T07:18:43.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64c4887700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f64c0107b60 0x7f64c00758e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:47252/0 (socket says 172.21.15.184:47252) 2024-02-05T07:18:43.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bffff700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f64c010a980 0x7f64c01a3cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:37496/0 (socket says 172.21.15.184:37496) 2024-02-05T07:18:43.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64c4887700 1 -- 172.21.15.184:0/613382853 learned_addr learned my addr 172.21.15.184:0/613382853 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:43.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695326408 0 0) 0x7f64c01aaf50 con 0x7f64c010a980 2024-02-05T07:18:43.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64b00049e0 con 0x7f64c010a980 2024-02-05T07:18:43.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4179876656 0 0) 0x7f64c01a8bd0 con 0x7f64c0107b60 2024-02-05T07:18:43.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64c01aaf50 con 0x7f64c0107b60 2024-02-05T07:18:43.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654118921 0 0) 0x7f64c01a9d70 con 0x7f64c010e550 2024-02-05T07:18:43.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64c01a8bd0 con 0x7f64c010e550 2024-02-05T07:18:43.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2956226534 0 0) 0x7f64c01aaf50 con 0x7f64c0107b60 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f64c01a9d70 con 0x7f64c0107b60 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f64b4001870 con 0x7f64c0107b60 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3576913722 0 0) 0x7f64b00049e0 con 0x7f64c010a980 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f64c01aaf50 con 0x7f64c010a980 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f64ac0045e0 con 0x7f64c010a980 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2331358790 0 0) 0x7f64c01a8bd0 con 0x7f64c010e550 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f64b00049e0 con 0x7f64c010e550 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f64b8001470 con 0x7f64c010e550 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.910+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3107028506 0 0) 0x7f64c01a9d70 con 0x7f64c0107b60 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.911+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 >> v1:172.21.15.184:6790/0 conn(0x7f64c010a980 legacy=0x7f64c01a3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.911+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 >> v1:172.21.15.188:6789/0 conn(0x7f64c010e550 legacy=0x7f64c01a7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.911+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64c01ac170 con 0x7f64c0107b60 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.911+0000 7f64c6aeb700 1 -- 172.21.15.184:0/613382853 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64c01a8dc0 con 0x7f64c0107b60 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.911+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f64b4003b30 con 0x7f64c0107b60 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.911+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f64b4005d10 con 0x7f64c0107b60 2024-02-05T07:18:43.915 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.911+0000 7f64c6aeb700 1 -- 172.21.15.184:0/613382853 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f64c01a9240 con 0x7f64c0107b60 2024-02-05T07:18:43.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.912+0000 7f64c6aeb700 1 -- 172.21.15.184:0/613382853 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c01031d0 con 0x7f64c0107b60 2024-02-05T07:18:43.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.912+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f64b40036a0 con 0x7f64c0107b60 2024-02-05T07:18:43.916 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.913+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7f64b4088a60 con 0x7f64c0107b60 2024-02-05T07:18:43.919 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:43.917+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f64b4055d60 con 0x7f64c0107b60 2024-02-05T07:18:44.110 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:44.108+0000 7f64c6aeb700 1 -- 172.21.15.184:0/613382853 --> v1:172.21.15.184:6800/103463156 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64c0068610 con 0x7f64b006eb30 2024-02-05T07:18:44.121 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:44.119+0000 7f64bdffb700 1 -- 172.21.15.184:0/613382853 <== mgr.14610 v1:172.21.15.184:6800/103463156 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+384588 (unknown 2965378022 0 673747276) 0x7f64c0068610 con 0x7f64b006eb30 2024-02-05T07:18:44.125 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:18:44.128 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:44.123+0000 7f64c6aeb700 1 -- 172.21.15.184:0/613382853 >> v1:172.21.15.184:6800/103463156 conn(0x7f64b006eb30 legacy=0x7f64b0070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:44.128 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:44.123+0000 7f64c6aeb700 1 -- 172.21.15.184:0/613382853 >> v1:172.21.15.184:6789/0 conn(0x7f64c0107b60 legacy=0x7f64c00758e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:44.128 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:44.123+0000 7f64c6aeb700 1 -- 172.21.15.184:0/613382853 shutdown_connections 2024-02-05T07:18:44.128 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:44.123+0000 7f64c6aeb700 1 -- 172.21.15.184:0/613382853 >> 172.21.15.184:0/613382853 conn(0x7f64c00fd600 msgr2=0x7f64c01001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:44.128 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:44.124+0000 7f64c6aeb700 1 -- 172.21.15.184:0/613382853 shutdown_connections 2024-02-05T07:18:44.129 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:44.124+0000 7f64c6aeb700 1 -- 172.21.15.184:0/613382853 wait complete. 2024-02-05T07:18:44.129 INFO:teuthology.orchestra.run.smithi184.stderr:dumped all 2024-02-05T07:18:44.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:44 smithi188 ceph-mon[33283]: pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:44.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:44 smithi184 ceph-mon[29861]: pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:44.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:44 smithi184 ceph-mon[41609]: pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:44.880 INFO:teuthology.orchestra.run.smithi184.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-02-05T07:18:42.407372+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596316,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":1012,"num_read_kb":858,"num_write":615,"num_write_kb":2461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":1771434,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":600,"ondisk_log_size":600,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":244304,"kb_used_data":7356,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":749716912,"statfs":{"total":767960285184,"available":767710117888,"internally_reserved":0,"allocated":7532544,"data_stored":4022812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002772"},"pg_stats":[{"pgid":"6.1a","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387163+0000","last_change":"2024-02-05T07:17:24.306478+0000","last_active":"2024-02-05T07:17:56.387163+0000","last_peered":"2024-02-05T07:17:56.387163+0000","last_clean":"2024-02-05T07:17:56.387163+0000","last_became_active":"2024-02-05T07:17:24.305985+0000","last_became_peered":"2024-02-05T07:17:24.305985+0000","last_unstale":"2024-02-05T07:17:56.387163+0000","last_undegraded":"2024-02-05T07:17:56.387163+0000","last_fullsized":"2024-02-05T07:17:56.387163+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:00:50.626970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389547+0000","last_change":"2024-02-05T07:17:22.304640+0000","last_active":"2024-02-05T07:17:56.389547+0000","last_peered":"2024-02-05T07:17:56.389547+0000","last_clean":"2024-02-05T07:17:56.389547+0000","last_became_active":"2024-02-05T07:17:22.304340+0000","last_became_peered":"2024-02-05T07:17:22.304340+0000","last_unstale":"2024-02-05T07:17:56.389547+0000","last_undegraded":"2024-02-05T07:17:56.389547+0000","last_fullsized":"2024-02-05T07:17:56.389547+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:14:50.617495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"61'1","reported_seq":39,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193389+0000","last_change":"2024-02-05T07:17:18.283861+0000","last_active":"2024-02-05T07:17:57.193389+0000","last_peered":"2024-02-05T07:17:57.193389+0000","last_clean":"2024-02-05T07:17:57.193389+0000","last_became_active":"2024-02-05T07:17:18.283600+0000","last_became_peered":"2024-02-05T07:17:18.283600+0000","last_unstale":"2024-02-05T07:17:57.193389+0000","last_undegraded":"2024-02-05T07:17:57.193389+0000","last_fullsized":"2024-02-05T07:17:57.193389+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:09:34.840824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"68'9","reported_seq":61,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.386895+0000","last_change":"2024-02-05T07:17:46.496913+0000","last_active":"2024-02-05T07:17:56.386895+0000","last_peered":"2024-02-05T07:17:56.386895+0000","last_clean":"2024-02-05T07:17:56.386895+0000","last_became_active":"2024-02-05T07:17:46.492079+0000","last_became_peered":"2024-02-05T07:17:46.492079+0000","last_unstale":"2024-02-05T07:17:56.386895+0000","last_undegraded":"2024-02-05T07:17:56.386895+0000","last_fullsized":"2024-02-05T07:17:56.386895+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:29:18.384468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194585+0000","last_change":"2024-02-05T07:17:24.315755+0000","last_active":"2024-02-05T07:17:57.194585+0000","last_peered":"2024-02-05T07:17:57.194585+0000","last_clean":"2024-02-05T07:17:57.194585+0000","last_became_active":"2024-02-05T07:17:24.314925+0000","last_became_peered":"2024-02-05T07:17:24.314925+0000","last_unstale":"2024-02-05T07:17:57.194585+0000","last_undegraded":"2024-02-05T07:17:57.194585+0000","last_fullsized":"2024-02-05T07:17:57.194585+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:04:30.869275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.386898+0000","last_change":"2024-02-05T07:17:22.294838+0000","last_active":"2024-02-05T07:17:56.386898+0000","last_peered":"2024-02-05T07:17:56.386898+0000","last_clean":"2024-02-05T07:17:56.386898+0000","last_became_active":"2024-02-05T07:17:22.294515+0000","last_became_peered":"2024-02-05T07:17:22.294515+0000","last_unstale":"2024-02-05T07:17:56.386898+0000","last_undegraded":"2024-02-05T07:17:56.386898+0000","last_fullsized":"2024-02-05T07:17:56.386898+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:56:37.476629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194901+0000","last_change":"2024-02-05T07:17:18.279492+0000","last_active":"2024-02-05T07:17:57.194901+0000","last_peered":"2024-02-05T07:17:57.194901+0000","last_clean":"2024-02-05T07:17:57.194901+0000","last_became_active":"2024-02-05T07:17:18.279192+0000","last_became_peered":"2024-02-05T07:17:18.279192+0000","last_unstale":"2024-02-05T07:17:57.194901+0000","last_undegraded":"2024-02-05T07:17:57.194901+0000","last_fullsized":"2024-02-05T07:17:57.194901+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T09:20:45.496212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"68'15","reported_seq":54,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194009+0000","last_change":"2024-02-05T07:17:20.295512+0000","last_active":"2024-02-05T07:17:57.194009+0000","last_peered":"2024-02-05T07:17:57.194009+0000","last_clean":"2024-02-05T07:17:57.194009+0000","last_became_active":"2024-02-05T07:17:20.295246+0000","last_became_peered":"2024-02-05T07:17:20.295246+0000","last_unstale":"2024-02-05T07:17:57.194009+0000","last_undegraded":"2024-02-05T07:17:57.194009+0000","last_fullsized":"2024-02-05T07:17:57.194009+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:40:08.765931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192978+0000","last_change":"2024-02-05T07:17:24.302001+0000","last_active":"2024-02-05T07:17:57.192978+0000","last_peered":"2024-02-05T07:17:57.192978+0000","last_clean":"2024-02-05T07:17:57.192978+0000","last_became_active":"2024-02-05T07:17:24.301659+0000","last_became_peered":"2024-02-05T07:17:24.301659+0000","last_unstale":"2024-02-05T07:17:57.192978+0000","last_undegraded":"2024-02-05T07:17:57.192978+0000","last_fullsized":"2024-02-05T07:17:57.192978+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:47:22.825251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481576+0000","last_change":"2024-02-05T07:17:22.301326+0000","last_active":"2024-02-05T07:17:56.481576+0000","last_peered":"2024-02-05T07:17:56.481576+0000","last_clean":"2024-02-05T07:17:56.481576+0000","last_became_active":"2024-02-05T07:17:22.300404+0000","last_became_peered":"2024-02-05T07:17:22.300404+0000","last_unstale":"2024-02-05T07:17:56.481576+0000","last_undegraded":"2024-02-05T07:17:56.481576+0000","last_fullsized":"2024-02-05T07:17:56.481576+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:30:22.643579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481875+0000","last_change":"2024-02-05T07:17:18.280018+0000","last_active":"2024-02-05T07:17:56.481875+0000","last_peered":"2024-02-05T07:17:56.481875+0000","last_clean":"2024-02-05T07:17:56.481875+0000","last_became_active":"2024-02-05T07:17:18.279262+0000","last_became_peered":"2024-02-05T07:17:18.279262+0000","last_unstale":"2024-02-05T07:17:56.481875+0000","last_undegraded":"2024-02-05T07:17:56.481875+0000","last_fullsized":"2024-02-05T07:17:56.481875+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T18:47:28.659570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"68'9","reported_seq":45,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387579+0000","last_change":"2024-02-05T07:17:20.293491+0000","last_active":"2024-02-05T07:17:56.387579+0000","last_peered":"2024-02-05T07:17:56.387579+0000","last_clean":"2024-02-05T07:17:56.387579+0000","last_became_active":"2024-02-05T07:17:20.293212+0000","last_became_peered":"2024-02-05T07:17:20.293212+0000","last_unstale":"2024-02-05T07:17:56.387579+0000","last_undegraded":"2024-02-05T07:17:56.387579+0000","last_fullsized":"2024-02-05T07:17:56.387579+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:44:11.093107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481341+0000","last_change":"2024-02-05T07:17:24.304191+0000","last_active":"2024-02-05T07:17:56.481341+0000","last_peered":"2024-02-05T07:17:56.481341+0000","last_clean":"2024-02-05T07:17:56.481341+0000","last_became_active":"2024-02-05T07:17:24.303936+0000","last_became_peered":"2024-02-05T07:17:24.303936+0000","last_unstale":"2024-02-05T07:17:56.481341+0000","last_undegraded":"2024-02-05T07:17:56.481341+0000","last_fullsized":"2024-02-05T07:17:56.481341+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:17:50.501406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.429962+0000","last_change":"2024-02-05T07:17:22.298363+0000","last_active":"2024-02-05T07:17:56.429962+0000","last_peered":"2024-02-05T07:17:56.429962+0000","last_clean":"2024-02-05T07:17:56.429962+0000","last_became_active":"2024-02-05T07:17:22.298076+0000","last_became_peered":"2024-02-05T07:17:22.298076+0000","last_unstale":"2024-02-05T07:17:56.429962+0000","last_undegraded":"2024-02-05T07:17:56.429962+0000","last_fullsized":"2024-02-05T07:17:56.429962+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:32:14.863310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"61'1","reported_seq":39,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481777+0000","last_change":"2024-02-05T07:17:18.276215+0000","last_active":"2024-02-05T07:17:56.481777+0000","last_peered":"2024-02-05T07:17:56.481777+0000","last_clean":"2024-02-05T07:17:56.481777+0000","last_became_active":"2024-02-05T07:17:18.275799+0000","last_became_peered":"2024-02-05T07:17:18.275799+0000","last_unstale":"2024-02-05T07:17:56.481777+0000","last_undegraded":"2024-02-05T07:17:56.481777+0000","last_fullsized":"2024-02-05T07:17:56.481777+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:52:00.365305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"68'5","reported_seq":39,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387272+0000","last_change":"2024-02-05T07:17:20.290731+0000","last_active":"2024-02-05T07:17:56.387272+0000","last_peered":"2024-02-05T07:17:56.387272+0000","last_clean":"2024-02-05T07:17:56.387272+0000","last_became_active":"2024-02-05T07:17:20.290362+0000","last_became_peered":"2024-02-05T07:17:20.290362+0000","last_unstale":"2024-02-05T07:17:56.387272+0000","last_undegraded":"2024-02-05T07:17:56.387272+0000","last_fullsized":"2024-02-05T07:17:56.387272+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:32:49.412626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388775+0000","last_change":"2024-02-05T07:17:24.314824+0000","last_active":"2024-02-05T07:17:56.388775+0000","last_peered":"2024-02-05T07:17:56.388775+0000","last_clean":"2024-02-05T07:17:56.388775+0000","last_became_active":"2024-02-05T07:17:24.314250+0000","last_became_peered":"2024-02-05T07:17:24.314250+0000","last_unstale":"2024-02-05T07:17:56.388775+0000","last_undegraded":"2024-02-05T07:17:56.388775+0000","last_fullsized":"2024-02-05T07:17:56.388775+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:47:23.574823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388496+0000","last_change":"2024-02-05T07:17:22.297343+0000","last_active":"2024-02-05T07:17:56.388496+0000","last_peered":"2024-02-05T07:17:56.388496+0000","last_clean":"2024-02-05T07:17:56.388496+0000","last_became_active":"2024-02-05T07:17:22.297053+0000","last_became_peered":"2024-02-05T07:17:22.297053+0000","last_unstale":"2024-02-05T07:17:56.388496+0000","last_undegraded":"2024-02-05T07:17:56.388496+0000","last_fullsized":"2024-02-05T07:17:56.388496+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:39:28.800774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193424+0000","last_change":"2024-02-05T07:17:18.286244+0000","last_active":"2024-02-05T07:17:57.193424+0000","last_peered":"2024-02-05T07:17:57.193424+0000","last_clean":"2024-02-05T07:17:57.193424+0000","last_became_active":"2024-02-05T07:17:18.285815+0000","last_became_peered":"2024-02-05T07:17:18.285815+0000","last_unstale":"2024-02-05T07:17:57.193424+0000","last_undegraded":"2024-02-05T07:17:57.193424+0000","last_fullsized":"2024-02-05T07:17:57.193424+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:59:55.795328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"68'15","reported_seq":54,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.390264+0000","last_change":"2024-02-05T07:17:20.293813+0000","last_active":"2024-02-05T07:17:56.390264+0000","last_peered":"2024-02-05T07:17:56.390264+0000","last_clean":"2024-02-05T07:17:56.390264+0000","last_became_active":"2024-02-05T07:17:20.293485+0000","last_became_peered":"2024-02-05T07:17:20.293485+0000","last_unstale":"2024-02-05T07:17:56.390264+0000","last_undegraded":"2024-02-05T07:17:56.390264+0000","last_fullsized":"2024-02-05T07:17:56.390264+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T18:19:32.225679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.195001+0000","last_change":"2024-02-05T07:17:24.314980+0000","last_active":"2024-02-05T07:17:57.195001+0000","last_peered":"2024-02-05T07:17:57.195001+0000","last_clean":"2024-02-05T07:17:57.195001+0000","last_became_active":"2024-02-05T07:17:24.314655+0000","last_became_peered":"2024-02-05T07:17:24.314655+0000","last_unstale":"2024-02-05T07:17:57.195001+0000","last_undegraded":"2024-02-05T07:17:57.195001+0000","last_fullsized":"2024-02-05T07:17:57.195001+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:51:47.167883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387216+0000","last_change":"2024-02-05T07:17:22.297048+0000","last_active":"2024-02-05T07:17:56.387216+0000","last_peered":"2024-02-05T07:17:56.387216+0000","last_clean":"2024-02-05T07:17:56.387216+0000","last_became_active":"2024-02-05T07:17:22.296731+0000","last_became_peered":"2024-02-05T07:17:22.296731+0000","last_unstale":"2024-02-05T07:17:56.387216+0000","last_undegraded":"2024-02-05T07:17:56.387216+0000","last_fullsized":"2024-02-05T07:17:56.387216+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:13:22.849034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387688+0000","last_change":"2024-02-05T07:17:18.282575+0000","last_active":"2024-02-05T07:17:56.387688+0000","last_peered":"2024-02-05T07:17:56.387688+0000","last_clean":"2024-02-05T07:17:56.387688+0000","last_became_active":"2024-02-05T07:17:18.282138+0000","last_became_peered":"2024-02-05T07:17:18.282138+0000","last_unstale":"2024-02-05T07:17:56.387688+0000","last_undegraded":"2024-02-05T07:17:56.387688+0000","last_fullsized":"2024-02-05T07:17:56.387688+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:18:54.525107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"68'12","reported_seq":52,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194327+0000","last_change":"2024-02-05T07:17:20.293938+0000","last_active":"2024-02-05T07:17:57.194327+0000","last_peered":"2024-02-05T07:17:57.194327+0000","last_clean":"2024-02-05T07:17:57.194327+0000","last_became_active":"2024-02-05T07:17:20.293659+0000","last_became_peered":"2024-02-05T07:17:20.293659+0000","last_unstale":"2024-02-05T07:17:57.194327+0000","last_undegraded":"2024-02-05T07:17:57.194327+0000","last_fullsized":"2024-02-05T07:17:57.194327+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:44:12.213483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"68'1","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430195+0000","last_change":"2024-02-05T07:17:24.312709+0000","last_active":"2024-02-05T07:17:56.430195+0000","last_peered":"2024-02-05T07:17:56.430195+0000","last_clean":"2024-02-05T07:17:56.430195+0000","last_became_active":"2024-02-05T07:17:24.312348+0000","last_became_peered":"2024-02-05T07:17:24.312348+0000","last_unstale":"2024-02-05T07:17:56.430195+0000","last_undegraded":"2024-02-05T07:17:56.430195+0000","last_fullsized":"2024-02-05T07:17:56.430195+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:21:11.522895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"68'8","reported_seq":53,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:33.334518+0000","last_change":"2024-02-05T07:17:22.302691+0000","last_active":"2024-02-05T07:18:33.334518+0000","last_peered":"2024-02-05T07:18:33.334518+0000","last_clean":"2024-02-05T07:18:33.334518+0000","last_became_active":"2024-02-05T07:17:22.302372+0000","last_became_peered":"2024-02-05T07:17:22.302372+0000","last_unstale":"2024-02-05T07:18:33.334518+0000","last_undegraded":"2024-02-05T07:18:33.334518+0000","last_fullsized":"2024-02-05T07:18:33.334518+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:17:52.575941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"61'1","reported_seq":34,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389621+0000","last_change":"2024-02-05T07:17:18.277364+0000","last_active":"2024-02-05T07:17:56.389621+0000","last_peered":"2024-02-05T07:17:56.389621+0000","last_clean":"2024-02-05T07:17:56.389621+0000","last_became_active":"2024-02-05T07:17:18.276980+0000","last_became_peered":"2024-02-05T07:17:18.276980+0000","last_unstale":"2024-02-05T07:17:56.389621+0000","last_undegraded":"2024-02-05T07:17:56.389621+0000","last_fullsized":"2024-02-05T07:17:56.389621+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:54:40.778718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"68'10","reported_seq":44,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194078+0000","last_change":"2024-02-05T07:17:20.351797+0000","last_active":"2024-02-05T07:17:57.194078+0000","last_peered":"2024-02-05T07:17:57.194078+0000","last_clean":"2024-02-05T07:17:57.194078+0000","last_became_active":"2024-02-05T07:17:20.351378+0000","last_became_peered":"2024-02-05T07:17:20.351378+0000","last_unstale":"2024-02-05T07:17:57.194078+0000","last_undegraded":"2024-02-05T07:17:57.194078+0000","last_fullsized":"2024-02-05T07:17:57.194078+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:56:14.194292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388153+0000","last_change":"2024-02-05T07:17:24.307391+0000","last_active":"2024-02-05T07:17:56.388153+0000","last_peered":"2024-02-05T07:17:56.388153+0000","last_clean":"2024-02-05T07:17:56.388153+0000","last_became_active":"2024-02-05T07:17:24.306720+0000","last_became_peered":"2024-02-05T07:17:24.306720+0000","last_unstale":"2024-02-05T07:17:56.388153+0000","last_undegraded":"2024-02-05T07:17:56.388153+0000","last_fullsized":"2024-02-05T07:17:56.388153+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:02:43.992849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194286+0000","last_change":"2024-02-05T07:17:22.303924+0000","last_active":"2024-02-05T07:17:57.194286+0000","last_peered":"2024-02-05T07:17:57.194286+0000","last_clean":"2024-02-05T07:17:57.194286+0000","last_became_active":"2024-02-05T07:17:22.303315+0000","last_became_peered":"2024-02-05T07:17:22.303315+0000","last_unstale":"2024-02-05T07:17:57.194286+0000","last_undegraded":"2024-02-05T07:17:57.194286+0000","last_fullsized":"2024-02-05T07:17:57.194286+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:59:49.071650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193241+0000","last_change":"2024-02-05T07:17:18.282796+0000","last_active":"2024-02-05T07:17:57.193241+0000","last_peered":"2024-02-05T07:17:57.193241+0000","last_clean":"2024-02-05T07:17:57.193241+0000","last_became_active":"2024-02-05T07:17:18.282533+0000","last_became_peered":"2024-02-05T07:17:18.282533+0000","last_unstale":"2024-02-05T07:17:57.193241+0000","last_undegraded":"2024-02-05T07:17:57.193241+0000","last_fullsized":"2024-02-05T07:17:57.193241+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:39:56.293780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"68'11","reported_seq":48,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193395+0000","last_change":"2024-02-05T07:17:20.288590+0000","last_active":"2024-02-05T07:17:57.193395+0000","last_peered":"2024-02-05T07:17:57.193395+0000","last_clean":"2024-02-05T07:17:57.193395+0000","last_became_active":"2024-02-05T07:17:20.288267+0000","last_became_peered":"2024-02-05T07:17:20.288267+0000","last_unstale":"2024-02-05T07:17:57.193395+0000","last_undegraded":"2024-02-05T07:17:57.193395+0000","last_fullsized":"2024-02-05T07:17:57.193395+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:25:37.842800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.429854+0000","last_change":"2024-02-05T07:17:24.310019+0000","last_active":"2024-02-05T07:17:56.429854+0000","last_peered":"2024-02-05T07:17:56.429854+0000","last_clean":"2024-02-05T07:17:56.429854+0000","last_became_active":"2024-02-05T07:17:24.309728+0000","last_became_peered":"2024-02-05T07:17:24.309728+0000","last_unstale":"2024-02-05T07:17:56.429854+0000","last_undegraded":"2024-02-05T07:17:56.429854+0000","last_fullsized":"2024-02-05T07:17:56.429854+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:58:07.383015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192721+0000","last_change":"2024-02-05T07:17:22.304817+0000","last_active":"2024-02-05T07:17:57.192721+0000","last_peered":"2024-02-05T07:17:57.192721+0000","last_clean":"2024-02-05T07:17:57.192721+0000","last_became_active":"2024-02-05T07:17:22.304507+0000","last_became_peered":"2024-02-05T07:17:22.304507+0000","last_unstale":"2024-02-05T07:17:57.192721+0000","last_undegraded":"2024-02-05T07:17:57.192721+0000","last_fullsized":"2024-02-05T07:17:57.192721+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:02:25.406918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193273+0000","last_change":"2024-02-05T07:17:18.283702+0000","last_active":"2024-02-05T07:17:57.193273+0000","last_peered":"2024-02-05T07:17:57.193273+0000","last_clean":"2024-02-05T07:17:57.193273+0000","last_became_active":"2024-02-05T07:17:18.282831+0000","last_became_peered":"2024-02-05T07:17:18.282831+0000","last_unstale":"2024-02-05T07:17:57.193273+0000","last_undegraded":"2024-02-05T07:17:57.193273+0000","last_fullsized":"2024-02-05T07:17:57.193273+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:53:09.477445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"68'4","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193332+0000","last_change":"2024-02-05T07:17:20.294459+0000","last_active":"2024-02-05T07:17:57.193332+0000","last_peered":"2024-02-05T07:17:57.193332+0000","last_clean":"2024-02-05T07:17:57.193332+0000","last_became_active":"2024-02-05T07:17:20.293704+0000","last_became_peered":"2024-02-05T07:17:20.293704+0000","last_unstale":"2024-02-05T07:17:57.193332+0000","last_undegraded":"2024-02-05T07:17:57.193332+0000","last_fullsized":"2024-02-05T07:17:57.193332+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:01:13.788106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194398+0000","last_change":"2024-02-05T07:17:24.315261+0000","last_active":"2024-02-05T07:17:57.194398+0000","last_peered":"2024-02-05T07:17:57.194398+0000","last_clean":"2024-02-05T07:17:57.194398+0000","last_became_active":"2024-02-05T07:17:24.314494+0000","last_became_peered":"2024-02-05T07:17:24.314494+0000","last_unstale":"2024-02-05T07:17:57.194398+0000","last_undegraded":"2024-02-05T07:17:57.194398+0000","last_fullsized":"2024-02-05T07:17:57.194398+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:55:14.395110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430009+0000","last_change":"2024-02-05T07:17:22.299891+0000","last_active":"2024-02-05T07:17:56.430009+0000","last_peered":"2024-02-05T07:17:56.430009+0000","last_clean":"2024-02-05T07:17:56.430009+0000","last_became_active":"2024-02-05T07:17:22.299559+0000","last_became_peered":"2024-02-05T07:17:22.299559+0000","last_unstale":"2024-02-05T07:17:56.430009+0000","last_undegraded":"2024-02-05T07:17:56.430009+0000","last_fullsized":"2024-02-05T07:17:56.430009+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:01:30.056714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.482004+0000","last_change":"2024-02-05T07:17:18.281788+0000","last_active":"2024-02-05T07:17:56.482004+0000","last_peered":"2024-02-05T07:17:56.482004+0000","last_clean":"2024-02-05T07:17:56.482004+0000","last_became_active":"2024-02-05T07:17:18.279308+0000","last_became_peered":"2024-02-05T07:17:18.279308+0000","last_unstale":"2024-02-05T07:17:56.482004+0000","last_undegraded":"2024-02-05T07:17:56.482004+0000","last_fullsized":"2024-02-05T07:17:56.482004+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:32:24.076872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"68'11","reported_seq":48,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193797+0000","last_change":"2024-02-05T07:17:20.352075+0000","last_active":"2024-02-05T07:17:57.193797+0000","last_peered":"2024-02-05T07:17:57.193797+0000","last_clean":"2024-02-05T07:17:57.193797+0000","last_became_active":"2024-02-05T07:17:20.351792+0000","last_became_peered":"2024-02-05T07:17:20.351792+0000","last_unstale":"2024-02-05T07:17:57.193797+0000","last_undegraded":"2024-02-05T07:17:57.193797+0000","last_fullsized":"2024-02-05T07:17:57.193797+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T18:48:18.529452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192692+0000","last_change":"2024-02-05T07:17:24.303246+0000","last_active":"2024-02-05T07:17:57.192692+0000","last_peered":"2024-02-05T07:17:57.192692+0000","last_clean":"2024-02-05T07:17:57.192692+0000","last_became_active":"2024-02-05T07:17:24.302926+0000","last_became_peered":"2024-02-05T07:17:24.302926+0000","last_unstale":"2024-02-05T07:17:57.192692+0000","last_undegraded":"2024-02-05T07:17:57.192692+0000","last_fullsized":"2024-02-05T07:17:57.192692+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:51:40.454724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194678+0000","last_change":"2024-02-05T07:17:22.300576+0000","last_active":"2024-02-05T07:17:57.194678+0000","last_peered":"2024-02-05T07:17:57.194678+0000","last_clean":"2024-02-05T07:17:57.194678+0000","last_became_active":"2024-02-05T07:17:22.300002+0000","last_became_peered":"2024-02-05T07:17:22.300002+0000","last_unstale":"2024-02-05T07:17:57.194678+0000","last_undegraded":"2024-02-05T07:17:57.194678+0000","last_fullsized":"2024-02-05T07:17:57.194678+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:19:58.854801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430244+0000","last_change":"2024-02-05T07:17:18.284733+0000","last_active":"2024-02-05T07:17:56.430244+0000","last_peered":"2024-02-05T07:17:56.430244+0000","last_clean":"2024-02-05T07:17:56.430244+0000","last_became_active":"2024-02-05T07:17:18.283946+0000","last_became_peered":"2024-02-05T07:17:18.283946+0000","last_unstale":"2024-02-05T07:17:56.430244+0000","last_undegraded":"2024-02-05T07:17:56.430244+0000","last_fullsized":"2024-02-05T07:17:56.430244+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:19:05.818581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"68'9","reported_seq":45,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388769+0000","last_change":"2024-02-05T07:17:20.294373+0000","last_active":"2024-02-05T07:17:56.388769+0000","last_peered":"2024-02-05T07:17:56.388769+0000","last_clean":"2024-02-05T07:17:56.388769+0000","last_became_active":"2024-02-05T07:17:20.294098+0000","last_became_peered":"2024-02-05T07:17:20.294098+0000","last_unstale":"2024-02-05T07:17:56.388769+0000","last_undegraded":"2024-02-05T07:17:56.388769+0000","last_fullsized":"2024-02-05T07:17:56.388769+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:49:15.846839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193378+0000","last_change":"2024-02-05T07:17:24.310050+0000","last_active":"2024-02-05T07:17:57.193378+0000","last_peered":"2024-02-05T07:17:57.193378+0000","last_clean":"2024-02-05T07:17:57.193378+0000","last_became_active":"2024-02-05T07:17:24.309694+0000","last_became_peered":"2024-02-05T07:17:24.309694+0000","last_unstale":"2024-02-05T07:17:57.193378+0000","last_undegraded":"2024-02-05T07:17:57.193378+0000","last_fullsized":"2024-02-05T07:17:57.193378+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:48:22.983843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388560+0000","last_change":"2024-02-05T07:17:22.301278+0000","last_active":"2024-02-05T07:17:56.388560+0000","last_peered":"2024-02-05T07:17:56.388560+0000","last_clean":"2024-02-05T07:17:56.388560+0000","last_became_active":"2024-02-05T07:17:22.300935+0000","last_became_peered":"2024-02-05T07:17:22.300935+0000","last_unstale":"2024-02-05T07:17:56.388560+0000","last_undegraded":"2024-02-05T07:17:56.388560+0000","last_fullsized":"2024-02-05T07:17:56.388560+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:54:43.862444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387472+0000","last_change":"2024-02-05T07:17:18.285057+0000","last_active":"2024-02-05T07:17:56.387472+0000","last_peered":"2024-02-05T07:17:56.387472+0000","last_clean":"2024-02-05T07:17:56.387472+0000","last_became_active":"2024-02-05T07:17:18.284775+0000","last_became_peered":"2024-02-05T07:17:18.284775+0000","last_unstale":"2024-02-05T07:17:56.387472+0000","last_undegraded":"2024-02-05T07:17:56.387472+0000","last_fullsized":"2024-02-05T07:17:56.387472+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:30:07.132043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"68'11","reported_seq":48,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387222+0000","last_change":"2024-02-05T07:17:20.287540+0000","last_active":"2024-02-05T07:17:56.387222+0000","last_peered":"2024-02-05T07:17:56.387222+0000","last_clean":"2024-02-05T07:17:56.387222+0000","last_became_active":"2024-02-05T07:17:20.287243+0000","last_became_peered":"2024-02-05T07:17:20.287243+0000","last_unstale":"2024-02-05T07:17:56.387222+0000","last_undegraded":"2024-02-05T07:17:56.387222+0000","last_fullsized":"2024-02-05T07:17:56.387222+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:26:01.221883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193208+0000","last_change":"2024-02-05T07:17:24.313181+0000","last_active":"2024-02-05T07:17:57.193208+0000","last_peered":"2024-02-05T07:17:57.193208+0000","last_clean":"2024-02-05T07:17:57.193208+0000","last_became_active":"2024-02-05T07:17:24.312815+0000","last_became_peered":"2024-02-05T07:17:24.312815+0000","last_unstale":"2024-02-05T07:17:57.193208+0000","last_undegraded":"2024-02-05T07:17:57.193208+0000","last_fullsized":"2024-02-05T07:17:57.193208+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:18:15.404548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"68'8","reported_seq":50,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:33.334562+0000","last_change":"2024-02-05T07:17:22.299245+0000","last_active":"2024-02-05T07:18:33.334562+0000","last_peered":"2024-02-05T07:18:33.334562+0000","last_clean":"2024-02-05T07:18:33.334562+0000","last_became_active":"2024-02-05T07:17:22.298901+0000","last_became_peered":"2024-02-05T07:17:22.298901+0000","last_unstale":"2024-02-05T07:18:33.334562+0000","last_undegraded":"2024-02-05T07:18:33.334562+0000","last_fullsized":"2024-02-05T07:18:33.334562+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:38:25.680101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430085+0000","last_change":"2024-02-05T07:17:18.284639+0000","last_active":"2024-02-05T07:17:56.430085+0000","last_peered":"2024-02-05T07:17:56.430085+0000","last_clean":"2024-02-05T07:17:56.430085+0000","last_became_active":"2024-02-05T07:17:18.284362+0000","last_became_peered":"2024-02-05T07:17:18.284362+0000","last_unstale":"2024-02-05T07:17:56.430085+0000","last_undegraded":"2024-02-05T07:17:56.430085+0000","last_fullsized":"2024-02-05T07:17:56.430085+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:16:37.058264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"68'10","reported_seq":44,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193696+0000","last_change":"2024-02-05T07:17:20.351558+0000","last_active":"2024-02-05T07:17:57.193696+0000","last_peered":"2024-02-05T07:17:57.193696+0000","last_clean":"2024-02-05T07:17:57.193696+0000","last_became_active":"2024-02-05T07:17:20.351282+0000","last_became_peered":"2024-02-05T07:17:20.351282+0000","last_unstale":"2024-02-05T07:17:57.193696+0000","last_undegraded":"2024-02-05T07:17:57.193696+0000","last_fullsized":"2024-02-05T07:17:57.193696+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:54:39.199280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388225+0000","last_change":"2024-02-05T07:17:24.309287+0000","last_active":"2024-02-05T07:17:56.388225+0000","last_peered":"2024-02-05T07:17:56.388225+0000","last_clean":"2024-02-05T07:17:56.388225+0000","last_became_active":"2024-02-05T07:17:24.309006+0000","last_became_peered":"2024-02-05T07:17:24.309006+0000","last_unstale":"2024-02-05T07:17:56.388225+0000","last_undegraded":"2024-02-05T07:17:56.388225+0000","last_fullsized":"2024-02-05T07:17:56.388225+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:23:54.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"68'8","reported_seq":53,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:33.334813+0000","last_change":"2024-02-05T07:17:22.301348+0000","last_active":"2024-02-05T07:18:33.334813+0000","last_peered":"2024-02-05T07:18:33.334813+0000","last_clean":"2024-02-05T07:18:33.334813+0000","last_became_active":"2024-02-05T07:17:22.301023+0000","last_became_peered":"2024-02-05T07:17:22.301023+0000","last_unstale":"2024-02-05T07:18:33.334813+0000","last_undegraded":"2024-02-05T07:18:33.334813+0000","last_fullsized":"2024-02-05T07:18:33.334813+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:29:38.330165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192952+0000","last_change":"2024-02-05T07:17:18.283169+0000","last_active":"2024-02-05T07:17:57.192952+0000","last_peered":"2024-02-05T07:17:57.192952+0000","last_clean":"2024-02-05T07:17:57.192952+0000","last_became_active":"2024-02-05T07:17:18.282786+0000","last_became_peered":"2024-02-05T07:17:18.282786+0000","last_unstale":"2024-02-05T07:17:57.192952+0000","last_undegraded":"2024-02-05T07:17:57.192952+0000","last_fullsized":"2024-02-05T07:17:57.192952+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:51:37.157602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"68'9","reported_seq":45,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.482070+0000","last_change":"2024-02-05T07:17:20.351856+0000","last_active":"2024-02-05T07:17:56.482070+0000","last_peered":"2024-02-05T07:17:56.482070+0000","last_clean":"2024-02-05T07:17:56.482070+0000","last_became_active":"2024-02-05T07:17:20.351550+0000","last_became_peered":"2024-02-05T07:17:20.351550+0000","last_unstale":"2024-02-05T07:17:56.482070+0000","last_undegraded":"2024-02-05T07:17:56.482070+0000","last_fullsized":"2024-02-05T07:17:56.482070+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:53:55.600488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.390575+0000","last_change":"2024-02-05T07:17:24.310394+0000","last_active":"2024-02-05T07:17:56.390575+0000","last_peered":"2024-02-05T07:17:56.390575+0000","last_clean":"2024-02-05T07:17:56.390575+0000","last_became_active":"2024-02-05T07:17:24.309264+0000","last_became_peered":"2024-02-05T07:17:24.309264+0000","last_unstale":"2024-02-05T07:17:56.390575+0000","last_undegraded":"2024-02-05T07:17:56.390575+0000","last_fullsized":"2024-02-05T07:17:56.390575+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T09:14:38.679802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.195188+0000","last_change":"2024-02-05T07:17:22.300384+0000","last_active":"2024-02-05T07:17:57.195188+0000","last_peered":"2024-02-05T07:17:57.195188+0000","last_clean":"2024-02-05T07:17:57.195188+0000","last_became_active":"2024-02-05T07:17:22.300069+0000","last_became_peered":"2024-02-05T07:17:22.300069+0000","last_unstale":"2024-02-05T07:17:57.195188+0000","last_undegraded":"2024-02-05T07:17:57.195188+0000","last_fullsized":"2024-02-05T07:17:57.195188+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:55:38.595092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.429923+0000","last_change":"2024-02-05T07:17:18.284841+0000","last_active":"2024-02-05T07:17:56.429923+0000","last_peered":"2024-02-05T07:17:56.429923+0000","last_clean":"2024-02-05T07:17:56.429923+0000","last_became_active":"2024-02-05T07:17:18.283993+0000","last_became_peered":"2024-02-05T07:17:18.283993+0000","last_unstale":"2024-02-05T07:17:56.429923+0000","last_undegraded":"2024-02-05T07:17:56.429923+0000","last_fullsized":"2024-02-05T07:17:56.429923+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:09:32.666577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"68'9","reported_seq":45,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194208+0000","last_change":"2024-02-05T07:17:20.352186+0000","last_active":"2024-02-05T07:17:57.194208+0000","last_peered":"2024-02-05T07:17:57.194208+0000","last_clean":"2024-02-05T07:17:57.194208+0000","last_became_active":"2024-02-05T07:17:20.351726+0000","last_became_peered":"2024-02-05T07:17:20.351726+0000","last_unstale":"2024-02-05T07:17:57.194208+0000","last_undegraded":"2024-02-05T07:17:57.194208+0000","last_fullsized":"2024-02-05T07:17:57.194208+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:40:19.483725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430215+0000","last_change":"2024-02-05T07:17:24.314449+0000","last_active":"2024-02-05T07:17:56.430215+0000","last_peered":"2024-02-05T07:17:56.430215+0000","last_clean":"2024-02-05T07:17:56.430215+0000","last_became_active":"2024-02-05T07:17:24.314169+0000","last_became_peered":"2024-02-05T07:17:24.314169+0000","last_unstale":"2024-02-05T07:17:56.430215+0000","last_undegraded":"2024-02-05T07:17:56.430215+0000","last_fullsized":"2024-02-05T07:17:56.430215+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:50:55.155116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.482075+0000","last_change":"2024-02-05T07:17:22.304455+0000","last_active":"2024-02-05T07:17:56.482075+0000","last_peered":"2024-02-05T07:17:56.482075+0000","last_clean":"2024-02-05T07:17:56.482075+0000","last_became_active":"2024-02-05T07:17:22.301041+0000","last_became_peered":"2024-02-05T07:17:22.301041+0000","last_unstale":"2024-02-05T07:17:56.482075+0000","last_undegraded":"2024-02-05T07:17:56.482075+0000","last_fullsized":"2024-02-05T07:17:56.482075+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:52:18.005230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192758+0000","last_change":"2024-02-05T07:17:18.282468+0000","last_active":"2024-02-05T07:17:57.192758+0000","last_peered":"2024-02-05T07:17:57.192758+0000","last_clean":"2024-02-05T07:17:57.192758+0000","last_became_active":"2024-02-05T07:17:18.282200+0000","last_became_peered":"2024-02-05T07:17:18.282200+0000","last_unstale":"2024-02-05T07:17:57.192758+0000","last_undegraded":"2024-02-05T07:17:57.192758+0000","last_fullsized":"2024-02-05T07:17:57.192758+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T09:50:02.876019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"68'6","reported_seq":38,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.195247+0000","last_change":"2024-02-05T07:17:20.352217+0000","last_active":"2024-02-05T07:17:57.195247+0000","last_peered":"2024-02-05T07:17:57.195247+0000","last_clean":"2024-02-05T07:17:57.195247+0000","last_became_active":"2024-02-05T07:17:20.351501+0000","last_became_peered":"2024-02-05T07:17:20.351501+0000","last_unstale":"2024-02-05T07:17:57.195247+0000","last_undegraded":"2024-02-05T07:17:57.195247+0000","last_fullsized":"2024-02-05T07:17:57.195247+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:26:21.526363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481679+0000","last_change":"2024-02-05T07:17:24.314522+0000","last_active":"2024-02-05T07:17:56.481679+0000","last_peered":"2024-02-05T07:17:56.481679+0000","last_clean":"2024-02-05T07:17:56.481679+0000","last_became_active":"2024-02-05T07:17:24.314190+0000","last_became_peered":"2024-02-05T07:17:24.314190+0000","last_unstale":"2024-02-05T07:17:56.481679+0000","last_undegraded":"2024-02-05T07:17:56.481679+0000","last_fullsized":"2024-02-05T07:17:56.481679+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:41:24.699343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"61'2","reported_seq":45,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430574+0000","last_change":"2024-02-05T07:17:18.285647+0000","last_active":"2024-02-05T07:17:56.430574+0000","last_peered":"2024-02-05T07:17:56.430574+0000","last_clean":"2024-02-05T07:17:56.430574+0000","last_became_active":"2024-02-05T07:17:18.284332+0000","last_became_peered":"2024-02-05T07:17:18.284332+0000","last_unstale":"2024-02-05T07:17:56.430574+0000","last_undegraded":"2024-02-05T07:17:56.430574+0000","last_fullsized":"2024-02-05T07:17:56.430574+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:13:01.326717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"68'15","reported_seq":54,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481376+0000","last_change":"2024-02-05T07:17:20.351773+0000","last_active":"2024-02-05T07:17:56.481376+0000","last_peered":"2024-02-05T07:17:56.481376+0000","last_clean":"2024-02-05T07:17:56.481376+0000","last_became_active":"2024-02-05T07:17:20.351413+0000","last_became_peered":"2024-02-05T07:17:20.351413+0000","last_unstale":"2024-02-05T07:17:56.481376+0000","last_undegraded":"2024-02-05T07:17:56.481376+0000","last_fullsized":"2024-02-05T07:17:56.481376+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:54:21.716606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"68'8","reported_seq":50,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:33.334600+0000","last_change":"2024-02-05T07:17:22.305432+0000","last_active":"2024-02-05T07:18:33.334600+0000","last_peered":"2024-02-05T07:18:33.334600+0000","last_clean":"2024-02-05T07:18:33.334600+0000","last_became_active":"2024-02-05T07:17:22.305139+0000","last_became_peered":"2024-02-05T07:17:22.305139+0000","last_unstale":"2024-02-05T07:18:33.334600+0000","last_undegraded":"2024-02-05T07:18:33.334600+0000","last_fullsized":"2024-02-05T07:18:33.334600+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:42:41.836804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194494+0000","last_change":"2024-02-05T07:17:24.311380+0000","last_active":"2024-02-05T07:17:57.194494+0000","last_peered":"2024-02-05T07:17:57.194494+0000","last_clean":"2024-02-05T07:17:57.194494+0000","last_became_active":"2024-02-05T07:17:24.311085+0000","last_became_peered":"2024-02-05T07:17:24.311085+0000","last_unstale":"2024-02-05T07:17:57.194494+0000","last_undegraded":"2024-02-05T07:17:57.194494+0000","last_fullsized":"2024-02-05T07:17:57.194494+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:32:16.774283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430521+0000","last_change":"2024-02-05T07:17:18.285693+0000","last_active":"2024-02-05T07:17:56.430521+0000","last_peered":"2024-02-05T07:17:56.430521+0000","last_clean":"2024-02-05T07:17:56.430521+0000","last_became_active":"2024-02-05T07:17:18.285414+0000","last_became_peered":"2024-02-05T07:17:18.285414+0000","last_unstale":"2024-02-05T07:17:56.430521+0000","last_undegraded":"2024-02-05T07:17:56.430521+0000","last_fullsized":"2024-02-05T07:17:56.430521+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:51:39.651170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"68'12","reported_seq":52,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387476+0000","last_change":"2024-02-05T07:17:20.290162+0000","last_active":"2024-02-05T07:17:56.387476+0000","last_peered":"2024-02-05T07:17:56.387476+0000","last_clean":"2024-02-05T07:17:56.387476+0000","last_became_active":"2024-02-05T07:17:20.289823+0000","last_became_peered":"2024-02-05T07:17:20.289823+0000","last_unstale":"2024-02-05T07:17:56.387476+0000","last_undegraded":"2024-02-05T07:17:56.387476+0000","last_fullsized":"2024-02-05T07:17:56.387476+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:09:15.372720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.390027+0000","last_change":"2024-02-05T07:17:22.297137+0000","last_active":"2024-02-05T07:17:56.390027+0000","last_peered":"2024-02-05T07:17:56.390027+0000","last_clean":"2024-02-05T07:17:56.390027+0000","last_became_active":"2024-02-05T07:17:22.296534+0000","last_became_peered":"2024-02-05T07:17:22.296534+0000","last_unstale":"2024-02-05T07:17:56.390027+0000","last_undegraded":"2024-02-05T07:17:56.390027+0000","last_fullsized":"2024-02-05T07:17:56.390027+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:57:35.162801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.429732+0000","last_change":"2024-02-05T07:17:24.310790+0000","last_active":"2024-02-05T07:17:56.429732+0000","last_peered":"2024-02-05T07:17:56.429732+0000","last_clean":"2024-02-05T07:17:56.429732+0000","last_became_active":"2024-02-05T07:17:24.310505+0000","last_became_peered":"2024-02-05T07:17:24.310505+0000","last_unstale":"2024-02-05T07:17:56.429732+0000","last_undegraded":"2024-02-05T07:17:56.429732+0000","last_fullsized":"2024-02-05T07:17:56.429732+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:28:50.294617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389763+0000","last_change":"2024-02-05T07:17:22.298950+0000","last_active":"2024-02-05T07:17:56.389763+0000","last_peered":"2024-02-05T07:17:56.389763+0000","last_clean":"2024-02-05T07:17:56.389763+0000","last_became_active":"2024-02-05T07:17:22.298172+0000","last_became_peered":"2024-02-05T07:17:22.298172+0000","last_unstale":"2024-02-05T07:17:56.389763+0000","last_undegraded":"2024-02-05T07:17:56.389763+0000","last_fullsized":"2024-02-05T07:17:56.389763+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:49:14.813892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430415+0000","last_change":"2024-02-05T07:17:18.282178+0000","last_active":"2024-02-05T07:17:56.430415+0000","last_peered":"2024-02-05T07:17:56.430415+0000","last_clean":"2024-02-05T07:17:56.430415+0000","last_became_active":"2024-02-05T07:17:18.281721+0000","last_became_peered":"2024-02-05T07:17:18.281721+0000","last_unstale":"2024-02-05T07:17:56.430415+0000","last_undegraded":"2024-02-05T07:17:56.430415+0000","last_fullsized":"2024-02-05T07:17:56.430415+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T14:49:44.461053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"68'19","reported_seq":86,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192972+0000","last_change":"2024-02-05T07:17:46.203531+0000","last_active":"2024-02-05T07:17:57.192972+0000","last_peered":"2024-02-05T07:17:57.192972+0000","last_clean":"2024-02-05T07:17:57.192972+0000","last_became_active":"2024-02-05T07:17:46.193635+0000","last_became_peered":"2024-02-05T07:17:46.193635+0000","last_unstale":"2024-02-05T07:17:57.192972+0000","last_undegraded":"2024-02-05T07:17:57.192972+0000","last_fullsized":"2024-02-05T07:17:57.192972+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T18:57:23.978978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,7],"acting":[6,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192746+0000","last_change":"2024-02-05T07:17:24.310131+0000","last_active":"2024-02-05T07:17:57.192746+0000","last_peered":"2024-02-05T07:17:57.192746+0000","last_clean":"2024-02-05T07:17:57.192746+0000","last_became_active":"2024-02-05T07:17:24.309745+0000","last_became_peered":"2024-02-05T07:17:24.309745+0000","last_unstale":"2024-02-05T07:17:57.192746+0000","last_undegraded":"2024-02-05T07:17:57.192746+0000","last_fullsized":"2024-02-05T07:17:57.192746+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:26:00.361411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388919+0000","last_change":"2024-02-05T07:17:22.296514+0000","last_active":"2024-02-05T07:17:56.388919+0000","last_peered":"2024-02-05T07:17:56.388919+0000","last_clean":"2024-02-05T07:17:56.388919+0000","last_became_active":"2024-02-05T07:17:22.295945+0000","last_became_peered":"2024-02-05T07:17:22.295945+0000","last_unstale":"2024-02-05T07:17:56.388919+0000","last_undegraded":"2024-02-05T07:17:56.388919+0000","last_fullsized":"2024-02-05T07:17:56.388919+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:39:35.431560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481676+0000","last_change":"2024-02-05T07:17:18.278790+0000","last_active":"2024-02-05T07:17:56.481676+0000","last_peered":"2024-02-05T07:17:56.481676+0000","last_clean":"2024-02-05T07:17:56.481676+0000","last_became_active":"2024-02-05T07:17:18.278493+0000","last_became_peered":"2024-02-05T07:17:18.278493+0000","last_unstale":"2024-02-05T07:17:56.481676+0000","last_undegraded":"2024-02-05T07:17:56.481676+0000","last_fullsized":"2024-02-05T07:17:56.481676+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:08:02.218462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"68'9","reported_seq":45,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193237+0000","last_change":"2024-02-05T07:17:20.296231+0000","last_active":"2024-02-05T07:17:57.193237+0000","last_peered":"2024-02-05T07:17:57.193237+0000","last_clean":"2024-02-05T07:17:57.193237+0000","last_became_active":"2024-02-05T07:17:20.295933+0000","last_became_peered":"2024-02-05T07:17:20.295933+0000","last_unstale":"2024-02-05T07:17:57.193237+0000","last_undegraded":"2024-02-05T07:17:57.193237+0000","last_fullsized":"2024-02-05T07:17:57.193237+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:05:22.174950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194628+0000","last_change":"2024-02-05T07:17:24.305343+0000","last_active":"2024-02-05T07:17:57.194628+0000","last_peered":"2024-02-05T07:17:57.194628+0000","last_clean":"2024-02-05T07:17:57.194628+0000","last_became_active":"2024-02-05T07:17:24.305061+0000","last_became_peered":"2024-02-05T07:17:24.305061+0000","last_unstale":"2024-02-05T07:17:57.194628+0000","last_undegraded":"2024-02-05T07:17:57.194628+0000","last_fullsized":"2024-02-05T07:17:57.194628+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:52:29.185052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"65'2","reported_seq":42,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481472+0000","last_change":"2024-02-05T07:17:22.296367+0000","last_active":"2024-02-05T07:17:56.481472+0000","last_peered":"2024-02-05T07:17:56.481472+0000","last_clean":"2024-02-05T07:17:56.481472+0000","last_became_active":"2024-02-05T07:17:18.279484+0000","last_became_peered":"2024-02-05T07:17:18.279484+0000","last_unstale":"2024-02-05T07:17:56.481472+0000","last_undegraded":"2024-02-05T07:17:56.481472+0000","last_fullsized":"2024-02-05T07:17:56.481472+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:46:40.612314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0034039439999999999,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387020+0000","last_change":"2024-02-05T07:17:18.282723+0000","last_active":"2024-02-05T07:17:56.387020+0000","last_peered":"2024-02-05T07:17:56.387020+0000","last_clean":"2024-02-05T07:17:56.387020+0000","last_became_active":"2024-02-05T07:17:18.282337+0000","last_became_peered":"2024-02-05T07:17:18.282337+0000","last_unstale":"2024-02-05T07:17:56.387020+0000","last_undegraded":"2024-02-05T07:17:56.387020+0000","last_fullsized":"2024-02-05T07:17:56.387020+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:40:22.934781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"68'28","reported_seq":94,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:33.334605+0000","last_change":"2024-02-05T07:17:20.291669+0000","last_active":"2024-02-05T07:18:33.334605+0000","last_peered":"2024-02-05T07:18:33.334605+0000","last_clean":"2024-02-05T07:18:33.334605+0000","last_became_active":"2024-02-05T07:17:20.291407+0000","last_became_peered":"2024-02-05T07:17:20.291407+0000","last_unstale":"2024-02-05T07:18:33.334605+0000","last_undegraded":"2024-02-05T07:18:33.334605+0000","last_fullsized":"2024-02-05T07:18:33.334605+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T18:49:58.523217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193356+0000","last_change":"2024-02-05T07:17:22.307994+0000","last_active":"2024-02-05T07:17:57.193356+0000","last_peered":"2024-02-05T07:17:57.193356+0000","last_clean":"2024-02-05T07:17:57.193356+0000","last_became_active":"2024-02-05T07:17:22.307688+0000","last_became_peered":"2024-02-05T07:17:22.307688+0000","last_unstale":"2024-02-05T07:17:57.193356+0000","last_undegraded":"2024-02-05T07:17:57.193356+0000","last_fullsized":"2024-02-05T07:17:57.193356+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:37:57.528755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430479+0000","last_change":"2024-02-05T07:17:24.316753+0000","last_active":"2024-02-05T07:17:56.430479+0000","last_peered":"2024-02-05T07:17:56.430479+0000","last_clean":"2024-02-05T07:17:56.430479+0000","last_became_active":"2024-02-05T07:17:24.316383+0000","last_became_peered":"2024-02-05T07:17:24.316383+0000","last_unstale":"2024-02-05T07:17:56.430479+0000","last_undegraded":"2024-02-05T07:17:56.430479+0000","last_fullsized":"2024-02-05T07:17:56.430479+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:30:02.882849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387479+0000","last_change":"2024-02-05T07:17:18.280769+0000","last_active":"2024-02-05T07:17:56.387479+0000","last_peered":"2024-02-05T07:17:56.387479+0000","last_clean":"2024-02-05T07:17:56.387479+0000","last_became_active":"2024-02-05T07:17:18.278822+0000","last_became_peered":"2024-02-05T07:17:18.278822+0000","last_unstale":"2024-02-05T07:17:56.387479+0000","last_undegraded":"2024-02-05T07:17:56.387479+0000","last_fullsized":"2024-02-05T07:17:56.387479+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:11:42.178566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389055+0000","last_change":"2024-02-05T07:17:22.287014+0000","last_active":"2024-02-05T07:17:56.389055+0000","last_peered":"2024-02-05T07:17:56.389055+0000","last_clean":"2024-02-05T07:17:56.389055+0000","last_became_active":"2024-02-05T07:17:18.280417+0000","last_became_peered":"2024-02-05T07:17:18.280417+0000","last_unstale":"2024-02-05T07:17:56.389055+0000","last_undegraded":"2024-02-05T07:17:56.389055+0000","last_fullsized":"2024-02-05T07:17:56.389055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:26:42.166363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00057931900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"68'13","reported_seq":56,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389260+0000","last_change":"2024-02-05T07:17:20.292585+0000","last_active":"2024-02-05T07:17:56.389260+0000","last_peered":"2024-02-05T07:17:56.389260+0000","last_clean":"2024-02-05T07:17:56.389260+0000","last_became_active":"2024-02-05T07:17:20.292310+0000","last_became_peered":"2024-02-05T07:17:20.292310+0000","last_unstale":"2024-02-05T07:17:56.389260+0000","last_undegraded":"2024-02-05T07:17:56.389260+0000","last_fullsized":"2024-02-05T07:17:56.389260+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:28:03.081404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389375+0000","last_change":"2024-02-05T07:17:22.301480+0000","last_active":"2024-02-05T07:17:56.389375+0000","last_peered":"2024-02-05T07:17:56.389375+0000","last_clean":"2024-02-05T07:17:56.389375+0000","last_became_active":"2024-02-05T07:17:22.301190+0000","last_became_peered":"2024-02-05T07:17:22.301190+0000","last_unstale":"2024-02-05T07:17:56.389375+0000","last_undegraded":"2024-02-05T07:17:56.389375+0000","last_fullsized":"2024-02-05T07:17:56.389375+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:52:55.355321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.482057+0000","last_change":"2024-02-05T07:17:24.307216+0000","last_active":"2024-02-05T07:17:56.482057+0000","last_peered":"2024-02-05T07:17:56.482057+0000","last_clean":"2024-02-05T07:17:56.482057+0000","last_became_active":"2024-02-05T07:17:24.306911+0000","last_became_peered":"2024-02-05T07:17:24.306911+0000","last_unstale":"2024-02-05T07:17:56.482057+0000","last_undegraded":"2024-02-05T07:17:56.482057+0000","last_fullsized":"2024-02-05T07:17:56.482057+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:52:33.615795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":276,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:58.483905+0000","last_change":"2024-02-05T07:17:09.287720+0000","last_active":"2024-02-05T07:17:58.483905+0000","last_peered":"2024-02-05T07:17:58.483905+0000","last_clean":"2024-02-05T07:17:58.483905+0000","last_became_active":"2024-02-05T07:17:09.287395+0000","last_became_peered":"2024-02-05T07:17:09.287395+0000","last_unstale":"2024-02-05T07:17:58.483905+0000","last_undegraded":"2024-02-05T07:17:58.483905+0000","last_fullsized":"2024-02-05T07:17:58.483905+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:14:58.589269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:14:58.589269+0000","last_clean_scrub_stamp":"2024-02-05T07:14:58.589269+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:15:29.709923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194048+0000","last_change":"2024-02-05T07:17:18.279541+0000","last_active":"2024-02-05T07:17:57.194048+0000","last_peered":"2024-02-05T07:17:57.194048+0000","last_clean":"2024-02-05T07:17:57.194048+0000","last_became_active":"2024-02-05T07:17:18.279257+0000","last_became_peered":"2024-02-05T07:17:18.279257+0000","last_unstale":"2024-02-05T07:17:57.194048+0000","last_undegraded":"2024-02-05T07:17:57.194048+0000","last_fullsized":"2024-02-05T07:17:57.194048+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:52:36.484973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"68'16","reported_seq":68,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:33.334557+0000","last_change":"2024-02-05T07:17:20.351595+0000","last_active":"2024-02-05T07:18:33.334557+0000","last_peered":"2024-02-05T07:18:33.334557+0000","last_clean":"2024-02-05T07:18:33.334557+0000","last_became_active":"2024-02-05T07:17:20.351211+0000","last_became_peered":"2024-02-05T07:17:20.351211+0000","last_unstale":"2024-02-05T07:18:33.334557+0000","last_undegraded":"2024-02-05T07:18:33.334557+0000","last_fullsized":"2024-02-05T07:18:33.334557+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:16:40.996275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430301+0000","last_change":"2024-02-05T07:17:22.301346+0000","last_active":"2024-02-05T07:17:56.430301+0000","last_peered":"2024-02-05T07:17:56.430301+0000","last_clean":"2024-02-05T07:17:56.430301+0000","last_became_active":"2024-02-05T07:17:22.301053+0000","last_became_peered":"2024-02-05T07:17:22.301053+0000","last_unstale":"2024-02-05T07:17:56.430301+0000","last_undegraded":"2024-02-05T07:17:56.430301+0000","last_fullsized":"2024-02-05T07:17:56.430301+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:46:59.317068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387835+0000","last_change":"2024-02-05T07:17:24.312065+0000","last_active":"2024-02-05T07:17:56.387835+0000","last_peered":"2024-02-05T07:17:56.387835+0000","last_clean":"2024-02-05T07:17:56.387835+0000","last_became_active":"2024-02-05T07:17:24.311676+0000","last_became_peered":"2024-02-05T07:17:24.311676+0000","last_unstale":"2024-02-05T07:17:56.387835+0000","last_undegraded":"2024-02-05T07:17:56.387835+0000","last_fullsized":"2024-02-05T07:17:56.387835+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:18:00.222888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192897+0000","last_change":"2024-02-05T07:17:18.285493+0000","last_active":"2024-02-05T07:17:57.192897+0000","last_peered":"2024-02-05T07:17:57.192897+0000","last_clean":"2024-02-05T07:17:57.192897+0000","last_became_active":"2024-02-05T07:17:18.285208+0000","last_became_peered":"2024-02-05T07:17:18.285208+0000","last_unstale":"2024-02-05T07:17:57.192897+0000","last_undegraded":"2024-02-05T07:17:57.192897+0000","last_fullsized":"2024-02-05T07:17:57.192897+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:00:57.885970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"69'5","reported_seq":121,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:40.648474+0000","last_change":"2024-02-05T07:17:22.295737+0000","last_active":"2024-02-05T07:18:40.648474+0000","last_peered":"2024-02-05T07:18:40.648474+0000","last_clean":"2024-02-05T07:18:40.648474+0000","last_became_active":"2024-02-05T07:17:18.285184+0000","last_became_peered":"2024-02-05T07:17:18.285184+0000","last_unstale":"2024-02-05T07:18:40.648474+0000","last_undegraded":"2024-02-05T07:18:40.648474+0000","last_fullsized":"2024-02-05T07:18:40.648474+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:21:21.797689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00090368800000000004,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":73,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"68'12","reported_seq":47,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193295+0000","last_change":"2024-02-05T07:17:20.294445+0000","last_active":"2024-02-05T07:17:57.193295+0000","last_peered":"2024-02-05T07:17:57.193295+0000","last_clean":"2024-02-05T07:17:57.193295+0000","last_became_active":"2024-02-05T07:17:20.293445+0000","last_became_peered":"2024-02-05T07:17:20.293445+0000","last_unstale":"2024-02-05T07:17:57.193295+0000","last_undegraded":"2024-02-05T07:17:57.193295+0000","last_fullsized":"2024-02-05T07:17:57.193295+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:11:57.923653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.482239+0000","last_change":"2024-02-05T07:17:22.300440+0000","last_active":"2024-02-05T07:17:56.482239+0000","last_peered":"2024-02-05T07:17:56.482239+0000","last_clean":"2024-02-05T07:17:56.482239+0000","last_became_active":"2024-02-05T07:17:22.299605+0000","last_became_peered":"2024-02-05T07:17:22.299605+0000","last_unstale":"2024-02-05T07:17:56.482239+0000","last_undegraded":"2024-02-05T07:17:56.482239+0000","last_fullsized":"2024-02-05T07:17:56.482239+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:02:19.911184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389466+0000","last_change":"2024-02-05T07:17:24.314867+0000","last_active":"2024-02-05T07:17:56.389466+0000","last_peered":"2024-02-05T07:17:56.389466+0000","last_clean":"2024-02-05T07:17:56.389466+0000","last_became_active":"2024-02-05T07:17:24.314523+0000","last_became_peered":"2024-02-05T07:17:24.314523+0000","last_unstale":"2024-02-05T07:17:56.389466+0000","last_undegraded":"2024-02-05T07:17:56.389466+0000","last_fullsized":"2024-02-05T07:17:56.389466+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:33:22.068465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387952+0000","last_change":"2024-02-05T07:17:18.273405+0000","last_active":"2024-02-05T07:17:56.387952+0000","last_peered":"2024-02-05T07:17:56.387952+0000","last_clean":"2024-02-05T07:17:56.387952+0000","last_became_active":"2024-02-05T07:17:18.273047+0000","last_became_peered":"2024-02-05T07:17:18.273047+0000","last_unstale":"2024-02-05T07:17:56.387952+0000","last_undegraded":"2024-02-05T07:17:56.387952+0000","last_fullsized":"2024-02-05T07:17:56.387952+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T09:39:28.815608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"68'19","reported_seq":65,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193514+0000","last_change":"2024-02-05T07:17:20.351546+0000","last_active":"2024-02-05T07:17:57.193514+0000","last_peered":"2024-02-05T07:17:57.193514+0000","last_clean":"2024-02-05T07:17:57.193514+0000","last_became_active":"2024-02-05T07:17:20.351268+0000","last_became_peered":"2024-02-05T07:17:20.351268+0000","last_unstale":"2024-02-05T07:17:57.193514+0000","last_undegraded":"2024-02-05T07:17:57.193514+0000","last_fullsized":"2024-02-05T07:17:57.193514+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:12:57.361127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192995+0000","last_change":"2024-02-05T07:17:22.301640+0000","last_active":"2024-02-05T07:17:57.192995+0000","last_peered":"2024-02-05T07:17:57.192995+0000","last_clean":"2024-02-05T07:17:57.192995+0000","last_became_active":"2024-02-05T07:17:22.301286+0000","last_became_peered":"2024-02-05T07:17:22.301286+0000","last_unstale":"2024-02-05T07:17:57.192995+0000","last_undegraded":"2024-02-05T07:17:57.192995+0000","last_fullsized":"2024-02-05T07:17:57.192995+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:53:39.146281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192699+0000","last_change":"2024-02-05T07:17:24.313326+0000","last_active":"2024-02-05T07:17:57.192699+0000","last_peered":"2024-02-05T07:17:57.192699+0000","last_clean":"2024-02-05T07:17:57.192699+0000","last_became_active":"2024-02-05T07:17:24.313036+0000","last_became_peered":"2024-02-05T07:17:24.313036+0000","last_unstale":"2024-02-05T07:17:57.192699+0000","last_undegraded":"2024-02-05T07:17:57.192699+0000","last_fullsized":"2024-02-05T07:17:57.192699+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:35:36.860137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481965+0000","last_change":"2024-02-05T07:17:18.276186+0000","last_active":"2024-02-05T07:17:56.481965+0000","last_peered":"2024-02-05T07:17:56.481965+0000","last_clean":"2024-02-05T07:17:56.481965+0000","last_became_active":"2024-02-05T07:17:18.275906+0000","last_became_peered":"2024-02-05T07:17:18.275906+0000","last_unstale":"2024-02-05T07:17:56.481965+0000","last_undegraded":"2024-02-05T07:17:56.481965+0000","last_fullsized":"2024-02-05T07:17:56.481965+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T16:22:39.768474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"68'10","reported_seq":44,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388647+0000","last_change":"2024-02-05T07:17:20.288364+0000","last_active":"2024-02-05T07:17:56.388647+0000","last_peered":"2024-02-05T07:17:56.388647+0000","last_clean":"2024-02-05T07:17:56.388647+0000","last_became_active":"2024-02-05T07:17:20.288005+0000","last_became_peered":"2024-02-05T07:17:20.288005+0000","last_unstale":"2024-02-05T07:17:56.388647+0000","last_undegraded":"2024-02-05T07:17:56.388647+0000","last_fullsized":"2024-02-05T07:17:56.388647+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:48:48.033639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"68'8","reported_seq":50,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:33.334581+0000","last_change":"2024-02-05T07:17:22.301631+0000","last_active":"2024-02-05T07:18:33.334581+0000","last_peered":"2024-02-05T07:18:33.334581+0000","last_clean":"2024-02-05T07:18:33.334581+0000","last_became_active":"2024-02-05T07:17:22.301330+0000","last_became_peered":"2024-02-05T07:17:22.301330+0000","last_unstale":"2024-02-05T07:18:33.334581+0000","last_undegraded":"2024-02-05T07:18:33.334581+0000","last_fullsized":"2024-02-05T07:18:33.334581+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:39:25.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.430250+0000","last_change":"2024-02-05T07:17:24.315442+0000","last_active":"2024-02-05T07:17:56.430250+0000","last_peered":"2024-02-05T07:17:56.430250+0000","last_clean":"2024-02-05T07:17:56.430250+0000","last_became_active":"2024-02-05T07:17:24.314563+0000","last_became_peered":"2024-02-05T07:17:24.314563+0000","last_unstale":"2024-02-05T07:17:56.430250+0000","last_undegraded":"2024-02-05T07:17:56.430250+0000","last_fullsized":"2024-02-05T07:17:56.430250+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:35:01.917095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"61'1","reported_seq":34,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193975+0000","last_change":"2024-02-05T07:17:18.285637+0000","last_active":"2024-02-05T07:17:57.193975+0000","last_peered":"2024-02-05T07:17:57.193975+0000","last_clean":"2024-02-05T07:17:57.193975+0000","last_became_active":"2024-02-05T07:17:18.285357+0000","last_became_peered":"2024-02-05T07:17:18.285357+0000","last_unstale":"2024-02-05T07:17:57.193975+0000","last_undegraded":"2024-02-05T07:17:57.193975+0000","last_fullsized":"2024-02-05T07:17:57.193975+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:27:55.572167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"68'14","reported_seq":50,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387026+0000","last_change":"2024-02-05T07:17:20.285101+0000","last_active":"2024-02-05T07:17:56.387026+0000","last_peered":"2024-02-05T07:17:56.387026+0000","last_clean":"2024-02-05T07:17:56.387026+0000","last_became_active":"2024-02-05T07:17:20.284055+0000","last_became_peered":"2024-02-05T07:17:20.284055+0000","last_unstale":"2024-02-05T07:17:56.387026+0000","last_undegraded":"2024-02-05T07:17:56.387026+0000","last_fullsized":"2024-02-05T07:17:56.387026+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:46:13.090149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"68'8","reported_seq":50,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:33.334590+0000","last_change":"2024-02-05T07:17:22.299150+0000","last_active":"2024-02-05T07:18:33.334590+0000","last_peered":"2024-02-05T07:18:33.334590+0000","last_clean":"2024-02-05T07:18:33.334590+0000","last_became_active":"2024-02-05T07:17:22.298853+0000","last_became_peered":"2024-02-05T07:17:22.298853+0000","last_unstale":"2024-02-05T07:18:33.334590+0000","last_undegraded":"2024-02-05T07:18:33.334590+0000","last_fullsized":"2024-02-05T07:18:33.334590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:41:19.392977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387254+0000","last_change":"2024-02-05T07:17:24.309759+0000","last_active":"2024-02-05T07:17:56.387254+0000","last_peered":"2024-02-05T07:17:56.387254+0000","last_clean":"2024-02-05T07:17:56.387254+0000","last_became_active":"2024-02-05T07:17:24.309486+0000","last_became_peered":"2024-02-05T07:17:24.309486+0000","last_unstale":"2024-02-05T07:17:56.387254+0000","last_undegraded":"2024-02-05T07:17:56.387254+0000","last_fullsized":"2024-02-05T07:17:56.387254+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T19:16:44.544180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.195093+0000","last_change":"2024-02-05T07:17:18.282345+0000","last_active":"2024-02-05T07:17:57.195093+0000","last_peered":"2024-02-05T07:17:57.195093+0000","last_clean":"2024-02-05T07:17:57.195093+0000","last_became_active":"2024-02-05T07:17:18.282038+0000","last_became_peered":"2024-02-05T07:17:18.282038+0000","last_unstale":"2024-02-05T07:17:57.195093+0000","last_undegraded":"2024-02-05T07:17:57.195093+0000","last_fullsized":"2024-02-05T07:17:57.195093+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:45:02.469086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"68'18","reported_seq":61,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193532+0000","last_change":"2024-02-05T07:17:20.352282+0000","last_active":"2024-02-05T07:17:57.193532+0000","last_peered":"2024-02-05T07:17:57.193532+0000","last_clean":"2024-02-05T07:17:57.193532+0000","last_became_active":"2024-02-05T07:17:20.351809+0000","last_became_peered":"2024-02-05T07:17:20.351809+0000","last_unstale":"2024-02-05T07:17:57.193532+0000","last_undegraded":"2024-02-05T07:17:57.193532+0000","last_fullsized":"2024-02-05T07:17:57.193532+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T07:39:22.322069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.386927+0000","last_change":"2024-02-05T07:17:22.302893+0000","last_active":"2024-02-05T07:17:56.386927+0000","last_peered":"2024-02-05T07:17:56.386927+0000","last_clean":"2024-02-05T07:17:56.386927+0000","last_became_active":"2024-02-05T07:17:22.302344+0000","last_became_peered":"2024-02-05T07:17:22.302344+0000","last_unstale":"2024-02-05T07:17:56.386927+0000","last_undegraded":"2024-02-05T07:17:56.386927+0000","last_fullsized":"2024-02-05T07:17:56.386927+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T19:16:17.092730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.481865+0000","last_change":"2024-02-05T07:17:24.304379+0000","last_active":"2024-02-05T07:17:56.481865+0000","last_peered":"2024-02-05T07:17:56.481865+0000","last_clean":"2024-02-05T07:17:56.481865+0000","last_became_active":"2024-02-05T07:17:24.303905+0000","last_became_peered":"2024-02-05T07:17:24.303905+0000","last_unstale":"2024-02-05T07:17:56.481865+0000","last_undegraded":"2024-02-05T07:17:56.481865+0000","last_fullsized":"2024-02-05T07:17:56.481865+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:35:44.103501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"68'8","reported_seq":50,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:33.334518+0000","last_change":"2024-02-05T07:17:22.304951+0000","last_active":"2024-02-05T07:18:33.334518+0000","last_peered":"2024-02-05T07:18:33.334518+0000","last_clean":"2024-02-05T07:18:33.334518+0000","last_became_active":"2024-02-05T07:17:22.304655+0000","last_became_peered":"2024-02-05T07:17:22.304655+0000","last_unstale":"2024-02-05T07:18:33.334518+0000","last_undegraded":"2024-02-05T07:18:33.334518+0000","last_fullsized":"2024-02-05T07:18:33.334518+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:32:35.144503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193443+0000","last_change":"2024-02-05T07:17:18.281920+0000","last_active":"2024-02-05T07:17:57.193443+0000","last_peered":"2024-02-05T07:17:57.193443+0000","last_clean":"2024-02-05T07:17:57.193443+0000","last_became_active":"2024-02-05T07:17:18.281614+0000","last_became_peered":"2024-02-05T07:17:18.281614+0000","last_unstale":"2024-02-05T07:17:57.193443+0000","last_undegraded":"2024-02-05T07:17:57.193443+0000","last_fullsized":"2024-02-05T07:17:57.193443+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T13:01:53.304921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"68'15","reported_seq":29,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.390135+0000","last_change":"2024-02-05T07:17:46.200946+0000","last_active":"2024-02-05T07:17:56.390135+0000","last_peered":"2024-02-05T07:17:56.390135+0000","last_clean":"2024-02-05T07:17:56.390135+0000","last_became_active":"2024-02-05T07:17:46.191356+0000","last_became_peered":"2024-02-05T07:17:46.191356+0000","last_unstale":"2024-02-05T07:17:56.390135+0000","last_undegraded":"2024-02-05T07:17:56.390135+0000","last_fullsized":"2024-02-05T07:17:56.390135+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:39:01.691243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.193606+0000","last_change":"2024-02-05T07:17:24.314899+0000","last_active":"2024-02-05T07:17:57.193606+0000","last_peered":"2024-02-05T07:17:57.193606+0000","last_clean":"2024-02-05T07:17:57.193606+0000","last_became_active":"2024-02-05T07:17:24.314562+0000","last_became_peered":"2024-02-05T07:17:24.314562+0000","last_unstale":"2024-02-05T07:17:57.193606+0000","last_undegraded":"2024-02-05T07:17:57.193606+0000","last_fullsized":"2024-02-05T07:17:57.193606+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T09:51:53.155955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.482235+0000","last_change":"2024-02-05T07:17:22.304008+0000","last_active":"2024-02-05T07:17:56.482235+0000","last_peered":"2024-02-05T07:17:56.482235+0000","last_clean":"2024-02-05T07:17:56.482235+0000","last_became_active":"2024-02-05T07:17:22.303304+0000","last_became_peered":"2024-02-05T07:17:22.303304+0000","last_unstale":"2024-02-05T07:17:56.482235+0000","last_undegraded":"2024-02-05T07:17:56.482235+0000","last_fullsized":"2024-02-05T07:17:56.482235+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T15:22:45.841141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387379+0000","last_change":"2024-02-05T07:17:18.285673+0000","last_active":"2024-02-05T07:17:56.387379+0000","last_peered":"2024-02-05T07:17:56.387379+0000","last_clean":"2024-02-05T07:17:56.387379+0000","last_became_active":"2024-02-05T07:17:18.285326+0000","last_became_peered":"2024-02-05T07:17:18.285326+0000","last_unstale":"2024-02-05T07:17:56.387379+0000","last_undegraded":"2024-02-05T07:17:56.387379+0000","last_fullsized":"2024-02-05T07:17:56.387379+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:37:22.454481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"68'11","reported_seq":48,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.389419+0000","last_change":"2024-02-05T07:17:20.287695+0000","last_active":"2024-02-05T07:17:56.389419+0000","last_peered":"2024-02-05T07:17:56.389419+0000","last_clean":"2024-02-05T07:17:56.389419+0000","last_became_active":"2024-02-05T07:17:20.287333+0000","last_became_peered":"2024-02-05T07:17:20.287333+0000","last_unstale":"2024-02-05T07:17:56.389419+0000","last_undegraded":"2024-02-05T07:17:56.389419+0000","last_fullsized":"2024-02-05T07:17:56.389419+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T12:37:47.761670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.390366+0000","last_change":"2024-02-05T07:17:24.309836+0000","last_active":"2024-02-05T07:17:56.390366+0000","last_peered":"2024-02-05T07:17:56.390366+0000","last_clean":"2024-02-05T07:17:56.390366+0000","last_became_active":"2024-02-05T07:17:24.309385+0000","last_became_peered":"2024-02-05T07:17:24.309385+0000","last_unstale":"2024-02-05T07:17:56.390366+0000","last_undegraded":"2024-02-05T07:17:56.390366+0000","last_fullsized":"2024-02-05T07:17:56.390366+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:24:03.993047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388108+0000","last_change":"2024-02-05T07:17:22.298197+0000","last_active":"2024-02-05T07:17:56.388108+0000","last_peered":"2024-02-05T07:17:56.388108+0000","last_clean":"2024-02-05T07:17:56.388108+0000","last_became_active":"2024-02-05T07:17:22.297885+0000","last_became_peered":"2024-02-05T07:17:22.297885+0000","last_unstale":"2024-02-05T07:17:56.388108+0000","last_undegraded":"2024-02-05T07:17:56.388108+0000","last_fullsized":"2024-02-05T07:17:56.388108+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:18:23.167469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.192893+0000","last_change":"2024-02-05T07:17:18.280870+0000","last_active":"2024-02-05T07:17:57.192893+0000","last_peered":"2024-02-05T07:17:57.192893+0000","last_clean":"2024-02-05T07:17:57.192893+0000","last_became_active":"2024-02-05T07:17:18.280599+0000","last_became_peered":"2024-02-05T07:17:18.280599+0000","last_unstale":"2024-02-05T07:17:57.192893+0000","last_undegraded":"2024-02-05T07:17:57.192893+0000","last_fullsized":"2024-02-05T07:17:57.192893+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T18:11:54.290981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"68'17","reported_seq":57,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388485+0000","last_change":"2024-02-05T07:17:20.286369+0000","last_active":"2024-02-05T07:17:56.388485+0000","last_peered":"2024-02-05T07:17:56.388485+0000","last_clean":"2024-02-05T07:17:56.388485+0000","last_became_active":"2024-02-05T07:17:20.285951+0000","last_became_peered":"2024-02-05T07:17:20.285951+0000","last_unstale":"2024-02-05T07:17:56.388485+0000","last_undegraded":"2024-02-05T07:17:56.388485+0000","last_fullsized":"2024-02-05T07:17:56.388485+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T11:18:50.003842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"68'1","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.388985+0000","last_change":"2024-02-05T07:17:24.309350+0000","last_active":"2024-02-05T07:17:56.388985+0000","last_peered":"2024-02-05T07:17:56.388985+0000","last_clean":"2024-02-05T07:17:56.388985+0000","last_became_active":"2024-02-05T07:17:24.308867+0000","last_became_peered":"2024-02-05T07:17:24.308867+0000","last_unstale":"2024-02-05T07:17:56.388985+0000","last_undegraded":"2024-02-05T07:17:56.388985+0000","last_fullsized":"2024-02-05T07:17:56.388985+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:23.283660+0000","last_clean_scrub_stamp":"2024-02-05T07:17:23.283660+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:41:12.369837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"68'8","reported_seq":50,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:18:33.334590+0000","last_change":"2024-02-05T07:17:22.299783+0000","last_active":"2024-02-05T07:18:33.334590+0000","last_peered":"2024-02-05T07:18:33.334590+0000","last_clean":"2024-02-05T07:18:33.334590+0000","last_became_active":"2024-02-05T07:17:22.299462+0000","last_became_peered":"2024-02-05T07:17:22.299462+0000","last_unstale":"2024-02-05T07:18:33.334590+0000","last_undegraded":"2024-02-05T07:18:33.334590+0000","last_fullsized":"2024-02-05T07:18:33.334590+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":64,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:21.276651+0000","last_clean_scrub_stamp":"2024-02-05T07:17:21.276651+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T10:56:10.180299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:57.194765+0000","last_change":"2024-02-05T07:17:18.283543+0000","last_active":"2024-02-05T07:17:57.194765+0000","last_peered":"2024-02-05T07:17:57.194765+0000","last_clean":"2024-02-05T07:17:57.194765+0000","last_became_active":"2024-02-05T07:17:18.283192+0000","last_became_peered":"2024-02-05T07:17:18.283192+0000","last_unstale":"2024-02-05T07:17:57.194765+0000","last_undegraded":"2024-02-05T07:17:57.194765+0000","last_fullsized":"2024-02-05T07:17:57.194765+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:17.250896+0000","last_clean_scrub_stamp":"2024-02-05T07:17:17.250896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T08:23:42.113995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"68'10","reported_seq":44,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-02-05T07:17:56.387305+0000","last_change":"2024-02-05T07:17:20.289956+0000","last_active":"2024-02-05T07:17:56.387305+0000","last_peered":"2024-02-05T07:17:56.387305+0000","last_clean":"2024-02-05T07:17:56.387305+0000","last_became_active":"2024-02-05T07:17:20.289648+0000","last_became_peered":"2024-02-05T07:17:20.289648+0000","last_unstale":"2024-02-05T07:17:56.387305+0000","last_undegraded":"2024-02-05T07:17:56.387305+0000","last_fullsized":"2024-02-05T07:17:56.387305+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-05T07:17:19.266883+0000","last_clean_scrub_stamp":"2024-02-05T07:17:19.266883+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-06T17:46:46.396570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":698,"num_read_kb":455,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":393,"ondisk_log_size":393,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":73,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":9,"acting":9,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201301,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32452,"kb_used_data":1276,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712700,"statfs":{"total":95995035648,"available":95961804800,"internally_reserved":0,"allocated":1306624,"data_stored":871705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31914443},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.44},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"last":0.51500000000000001}]},{"osd":1,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45100000000000001}]},{"osd":2,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47399999999999998}]},{"osd":3,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.50600000000000001}]},{"osd":4,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.312},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.40899999999999997}]},{"osd":5,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.38}]},{"osd":6,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.46000000000000002}]}]},{"osd":6,"up_from":46,"seq":197568495641,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28272,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716880,"statfs":{"total":95995035648,"available":95966085120,"internally_reserved":0,"allocated":1286144,"data_stored":870654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 5 07:18:41 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.55200000000000005,"15min":0.55800000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71599999999999997,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.70599999999999996,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.52200000000000002}]},{"osd":1,"last update":"Mon Feb 5 07:18:41 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56399999999999995,"15min":0.56599999999999995},"min":{"1min":0.33300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.57499999999999996,"15min":0.58499999999999996},"min":{"1min":0.39200000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.67000000000000004,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58599999999999997}]},{"osd":2,"last update":"Mon Feb 5 07:18:41 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.56599999999999995,"15min":0.57799999999999996},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.69799999999999995,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56299999999999994,"15min":0.56899999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.71099999999999997,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.56299999999999994}]},{"osd":3,"last update":"Mon Feb 5 07:18:41 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.54600000000000004,"15min":0.55000000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.59799999999999998,"15min":0.60699999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.74299999999999999,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54900000000000004}]},{"osd":4,"last update":"Mon Feb 5 07:18:41 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.437,"15min":0.435},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.60499999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.44900000000000001,"15min":0.44400000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.39600000000000002}]},{"osd":5,"last update":"Mon Feb 5 07:18:41 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.44},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.504,"15min":0.5},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.70299999999999996,"5min":0.748,"15min":0.748},"last":0.495}]},{"osd":7,"last update":"Mon Feb 5 07:18:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.45700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31916,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713236,"statfs":{"total":95995035648,"available":95962353664,"internally_reserved":0,"allocated":753664,"data_stored":282628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 5 07:18:39 2024","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34200000000000003,"15min":0.32200000000000001},"min":{"1min":0.23200000000000001,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.61099999999999999,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.36799999999999999,"15min":0.33600000000000002},"min":{"1min":0.253,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55600000000000005,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.307}]},{"osd":2,"last update":"Mon Feb 5 07:18:02 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.38800000000000001,"15min":0.38400000000000001},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.64400000000000002,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.41199999999999998,"15min":0.40600000000000003},"min":{"1min":0.29199999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.39400000000000002}]},{"osd":3,"last update":"Mon Feb 5 07:18:30 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.47599999999999998,"15min":0.48999999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61699999999999999,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.434,"15min":0.443},"min":{"1min":0.29099999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54600000000000004,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.28999999999999998}]},{"osd":4,"last update":"Mon Feb 5 07:17:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.372,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.372},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.40400000000000003}]},{"osd":5,"last update":"Mon Feb 5 07:18:20 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.58999999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.89200000000000002,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.46899999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.45500000000000002}]},{"osd":6,"last update":"Mon Feb 5 07:17:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.44600000000000001}]},{"osd":7,"last update":"Mon Feb 5 07:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.38200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738426,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28300,"kb_used_data":1284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716852,"statfs":{"total":95995035648,"available":95966056448,"internally_reserved":0,"allocated":1314816,"data_stored":871846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Feb 5 07:18:42 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36299999999999999,"15min":0.311},"min":{"1min":0.20699999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.60399999999999998,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.36499999999999999,"15min":0.31900000000000001},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.65400000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.23599999999999999}]},{"osd":2,"last update":"Mon Feb 5 07:18:04 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.44700000000000001,"15min":0.44600000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53600000000000003,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.41699999999999998,"15min":0.40999999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57099999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.28399999999999997}]},{"osd":3,"last update":"Mon Feb 5 07:18:29 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.45600000000000002,"15min":0.47599999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57799999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.504,"15min":0.52500000000000002},"min":{"1min":0.25700000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.63500000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.32500000000000001}]},{"osd":4,"last update":"Mon Feb 5 07:17:49 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59199999999999997,"15min":0.59999999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.314},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.60199999999999998,"15min":0.61199999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.83499999999999996,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":0.41599999999999998}]},{"osd":5,"last update":"Mon Feb 5 07:18:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.46000000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.752,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.61699999999999999,"15min":0.627},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73299999999999998,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.45000000000000001}]},{"osd":6,"last update":"Mon Feb 5 07:18:42 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.755,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.61499999999999999,"15min":0.625},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.80800000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.48899999999999999}]},{"osd":7,"last update":"Mon Feb 5 07:18:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.503}]}]},{"osd":2,"up_from":18,"seq":77309411376,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31868,"kb_used_data":688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713284,"statfs":{"total":95995035648,"available":95962402816,"internally_reserved":0,"allocated":704512,"data_stored":281031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 5 07:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36399999999999999,"15min":0.35499999999999998},"min":{"1min":0.23000000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.39500000000000002,"15min":0.38800000000000001},"min":{"1min":0.25900000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.59899999999999998,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.24299999999999999}]},{"osd":1,"last update":"Mon Feb 5 07:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.39700000000000002,"15min":0.39300000000000002},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.53800000000000003,"5min":0.62,"15min":0.62},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41199999999999998,"15min":0.40799999999999997},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.59299999999999997,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.34399999999999997}]},{"osd":3,"last update":"Mon Feb 5 07:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.432,"15min":0.438},"min":{"1min":0.25900000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.60099999999999998,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.44600000000000001,"15min":0.44800000000000001},"min":{"1min":0.28399999999999997,"5min":0.254,"15min":0.254},"max":{"1min":0.58199999999999996,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.32000000000000001}]},{"osd":4,"last update":"Mon Feb 5 07:17:50 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.56699999999999995,"15min":0.56299999999999994},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.46600000000000003}]},{"osd":5,"last update":"Mon Feb 5 07:18:16 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.56899999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.875,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58399999999999996},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.35699999999999998}]},{"osd":6,"last update":"Mon Feb 5 07:17:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.375}]},{"osd":7,"last update":"Mon Feb 5 07:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.44},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.47599999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182442,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31892,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713260,"statfs":{"total":95995035648,"available":95962378240,"internally_reserved":0,"allocated":729088,"data_stored":281177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 5 07:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.39000000000000001,"15min":0.39600000000000002},"min":{"1min":0.248,"5min":0.245,"15min":0.245},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.38},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.436,"15min":0.44400000000000001},"min":{"1min":0.28000000000000003,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.56599999999999995,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.439}]},{"osd":1,"last update":"Mon Feb 5 07:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.41999999999999998,"15min":0.42999999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.56200000000000006,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.441,"15min":0.45300000000000001},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.61699999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.42099999999999999}]},{"osd":2,"last update":"Mon Feb 5 07:18:31 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.46100000000000002,"15min":0.46800000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.58999999999999997,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.44900000000000001,"15min":0.46400000000000002},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.57899999999999996,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.46600000000000003}]},{"osd":4,"last update":"Mon Feb 5 07:17:48 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55600000000000005,"15min":0.55500000000000005},"min":{"1min":0.41699999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.69999999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.44,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.74399999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.57599999999999996}]},{"osd":5,"last update":"Mon Feb 5 07:18:15 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61399999999999999,"15min":0.61799999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.68200000000000005}]},{"osd":6,"last update":"Mon Feb 5 07:18:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.746,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.58899999999999997,"15min":0.58599999999999997},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.66700000000000004}]},{"osd":7,"last update":"Mon Feb 5 07:18:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.745}]}]},{"osd":4,"up_from":30,"seq":128849018917,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27732,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717420,"statfs":{"total":95995035648,"available":95966638080,"internally_reserved":0,"allocated":729088,"data_stored":281778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 5 07:17:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.38},{"interface":"front","average":{"1min":0.625,"5min":0.52700000000000002,"15min":0.51100000000000001},"min":{"1min":0.35899999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":0.57099999999999995}]},{"osd":1,"last update":"Mon Feb 5 07:17:48 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.48699999999999999,"15min":0.48099999999999998},"min":{"1min":0.34599999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.6950000000000001,"5min":1.6950000000000001,"15min":1.6950000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":0.40899999999999997}]},{"osd":2,"last update":"Mon Feb 5 07:17:48 2024","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.501,"15min":0.498},"min":{"1min":0.39700000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.495},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.51500000000000001,"15min":0.501},"min":{"1min":0.39600000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.54700000000000004}]},{"osd":3,"last update":"Mon Feb 5 07:17:48 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.52400000000000002,"15min":0.51800000000000002},"min":{"1min":0.39200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.53900000000000003,"15min":0.52500000000000002},"min":{"1min":0.41499999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":2.6789999999999998,"5min":2.6789999999999998,"15min":2.6789999999999998},"last":0.50700000000000001}]},{"osd":5,"last update":"Mon Feb 5 07:18:14 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.39400000000000002,"15min":0.379},"min":{"1min":0.33700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.31},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.435,"15min":0.42699999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.46200000000000002}]},{"osd":6,"last update":"Mon Feb 5 07:17:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.34799999999999998}]},{"osd":7,"last update":"Mon Feb 5 07:18:08 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.48099999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757280,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31872,"kb_used_data":692,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713280,"statfs":{"total":95995035648,"available":95962398720,"internally_reserved":0,"allocated":708608,"data_stored":281993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Feb 5 07:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54200000000000004,"15min":0.54500000000000004},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.33600000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.39900000000000002}]},{"osd":1,"last update":"Mon Feb 5 07:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54300000000000004,"15min":0.54400000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.496},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.435}]},{"osd":2,"last update":"Mon Feb 5 07:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54400000000000004,"15min":0.54000000000000004},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56699999999999995,"15min":0.57299999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.86599999999999999,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Feb 5 07:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57099999999999995,"15min":0.57599999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55100000000000005,"15min":0.55000000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.81599999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.44400000000000001}]},{"osd":4,"last update":"Mon Feb 5 07:18:19 2024","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.436,"15min":0.435},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68500000000000005,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46999999999999997,"15min":0.46800000000000003},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64800000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.45300000000000001}]},{"osd":6,"last update":"Mon Feb 5 07:17:40 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.42099999999999999}]},{"osd":7,"last update":"Mon Feb 5 07:18:06 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":2008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-05T07:18:44.886 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-05T07:18:44.886 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-05T07:18:44.886 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-05T07:18:44.886 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921 shell --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 -- ceph health --format=json 2024-02-05T07:18:45.127 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/mon.a/config 2024-02-05T07:18:45.502 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:45 smithi184 ceph-mon[29861]: from='client.14760 v1:172.21.15.184:0/613382853' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-05T07:18:45.502 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:45 smithi184 ceph-mon[41609]: from='client.14760 v1:172.21.15.184:0/613382853' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-05T07:18:45.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:45 smithi188 ceph-mon[33283]: from='client.14760 v1:172.21.15.184:0/613382853' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-05T07:18:46.271 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:18:46 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[78025]: ts=2024-02-05T07:18:46.056Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003221187s 2024-02-05T07:18:46.609 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:46 smithi184 ceph-mon[29861]: pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:46.609 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:46 smithi184 ceph-mon[41609]: pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:46.652 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:46 smithi188 ceph-mon[33283]: pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:46.837 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.833+0000 7efead60c700 1 -- 172.21.15.184:0/3015744153 >> v1:172.21.15.184:6789/0 conn(0x7efea8109870 legacy=0x7efea810bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:46.837 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.833+0000 7efead60c700 1 -- 172.21.15.184:0/3015744153 shutdown_connections 2024-02-05T07:18:46.837 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.833+0000 7efead60c700 1 -- 172.21.15.184:0/3015744153 >> 172.21.15.184:0/3015744153 conn(0x7efea80fc4b0 msgr2=0x7efea80fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:46.837 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.833+0000 7efead60c700 1 -- 172.21.15.184:0/3015744153 shutdown_connections 2024-02-05T07:18:46.837 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.833+0000 7efead60c700 1 -- 172.21.15.184:0/3015744153 wait complete. 2024-02-05T07:18:46.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.833+0000 7efead60c700 1 Processor -- start 2024-02-05T07:18:46.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efead60c700 1 -- start start 2024-02-05T07:18:46.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efead60c700 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7efea81a5a70 con 0x7efea810d440 2024-02-05T07:18:46.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efead60c700 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7efea81a6c50 con 0x7efea81069c0 2024-02-05T07:18:46.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efead60c700 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7efea81a7e50 con 0x7efea8109870 2024-02-05T07:18:46.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efea77fe700 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7efea810d440 0x7efea81a4130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:47266/0 (socket says 172.21.15.184:47266) 2024-02-05T07:18:46.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efea77fe700 1 -- 172.21.15.184:0/2878723313 learned_addr learned my addr 172.21.15.184:0/2878723313 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:18:46.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efea67fc700 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7efea8109870 0x7efea81a07f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:37508/0 (socket says 172.21.15.184:37508) 2024-02-05T07:18:46.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525105071 0 0) 0x7efea81a5a70 con 0x7efea810d440 2024-02-05T07:18:46.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe900035b0 con 0x7efea810d440 2024-02-05T07:18:46.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384978246 0 0) 0x7efea81a7e50 con 0x7efea8109870 2024-02-05T07:18:46.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efea81a5a70 con 0x7efea8109870 2024-02-05T07:18:46.838 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 898407239 0 0) 0x7efea81a6c50 con 0x7efea81069c0 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efea81a7e50 con 0x7efea81069c0 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3730883390 0 0) 0x7efea81a5a70 con 0x7efea8109870 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efea81a6c50 con 0x7efea8109870 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.834+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7efe9c003680 con 0x7efea8109870 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.835+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1409432058 0 0) 0x7efe900035b0 con 0x7efea810d440 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.835+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efea81a5a70 con 0x7efea810d440 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.835+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2581081087 0 0) 0x7efea81a7e50 con 0x7efea81069c0 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.835+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7efe900035b0 con 0x7efea81069c0 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.835+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7efe98001870 con 0x7efea810d440 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.835+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7efea0001bd0 con 0x7efea81069c0 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.835+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3593540135 0 0) 0x7efea81a6c50 con 0x7efea8109870 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.835+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 >> v1:172.21.15.188:6789/0 conn(0x7efea81069c0 legacy=0x7efea810cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.835+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 >> v1:172.21.15.184:6789/0 conn(0x7efea810d440 legacy=0x7efea81a4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.835+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea81a9050 con 0x7efea8109870 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.835+0000 7efead60c700 1 -- 172.21.15.184:0/2878723313 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea81a5c60 con 0x7efea8109870 2024-02-05T07:18:46.839 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.835+0000 7efead60c700 1 -- 172.21.15.184:0/2878723313 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7efea81a60e0 con 0x7efea8109870 2024-02-05T07:18:46.840 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.835+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7efe9c003910 con 0x7efea8109870 2024-02-05T07:18:46.840 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.835+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7efe9c004e60 con 0x7efea8109870 2024-02-05T07:18:46.840 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.836+0000 7efead60c700 1 -- 172.21.15.184:0/2878723313 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe94005150 con 0x7efea8109870 2024-02-05T07:18:46.840 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.836+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7efe9c005060 con 0x7efea8109870 2024-02-05T07:18:46.840 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.837+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6259+0+0 (unknown 2163206862 0 0) 0x7efe9c088a00 con 0x7efea8109870 2024-02-05T07:18:46.843 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:46.841+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7efe9c055d00 con 0x7efea8109870 2024-02-05T07:18:47.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:47.080+0000 7efead60c700 1 -- 172.21.15.184:0/2878723313 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efe94005980 con 0x7efea8109870 2024-02-05T07:18:47.083 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:47.081+0000 7efe8ffff700 1 -- 172.21.15.184:0/2878723313 <== mon.2 v1:172.21.15.184:6790/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7efe9c054070 con 0x7efea8109870 2024-02-05T07:18:47.083 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-05T07:18:47.083 INFO:teuthology.orchestra.run.smithi184.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-05T07:18:47.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:47.083+0000 7efead60c700 1 -- 172.21.15.184:0/2878723313 >> v1:172.21.15.184:6800/103463156 conn(0x7efe90070d60 legacy=0x7efe90073220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:47.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:47.083+0000 7efead60c700 1 -- 172.21.15.184:0/2878723313 >> v1:172.21.15.184:6790/0 conn(0x7efea8109870 legacy=0x7efea81a07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:18:47.085 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:47.083+0000 7efead60c700 1 -- 172.21.15.184:0/2878723313 shutdown_connections 2024-02-05T07:18:47.086 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:47.083+0000 7efead60c700 1 -- 172.21.15.184:0/2878723313 >> 172.21.15.184:0/2878723313 conn(0x7efea80fc4b0 msgr2=0x7efea81109a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:18:47.086 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:47.083+0000 7efead60c700 1 -- 172.21.15.184:0/2878723313 shutdown_connections 2024-02-05T07:18:47.086 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-05T07:18:47.083+0000 7efead60c700 1 -- 172.21.15.184:0/2878723313 wait complete. 2024-02-05T07:18:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:47 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2878723313' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-05T07:18:47.499 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:18:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:18:47.754 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:47 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2878723313' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-05T07:18:47.755 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:47 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2878723313' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-05T07:18:47.783 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-05T07:18:47.784 INFO:tasks.cephadm:Setup complete, yielding 2024-02-05T07:18:47.784 INFO:teuthology.run_tasks:Running task workunit... 2024-02-05T07:18:47.799 INFO:tasks.workunit:Pulling workunits from ref 164d3be4a527be775f4d3c343ea591122f1b8921 2024-02-05T07:18:47.799 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-05T07:18:47.799 DEBUG:teuthology.orchestra.run.smithi184:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-05T07:18:47.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-05T07:18:47.815 INFO:teuthology.orchestra.run.smithi184.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-02-05T07:18:47.816 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-02-05T07:18:47.870 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-02-05T07:18:47.871 DEBUG:teuthology.orchestra.run.smithi184:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-02-05T07:18:47.925 INFO:tasks.workunit:timeout=3h 2024-02-05T07:18:47.925 INFO:tasks.workunit:cleanup=True 2024-02-05T07:18:47.926 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 164d3be4a527be775f4d3c343ea591122f1b8921 2024-02-05T07:18:47.981 INFO:tasks.workunit.client.0.smithi184.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-05T07:18:48.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:48 smithi188 ceph-mon[33283]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:48.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:48 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:48.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:48 smithi184 ceph-mon[29861]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:48.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:48 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:48.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:48 smithi184 ceph-mon[41609]: pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:48.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:48 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:49.499 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 systemd[1]: Starting Ceph grafana.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:18:49.857 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 podman[66281]: 2024-02-05 07:18:49.454369361 +0000 UTC m=+0.017293164 image pull a0ea5e3c46d9434bd173d585b7c2638c7451eaf2543d1d22f9e78442615aaffb quay.io/ceph/ceph-grafana:9.4.12 2024-02-05T07:18:49.857 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 podman[66281]: 2024-02-05 07:18:49.561939042 +0000 UTC m=+0.124862886 container create a412a87495cad195f6392b37fdb58b410ab1011e034963ced44a054ec2c9e2f9 (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Paul Cuzner , io.openshift.expose-services=, distribution-scope=public, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., io.buildah.version=1.32.0, build-date=2022-04-29T11:48:11.055897, io.k8s.display-name=Red Hat Universal Base Image 8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, release=239.1651231664, io.openshift.tags=base rhel8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, com.redhat.component=ubi8-container, summary=Grafana Container configured for Ceph mgr/dashboard integration, vcs-type=git, description=Ceph Grafana Container, name=ubi8, architecture=x86_64, version=8.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI) 2024-02-05T07:18:49.857 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 podman[66281]: 2024-02-05 07:18:49.780764932 +0000 UTC m=+0.343688732 container init a412a87495cad195f6392b37fdb58b410ab1011e034963ced44a054ec2c9e2f9 (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a, vcs-type=git, name=ubi8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, version=8.5, io.k8s.display-name=Red Hat Universal Base Image 8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.component=ubi8-container, build-date=2022-04-29T11:48:11.055897, distribution-scope=public, io.openshift.tags=base rhel8, description=Ceph Grafana Container, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, io.buildah.version=1.32.0, maintainer=Paul Cuzner , vendor=Red Hat, Inc., release=239.1651231664) 2024-02-05T07:18:49.857 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 podman[66281]: 2024-02-05 07:18:49.786230543 +0000 UTC m=+0.349154346 container start a412a87495cad195f6392b37fdb58b410ab1011e034963ced44a054ec2c9e2f9 (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a, version=8.5, io.k8s.display-name=Red Hat Universal Base Image 8, vcs-type=git, name=ubi8, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.component=ubi8-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Paul Cuzner , distribution-scope=public, io.openshift.expose-services=, io.openshift.tags=base rhel8, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.32.0, vendor=Red Hat, Inc., release=239.1651231664, description=Ceph Grafana Container, architecture=x86_64, build-date=2022-04-29T11:48:11.055897, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI) 2024-02-05T07:18:49.857 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 bash[66281]: a412a87495cad195f6392b37fdb58b410ab1011e034963ced44a054ec2c9e2f9 2024-02-05T07:18:50.109 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 systemd[1]: Started Ceph grafana.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:18:50.109 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=settings t=2024-02-05T07:18:49.937991415Z level=info msg="Starting Grafana" version=9.4.12 commit=37ee25ba46 branch=HEAD compiled=2023-05-22T15:58:05Z 2024-02-05T07:18:50.109 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=settings t=2024-02-05T07:18:49.938198168Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-02-05T07:18:50.109 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=settings t=2024-02-05T07:18:49.938222981Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-02-05T07:18:50.109 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=settings t=2024-02-05T07:18:49.938230844Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-02-05T07:18:50.109 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=settings t=2024-02-05T07:18:49.938236764Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-02-05T07:18:50.109 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=settings t=2024-02-05T07:18:49.938242718Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-02-05T07:18:50.109 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=settings t=2024-02-05T07:18:49.938248327Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-02-05T07:18:50.109 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=settings t=2024-02-05T07:18:49.938253928Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-02-05T07:18:50.109 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=settings t=2024-02-05T07:18:49.938259633Z level=info msg="Path Home" path=/usr/share/grafana 2024-02-05T07:18:50.110 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=settings t=2024-02-05T07:18:49.938264992Z level=info msg="Path Data" path=/var/lib/grafana 2024-02-05T07:18:50.110 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=settings t=2024-02-05T07:18:49.938270202Z level=info msg="Path Logs" path=/var/log/grafana 2024-02-05T07:18:50.110 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=settings t=2024-02-05T07:18:49.938275376Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-02-05T07:18:50.110 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=settings t=2024-02-05T07:18:49.938280769Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-02-05T07:18:50.110 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=settings t=2024-02-05T07:18:49.938286258Z level=info msg="App mode production" 2024-02-05T07:18:50.110 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=sqlstore t=2024-02-05T07:18:49.93833Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-02-05T07:18:50.110 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=sqlstore t=2024-02-05T07:18:49.938345465Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-02-05T07:18:50.110 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.939166253Z level=info msg="Starting DB migrations" 2024-02-05T07:18:50.110 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.939238857Z level=info msg="Executing migration" id="create migration_log table" 2024-02-05T07:18:50.110 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.939746308Z level=info msg="Executing migration" id="create user table" 2024-02-05T07:18:50.110 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.940158288Z level=info msg="Executing migration" id="add unique index user.login" 2024-02-05T07:18:50.110 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.940579331Z level=info msg="Executing migration" id="add unique index user.email" 2024-02-05T07:18:50.111 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.941005403Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-02-05T07:18:50.111 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.941672192Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-02-05T07:18:50.111 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.942066333Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-02-05T07:18:50.111 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.942774855Z level=info msg="Executing migration" id="create user table v2" 2024-02-05T07:18:50.111 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.943184103Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-02-05T07:18:50.111 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.943606098Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-02-05T07:18:50.112 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.944042203Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-02-05T07:18:50.112 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.944427312Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-02-05T07:18:50.112 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.94476613Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-02-05T07:18:50.112 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.946768972Z level=info msg="Executing migration" id="Update user table charset" 2024-02-05T07:18:50.112 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.94711479Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-02-05T07:18:50.112 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.947543869Z level=info msg="Executing migration" id="Add missing user data" 2024-02-05T07:18:50.112 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.947881629Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-02-05T07:18:50.112 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.948322328Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-02-05T07:18:50.112 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.948735108Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-02-05T07:18:50.112 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.949135545Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-02-05T07:18:50.113 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.950308135Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-02-05T07:18:50.113 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.953408665Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-02-05T07:18:50.113 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.953857777Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-02-05T07:18:50.114 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.954271256Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-02-05T07:18:50.114 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.957088122Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-02-05T07:18:50.114 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.959528887Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-02-05T07:18:50.114 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.962342157Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-02-05T07:18:50.114 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.965103183Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-02-05T07:18:50.114 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.967613073Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-02-05T07:18:50.114 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.970132827Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-02-05T07:18:50.114 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.970523511Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-02-05T07:18:50.114 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.973184335Z level=info msg="Executing migration" id="create temp_user v2" 2024-02-05T07:18:50.114 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.97588898Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-02-05T07:18:50.114 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.978641684Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-02-05T07:18:50.114 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.979060261Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-02-05T07:18:50.114 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.981858926Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-02-05T07:18:50.115 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.984633813Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-02-05T07:18:50.115 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.98742067Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-02-05T07:18:50.115 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.988042921Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-02-05T07:18:50.115 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.988817889Z level=info msg="Executing migration" id="create star table" 2024-02-05T07:18:50.115 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.98971688Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-02-05T07:18:50.115 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.990435839Z level=info msg="Executing migration" id="create org table v1" 2024-02-05T07:18:50.115 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.991338179Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-02-05T07:18:50.115 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.991959093Z level=info msg="Executing migration" id="create org_user table v1" 2024-02-05T07:18:50.115 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.992936398Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-02-05T07:18:50.115 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.993569784Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-02-05T07:18:50.115 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.99457309Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-02-05T07:18:50.115 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.995142117Z level=info msg="Executing migration" id="Update org table charset" 2024-02-05T07:18:50.115 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.995941403Z level=info msg="Executing migration" id="Update org_user table charset" 2024-02-05T07:18:50.115 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.996838852Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-02-05T07:18:50.116 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.99753504Z level=info msg="Executing migration" id="create dashboard table" 2024-02-05T07:18:50.116 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.998428102Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-02-05T07:18:50.116 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.999142519Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-02-05T07:18:50.116 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:49.999998275Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-02-05T07:18:50.116 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.000828314Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-02-05T07:18:50.116 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.001503941Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-02-05T07:18:50.116 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.002330821Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-02-05T07:18:50.116 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.003275525Z level=info msg="Executing migration" id="create dashboard v2" 2024-02-05T07:18:50.116 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.004096884Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-02-05T07:18:50.116 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.004893661Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-02-05T07:18:50.116 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.005820949Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-02-05T07:18:50.116 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.006556562Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-02-05T07:18:50.116 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.007337053Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-02-05T07:18:50.117 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.008141431Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-02-05T07:18:50.117 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.008927242Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-02-05T07:18:50.117 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.009716103Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-02-05T07:18:50.117 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.010519456Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-02-05T07:18:50.117 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.011326194Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-02-05T07:18:50.117 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.012278962Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-02-05T07:18:50.117 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.012941105Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-02-05T07:18:50.117 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.013745785Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-02-05T07:18:50.117 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.014664471Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-02-05T07:18:50.117 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.015348444Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-02-05T07:18:50.118 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.01824505Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-02-05T07:18:50.118 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.020685083Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-02-05T07:18:50.118 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.023446571Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-02-05T07:18:50.118 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.026192462Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-02-05T07:18:50.118 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.028999025Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-02-05T07:18:50.118 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.03165812Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-02-05T07:18:50.119 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.034278272Z level=info msg="Executing migration" id="Update dashboard title length" 2024-02-05T07:18:50.119 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.037074156Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-02-05T07:18:50.119 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.039807282Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-02-05T07:18:50.119 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.042356239Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-02-05T07:18:50.119 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.045199114Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-02-05T07:18:50.119 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.047948467Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-02-05T07:18:50.120 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.050578097Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-02-05T07:18:50.120 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.053309739Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-02-05T07:18:50.120 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.055851296Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-02-05T07:18:50.120 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.058520767Z level=info msg="Executing migration" id="Add check_sum column" 2024-02-05T07:18:50.120 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.061318323Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-02-05T07:18:50.120 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.064086939Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-02-05T07:18:50.121 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.066390656Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-02-05T07:18:50.121 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.069088869Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-02-05T07:18:50.121 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.071704766Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-02-05T07:18:50.121 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.074117903Z level=info msg="Executing migration" id="create data_source table" 2024-02-05T07:18:50.121 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.076775772Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-02-05T07:18:50.121 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.079158015Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-02-05T07:18:50.122 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.081918201Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-02-05T07:18:50.122 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.084432396Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-02-05T07:18:50.122 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.086720092Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-02-05T07:18:50.122 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.089377936Z level=info msg="Executing migration" id="create data_source table v2" 2024-02-05T07:18:50.122 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.091911304Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-02-05T07:18:50.122 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.094300708Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-02-05T07:18:50.123 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.0968183Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-02-05T07:18:50.123 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.099444679Z level=info msg="Executing migration" id="Add column with_credentials" 2024-02-05T07:18:50.123 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.101987153Z level=info msg="Executing migration" id="Add secure json data column" 2024-02-05T07:18:50.123 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.104486811Z level=info msg="Executing migration" id="Update data_source table charset" 2024-02-05T07:18:50.123 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.106983577Z level=info msg="Executing migration" id="Update initial version to 1" 2024-02-05T07:18:50.123 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.107632393Z level=info msg="Executing migration" id="Add read_only data column" 2024-02-05T07:18:50.124 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.108417297Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-02-05T07:18:50.124 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.109178408Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-02-05T07:18:50.124 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.109959772Z level=info msg="Executing migration" id="Add uid column" 2024-02-05T07:18:50.359 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-mon[33283]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:50.359 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:50.359 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:50.360 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:50.360 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:50.360 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.110791432Z level=info msg="Executing migration" id="Update uid value" 2024-02-05T07:18:50.360 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.111535009Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-02-05T07:18:50.360 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.111988601Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-02-05T07:18:50.360 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.112442993Z level=info msg="Executing migration" id="create api_key table" 2024-02-05T07:18:50.361 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.11321089Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-02-05T07:18:50.361 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.113993995Z level=info msg="Executing migration" id="add index api_key.key" 2024-02-05T07:18:50.361 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.114770678Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-02-05T07:18:50.361 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.11556029Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-02-05T07:18:50.361 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.116360744Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-02-05T07:18:50.361 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.116799904Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-02-05T07:18:50.361 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.117654331Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-02-05T07:18:50.361 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.11877963Z level=info msg="Executing migration" id="create api_key table v2" 2024-02-05T07:18:50.361 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.119557369Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-02-05T07:18:50.361 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.120054252Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-02-05T07:18:50.361 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.120810286Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-02-05T07:18:50.361 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.121712046Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-02-05T07:18:50.361 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.122448187Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-02-05T07:18:50.361 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.123218725Z level=info msg="Executing migration" id="Update api_key table charset" 2024-02-05T07:18:50.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.123997733Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-02-05T07:18:50.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.124786442Z level=info msg="Executing migration" id="Add service account foreign key" 2024-02-05T07:18:50.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.125560797Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-02-05T07:18:50.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.1259102Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-02-05T07:18:50.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.126803227Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-02-05T07:18:50.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.127621986Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-02-05T07:18:50.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.128505927Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-02-05T07:18:50.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.129073659Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-02-05T07:18:50.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.129879459Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-02-05T07:18:50.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.130637882Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-02-05T07:18:50.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.13146512Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-02-05T07:18:50.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.131942765Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-02-05T07:18:50.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.132884343Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-02-05T07:18:50.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.135546637Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-02-05T07:18:50.362 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.137970368Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-02-05T07:18:50.363 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.138610053Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-02-05T07:18:50.363 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.139424439Z level=info msg="Executing migration" id="create quota table v1" 2024-02-05T07:18:50.363 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.139833064Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-02-05T07:18:50.363 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.140264063Z level=info msg="Executing migration" id="Update quota table charset" 2024-02-05T07:18:50.363 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.14055448Z level=info msg="Executing migration" id="create plugin_setting table" 2024-02-05T07:18:50.364 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.141037062Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-02-05T07:18:50.364 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.141948325Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-02-05T07:18:50.364 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.142721638Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-02-05T07:18:50.365 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.142984867Z level=info msg="Executing migration" id="create session table" 2024-02-05T07:18:50.365 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.143507151Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-02-05T07:18:50.365 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.143771358Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-02-05T07:18:50.365 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.144052679Z level=info msg="Executing migration" id="create playlist table v2" 2024-02-05T07:18:50.365 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.144473617Z level=info msg="Executing migration" id="create playlist item table v2" 2024-02-05T07:18:50.365 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.145270509Z level=info msg="Executing migration" id="Update playlist table charset" 2024-02-05T07:18:50.365 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.146023805Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-02-05T07:18:50.365 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.146368766Z level=info msg="Executing migration" id="drop preferences table v2" 2024-02-05T07:18:50.365 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.146630601Z level=info msg="Executing migration" id="drop preferences table v3" 2024-02-05T07:18:50.365 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.146903542Z level=info msg="Executing migration" id="create preferences table v3" 2024-02-05T07:18:50.365 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.147288014Z level=info msg="Executing migration" id="Update preferences table charset" 2024-02-05T07:18:50.365 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.148094643Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-02-05T07:18:50.365 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.148698485Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-02-05T07:18:50.366 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.148984825Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-02-05T07:18:50.366 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.149628889Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-02-05T07:18:50.366 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.150231495Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-02-05T07:18:50.366 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.151062065Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-02-05T07:18:50.366 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.151510024Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-02-05T07:18:50.366 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.152349709Z level=info msg="Executing migration" id="create alert table v1" 2024-02-05T07:18:50.366 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.152810304Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-02-05T07:18:50.366 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.153627718Z level=info msg="Executing migration" id="add index alert state" 2024-02-05T07:18:50.366 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.154499371Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-02-05T07:18:50.366 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.155082227Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-02-05T07:18:50.366 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.155512133Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-02-05T07:18:50.366 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.15595286Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-02-05T07:18:50.366 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.156339224Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-02-05T07:18:50.366 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.157796804Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-02-05T07:18:50.367 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.158186253Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-02-05T07:18:50.367 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.158637345Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-02-05T07:18:50.367 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.158926252Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-02-05T07:18:50.367 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.159280615Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-02-05T07:18:50.367 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.159679405Z level=info msg="Executing migration" id="Add column is_default" 2024-02-05T07:18:50.367 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.160310962Z level=info msg="Executing migration" id="Add column frequency" 2024-02-05T07:18:50.367 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.160922705Z level=info msg="Executing migration" id="Add column send_reminder" 2024-02-05T07:18:50.367 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.161572747Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-02-05T07:18:50.367 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.162219059Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-02-05T07:18:50.367 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.162656277Z level=info msg="Executing migration" id="Update alert table charset" 2024-02-05T07:18:50.367 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.162914534Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-02-05T07:18:50.368 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.163217826Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-02-05T07:18:50.368 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.163623548Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-02-05T07:18:50.368 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.164029972Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-02-05T07:18:50.368 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.164487502Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-02-05T07:18:50.368 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.164872779Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-02-05T07:18:50.368 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.165286809Z level=info msg="Executing migration" id="Add for to alert table" 2024-02-05T07:18:50.368 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.165902793Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-02-05T07:18:50.368 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.166564576Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-02-05T07:18:50.368 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.166876131Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-02-05T07:18:50.368 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.167347785Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-02-05T07:18:50.368 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.167755381Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-02-05T07:18:50.368 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.168421188Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-02-05T07:18:50.368 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.168718825Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-02-05T07:18:50.369 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.169107573Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-02-05T07:18:50.369 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.169540591Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-02-05T07:18:50.369 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.16981705Z level=info msg="Executing migration" id="create annotation table v5" 2024-02-05T07:18:50.369 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.170251904Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-02-05T07:18:50.369 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.170666569Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-02-05T07:18:50.369 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.171082044Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-02-05T07:18:50.369 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.171515722Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-02-05T07:18:50.369 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.171989023Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-02-05T07:18:50.369 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.172820013Z level=info msg="Executing migration" id="Update annotation table charset" 2024-02-05T07:18:50.369 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.173123537Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-02-05T07:18:50.369 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.173839836Z level=info msg="Executing migration" id="Drop category_id index" 2024-02-05T07:18:50.369 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.174683341Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-02-05T07:18:50.369 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.175529666Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-02-05T07:18:50.369 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.17646379Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-02-05T07:18:50.369 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.176963989Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-02-05T07:18:50.370 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.177791654Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-02-05T07:18:50.370 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.179458627Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-02-05T07:18:50.370 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.182308069Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-02-05T07:18:50.370 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.185268792Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-02-05T07:18:50.370 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.187615666Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-02-05T07:18:50.370 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.190511879Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-02-05T07:18:50.370 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.193260564Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-02-05T07:18:50.370 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.195899226Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-02-05T07:18:50.370 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.198794487Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-02-05T07:18:50.370 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.201406992Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-02-05T07:18:50.370 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.20419409Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-02-05T07:18:50.370 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.206926868Z level=info msg="Executing migration" id="Add epoch_end column" 2024-02-05T07:18:50.370 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.209467581Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-02-05T07:18:50.370 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.212177098Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-02-05T07:18:50.371 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.214787487Z level=info msg="Executing migration" id="Move region to single row" 2024-02-05T07:18:50.371 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.217598162Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-02-05T07:18:50.371 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.220215642Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-02-05T07:18:50.371 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.223096482Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-02-05T07:18:50.371 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.225805442Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-02-05T07:18:50.371 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.228431521Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-02-05T07:18:50.371 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.231225519Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-02-05T07:18:50.371 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.233889031Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-02-05T07:18:50.371 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.236329931Z level=info msg="Executing migration" id="create test_data table" 2024-02-05T07:18:50.371 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.239217423Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-02-05T07:18:50.371 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.239762019Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-02-05T07:18:50.371 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.242472805Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-02-05T07:18:50.371 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.245297897Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-02-05T07:18:50.371 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.247673469Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-02-05T07:18:50.371 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.250438319Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-02-05T07:18:50.372 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.253114486Z level=info msg="Executing migration" id="create team table" 2024-02-05T07:18:50.372 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.255784448Z level=info msg="Executing migration" id="add index team.org_id" 2024-02-05T07:18:50.372 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.258401247Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-02-05T07:18:50.372 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.261006243Z level=info msg="Executing migration" id="create team member table" 2024-02-05T07:18:50.372 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.26376095Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-02-05T07:18:50.372 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.266414276Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-02-05T07:18:50.372 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.269230138Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-02-05T07:18:50.372 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.271777958Z level=info msg="Executing migration" id="Add column email to team table" 2024-02-05T07:18:50.372 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.274336892Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-02-05T07:18:50.372 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.275113086Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-02-05T07:18:50.372 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.275907701Z level=info msg="Executing migration" id="create dashboard acl table" 2024-02-05T07:18:50.372 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.276693811Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-02-05T07:18:50.372 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.277606769Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-02-05T07:18:50.372 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.278136105Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-02-05T07:18:50.373 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.27857112Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-02-05T07:18:50.373 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.279415177Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-02-05T07:18:50.373 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.280214408Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-02-05T07:18:50.373 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.280686296Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-02-05T07:18:50.373 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.281565986Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-02-05T07:18:50.373 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.282310457Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-02-05T07:18:50.373 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.283110615Z level=info msg="Executing migration" id="create tag table" 2024-02-05T07:18:50.373 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.283497456Z level=info msg="Executing migration" id="add index tag.key_value" 2024-02-05T07:18:50.373 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.284280304Z level=info msg="Executing migration" id="create login attempt table" 2024-02-05T07:18:50.373 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.285257512Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-02-05T07:18:50.373 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.285905727Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-02-05T07:18:50.373 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.286392855Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-02-05T07:18:50.373 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.28830761Z level=info msg="Executing migration" id="create login_attempt v2" 2024-02-05T07:18:50.373 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.289262Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-02-05T07:18:50.374 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.289977756Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-02-05T07:18:50.374 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.29032037Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-02-05T07:18:50.374 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.291169365Z level=info msg="Executing migration" id="create user auth table" 2024-02-05T07:18:50.374 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.291942931Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-02-05T07:18:50.374 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.292728738Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-02-05T07:18:50.374 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.293058791Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-02-05T07:18:50.374 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.293857626Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-02-05T07:18:50.374 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.296728679Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-02-05T07:18:50.374 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.299155087Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-02-05T07:18:50.374 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.300003007Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-02-05T07:18:50.374 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.302852403Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-02-05T07:18:50.374 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.305723306Z level=info msg="Executing migration" id="create server_lock table" 2024-02-05T07:18:50.374 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.308233904Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-02-05T07:18:50.374 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.308683567Z level=info msg="Executing migration" id="create user auth token table" 2024-02-05T07:18:50.375 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.311468548Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-02-05T07:18:50.375 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.314265451Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-02-05T07:18:50.375 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.316686994Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-02-05T07:18:50.375 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.317130112Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-02-05T07:18:50.375 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.319945945Z level=info msg="Executing migration" id="create cache_data table" 2024-02-05T07:18:50.375 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.322787973Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-02-05T07:18:50.375 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.325291524Z level=info msg="Executing migration" id="create short_url table v1" 2024-02-05T07:18:50.375 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.325729016Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-02-05T07:18:50.375 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.328381408Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-02-05T07:18:50.375 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.331081871Z level=info msg="Executing migration" id="delete alert_definition table" 2024-02-05T07:18:50.375 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.333758687Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-02-05T07:18:50.375 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.334231969Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-02-05T07:18:50.375 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.336905233Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-02-05T07:18:50.375 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.339384849Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-02-05T07:18:50.376 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.341963209Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-02-05T07:18:50.376 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.342393694Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-02-05T07:18:50.376 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.345015107Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-02-05T07:18:50.376 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.345534894Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-02-05T07:18:50.376 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.347544195Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-02-05T07:18:50.376 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.350253498Z level=info msg="Executing migration" id="drop alert_definition table" 2024-02-05T07:18:50.376 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.350764019Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-02-05T07:18:50.376 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.353570978Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-02-05T07:18:50.376 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.354224606Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-02-05T07:18:50.376 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.355947724Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-02-05T07:18:50.376 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.358398059Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-02-05T07:18:50.376 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.358837048Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-02-05T07:18:50.376 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.361371556Z level=info msg="Executing migration" id="create alert_instance table" 2024-02-05T07:18:50.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:50 smithi184 ceph-mon[41609]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:50.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:50 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:50.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:50 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:50.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:50 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:50.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:50 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:50 smithi184 ceph-mon[29861]: pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:50 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:50 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:50 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:50.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:50 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:50.635 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.363772184Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-02-05T07:18:50.635 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.364532797Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-02-05T07:18:50.635 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.364955047Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-02-05T07:18:50.636 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.365744824Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-02-05T07:18:50.636 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.366460323Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-02-05T07:18:50.636 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.367248038Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-02-05T07:18:50.636 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.370646451Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-02-05T07:18:50.636 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.373988045Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-02-05T07:18:50.636 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.374825186Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-02-05T07:18:50.636 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.375453601Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-02-05T07:18:50.636 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.376338824Z level=info msg="Executing migration" id="create alert_rule table" 2024-02-05T07:18:50.636 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.37710786Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-02-05T07:18:50.636 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.377847715Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-02-05T07:18:50.636 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.378654433Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-02-05T07:18:50.636 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.379126067Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-02-05T07:18:50.637 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.379806807Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-02-05T07:18:50.637 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.380675065Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-02-05T07:18:50.637 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.38155248Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-02-05T07:18:50.637 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.382427662Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-02-05T07:18:50.637 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.383221418Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-02-05T07:18:50.637 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.38413781Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-02-05T07:18:50.637 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.384993542Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-02-05T07:18:50.637 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.385840118Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-02-05T07:18:50.637 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.387057278Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-02-05T07:18:50.637 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.387879373Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-02-05T07:18:50.637 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.388708889Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-02-05T07:18:50.637 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.38901433Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-02-05T07:18:50.637 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.389934404Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-02-05T07:18:50.637 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.390601012Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-02-05T07:18:50.638 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.391423409Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-02-05T07:18:50.638 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.391728579Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-02-05T07:18:50.638 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.392606986Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-02-05T07:18:50.638 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.393426783Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-02-05T07:18:50.638 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.39426919Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-02-05T07:18:50.638 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.395100659Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-02-05T07:18:50.639 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.395926671Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-02-05T07:18:50.639 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.398593431Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-02-05T07:18:50.639 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.401361572Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-02-05T07:18:50.639 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.402210965Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-02-05T07:18:50.639 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.404906677Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-02-05T07:18:50.639 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.407799944Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-02-05T07:18:50.639 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.41038284Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-02-05T07:18:50.639 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.411491912Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-02-05T07:18:50.640 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.414150505Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-02-05T07:18:50.640 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.41696607Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-02-05T07:18:50.640 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.419843204Z level=info msg="Executing migration" id="create provenance_type table" 2024-02-05T07:18:50.640 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.420293466Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-02-05T07:18:50.640 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.423108968Z level=info msg="Executing migration" id="create alert_image table" 2024-02-05T07:18:50.640 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.425642916Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-02-05T07:18:50.640 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.428195279Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-02-05T07:18:50.640 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.428496724Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-02-05T07:18:50.640 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.4312594Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-02-05T07:18:50.640 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.433998413Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-02-05T07:18:50.640 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.43408544Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-02-05T07:18:50.640 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.436700574Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-02-05T07:18:50.640 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.437089014Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-02-05T07:18:50.640 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.439579414Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.439715403Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.4398213Z level=info msg="alerts found to migrate" alerts=0 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.442086834Z level=info msg="Executing migration" id="create library_element table v1" 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.444380917Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.444924644Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.447494407Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.449952724Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.452340079Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.452649279Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.455159248Z level=info msg="Executing migration" id="create data_keys table" 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.455585254Z level=info msg="Executing migration" id="create secrets table" 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.457867493Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.462187967Z level=info msg="Executing migration" id="add name column into data_keys" 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.463094206Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.465552299Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-02-05T07:18:50.641 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.469816892Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-02-05T07:18:50.642 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.474232332Z level=info msg="Executing migration" id="create kv_store table v1" 2024-02-05T07:18:50.642 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.47464315Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-02-05T07:18:50.642 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.475433154Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-02-05T07:18:50.642 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.476296482Z level=info msg="Executing migration" id="create permission table" 2024-02-05T07:18:50.642 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.476918498Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-02-05T07:18:50.642 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.477358343Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-02-05T07:18:50.642 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.478090328Z level=info msg="Executing migration" id="create role table" 2024-02-05T07:18:50.642 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.478840569Z level=info msg="Executing migration" id="add column display_name" 2024-02-05T07:18:50.642 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.479784842Z level=info msg="Executing migration" id="add column group_name" 2024-02-05T07:18:50.642 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.480724392Z level=info msg="Executing migration" id="add index role.org_id" 2024-02-05T07:18:50.642 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.481638931Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-02-05T07:18:50.642 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.482271458Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-02-05T07:18:50.642 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.483081552Z level=info msg="Executing migration" id="create team role table" 2024-02-05T07:18:50.642 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.483488937Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-02-05T07:18:50.643 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.484254173Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-02-05T07:18:50.643 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.485154901Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-02-05T07:18:50.643 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.485828873Z level=info msg="Executing migration" id="create user role table" 2024-02-05T07:18:50.643 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.486222633Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-02-05T07:18:50.643 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.487049937Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-02-05T07:18:50.643 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.487931384Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-02-05T07:18:50.643 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.488628321Z level=info msg="Executing migration" id="create builtin role table" 2024-02-05T07:18:50.643 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.489069814Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-02-05T07:18:50.643 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.489901337Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-02-05T07:18:50.643 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.490922197Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-02-05T07:18:50.643 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.491923332Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-02-05T07:18:50.643 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.492407418Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-02-05T07:18:50.643 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.493184454Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-02-05T07:18:50.643 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.493596736Z level=info msg="Executing migration" id="add unique index role.uid" 2024-02-05T07:18:50.643 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.493989581Z level=info msg="Executing migration" id="create seed assignment table" 2024-02-05T07:18:50.644 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.494469901Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-02-05T07:18:50.644 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.494929119Z level=info msg="Executing migration" id="add column hidden to role table" 2024-02-05T07:18:50.644 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.495926472Z level=info msg="Executing migration" id="create query_history table v1" 2024-02-05T07:18:50.644 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.496374088Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-02-05T07:18:50.644 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.496830937Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-02-05T07:18:50.644 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.497120844Z level=info msg="Executing migration" id="teams permissions migration" 2024-02-05T07:18:50.644 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.497563415Z level=info msg="Executing migration" id="dashboard permissions" 2024-02-05T07:18:50.644 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.498005169Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-02-05T07:18:50.644 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.498403869Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-02-05T07:18:50.644 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.498708147Z level=info msg="Executing migration" id="alerting notification permissions" 2024-02-05T07:18:50.644 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.499097188Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-02-05T07:18:50.644 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.49951296Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-02-05T07:18:50.644 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.499963798Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-02-05T07:18:50.644 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.50095087Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-02-05T07:18:50.645 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.50129022Z level=info msg="Executing migration" id="create correlation table v1" 2024-02-05T07:18:50.645 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.501728854Z level=info msg="Executing migration" id="add index correlations.uid" 2024-02-05T07:18:50.645 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.502189114Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-02-05T07:18:50.645 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.502640798Z level=info msg="Executing migration" id="add correlation config column" 2024-02-05T07:18:50.645 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.503691954Z level=info msg="Executing migration" id="create entity_events table" 2024-02-05T07:18:50.645 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.504138088Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-02-05T07:18:50.645 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.504577375Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-02-05T07:18:50.645 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.504680215Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-02-05T07:18:50.645 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.504994087Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-02-05T07:18:50.645 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.505083572Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-02-05T07:18:50.645 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.505352026Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-02-05T07:18:50.645 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.505708018Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-02-05T07:18:50.645 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.506093144Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-02-05T07:18:50.645 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.506522386Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-02-05T07:18:50.646 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.50694322Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-02-05T07:18:50.646 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.507357912Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-02-05T07:18:50.646 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.507773289Z level=info msg="Executing migration" id="Drop public config table" 2024-02-05T07:18:50.646 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.508138476Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-02-05T07:18:50.646 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.508560561Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-02-05T07:18:50.646 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.508958454Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-02-05T07:18:50.646 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.509409214Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-02-05T07:18:50.646 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.509832987Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-02-05T07:18:50.647 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.512849294Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-02-05T07:18:50.647 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.513878281Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-02-05T07:18:50.647 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.51490113Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-02-05T07:18:50.647 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.515228203Z level=info msg="Executing migration" id="add share column" 2024-02-05T07:18:50.647 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.516220459Z level=info msg="Executing migration" id="create default alerting folders" 2024-02-05T07:18:50.647 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.516664017Z level=info msg="Executing migration" id="create file table" 2024-02-05T07:18:50.648 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.517104534Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-02-05T07:18:50.648 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.517539785Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-02-05T07:18:50.648 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.517996368Z level=info msg="Executing migration" id="create file_meta table" 2024-02-05T07:18:50.648 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.518852922Z level=info msg="Executing migration" id="file table idx: path key" 2024-02-05T07:18:50.648 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.51971674Z level=info msg="Executing migration" id="set path collation in file table" 2024-02-05T07:18:50.649 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.520040485Z level=info msg="Executing migration" id="managed permissions migration" 2024-02-05T07:18:50.649 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.522859365Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-02-05T07:18:50.649 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.52539887Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-02-05T07:18:50.649 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.528017748Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-02-05T07:18:50.649 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.529075258Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-02-05T07:18:50.649 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.531912543Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-02-05T07:18:50.650 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.534846384Z level=info msg="Executing migration" id="update group index for alert rules" 2024-02-05T07:18:50.650 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.537155752Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-02-05T07:18:50.650 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.537488103Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-02-05T07:18:50.650 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.540252752Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-02-05T07:18:50.650 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.541348368Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-02-05T07:18:50.650 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.543021854Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-02-05T07:18:50.651 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.545662429Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-02-05T07:18:50.651 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.555351618Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-02-05T07:18:50.651 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.558201994Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-02-05T07:18:50.651 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.56092609Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-02-05T07:18:50.651 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.564325866Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-02-05T07:18:50.651 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.564648705Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-02-05T07:18:50.652 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.567400853Z level=info msg="Executing migration" id="create folder table" 2024-02-05T07:18:50.652 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.568143052Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-02-05T07:18:50.652 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.570058027Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-02-05T07:18:50.652 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.572791847Z level=info msg="Executing migration" id="Update folder title length" 2024-02-05T07:18:50.652 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.573114472Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-02-05T07:18:50.652 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=migrator t=2024-02-05T07:18:50.575754361Z level=info msg="migrations completed" performed=485 skipped=0 duration=636.536577ms 2024-02-05T07:18:50.653 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=sqlstore t=2024-02-05T07:18:50.576174146Z level=info msg="Created default organization" 2024-02-05T07:18:50.653 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=plugin.loader t=2024-02-05T07:18:50.63366278Z level=info msg="Plugin registered" pluginID=input 2024-02-05T07:18:50.999 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=plugin.loader t=2024-02-05T07:18:50.663493688Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2024-02-05T07:18:50.999 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=plugin.loader t=2024-02-05T07:18:50.663513036Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2024-02-05T07:18:50.999 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=secrets t=2024-02-05T07:18:50.66354771Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-02-05T07:18:51.000 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=query_data t=2024-02-05T07:18:50.665615108Z level=info msg="Query Service initialization" 2024-02-05T07:18:51.000 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=live.push_http t=2024-02-05T07:18:50.668482274Z level=info msg="Live Push Gateway initialization" 2024-02-05T07:18:51.187 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:51 smithi184 bash[79307]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-02-05T07:18:51.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:51 smithi188 ceph-mon[33283]: Deploying daemon node-exporter.a on smithi184 2024-02-05T07:18:51.499 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=infra.usagestats.collector t=2024-02-05T07:18:51.27074214Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-02-05T07:18:51.499 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=provisioning.datasources t=2024-02-05T07:18:51.271754963Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-02-05T07:18:51.499 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=provisioning.datasources t=2024-02-05T07:18:51.282796144Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-02-05T07:18:51.499 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=provisioning.alerting t=2024-02-05T07:18:51.293680224Z level=info msg="starting to provision alerting" 2024-02-05T07:18:51.499 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=provisioning.alerting t=2024-02-05T07:18:51.293702678Z level=info msg="finished to provision alerting" 2024-02-05T07:18:51.499 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=grafanaStorageLogger t=2024-02-05T07:18:51.293833717Z level=info msg="storage starting" 2024-02-05T07:18:51.499 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=ngalert.state.manager t=2024-02-05T07:18:51.29389285Z level=info msg="Warming state cache for startup" 2024-02-05T07:18:51.500 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=http.server t=2024-02-05T07:18:51.296264741Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-02-05T07:18:51.500 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=ngalert.state.manager t=2024-02-05T07:18:51.305517512Z level=info msg="State cache has been initialized" states=0 duration=11.623505ms 2024-02-05T07:18:51.500 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=ngalert.multiorg.alertmanager t=2024-02-05T07:18:51.305580632Z level=info msg="starting MultiOrg Alertmanager" 2024-02-05T07:18:51.500 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=ticker t=2024-02-05T07:18:51.305603704Z level=info msg=starting first_tick=2024-02-05T07:19:00Z 2024-02-05T07:18:51.500 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=sqlstore.transactions t=2024-02-05T07:18:51.31350734Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-02-05T07:18:51.500 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:18:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=sqlstore.transactions t=2024-02-05T07:18:51.324644165Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-02-05T07:18:51.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:51 smithi184 ceph-mon[29861]: Deploying daemon node-exporter.a on smithi184 2024-02-05T07:18:51.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:51 smithi184 ceph-mon[41609]: Deploying daemon node-exporter.a on smithi184 2024-02-05T07:18:51.881 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:51 smithi184 bash[79307]: Getting image source signatures 2024-02-05T07:18:51.881 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:51 smithi184 bash[79307]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-02-05T07:18:51.881 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:51 smithi184 bash[79307]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-02-05T07:18:51.881 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:51 smithi184 bash[79307]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-02-05T07:18:52.187 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:18:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:18:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:18:52.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:52 smithi188 ceph-mon[33283]: pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:52.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:52 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:52.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:52 smithi184 ceph-mon[29861]: pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:52.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:52 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:52.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:52 smithi184 ceph-mon[41609]: pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:52.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:52 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:53.445 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 bash[79307]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-02-05T07:18:53.445 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 bash[79307]: Writing manifest to image destination 2024-02-05T07:18:53.767 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 podman[79307]: 2024-02-05 07:18:53.390996419 +0000 UTC m=+2.372068364 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-02-05T07:18:53.768 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 podman[79307]: 2024-02-05 07:18:53.514634731 +0000 UTC m=+2.495706715 container create 2fa7beb4099097a81cf69646a005956d6e6a6fffa519ee58bd927c0605eb9cbf (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-02-05T07:18:54.022 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 podman[79307]: 2024-02-05 07:18:53.766420908 +0000 UTC m=+2.747492847 container init 2fa7beb4099097a81cf69646a005956d6e6a6fffa519ee58bd927c0605eb9cbf (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-02-05T07:18:54.022 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 podman[79307]: 2024-02-05 07:18:53.772026342 +0000 UTC m=+2.753098281 container start 2fa7beb4099097a81cf69646a005956d6e6a6fffa519ee58bd927c0605eb9cbf (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-02-05T07:18:54.022 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.776Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-02-05T07:18:54.022 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.776Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-02-05T07:18:54.022 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.776Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-02-05T07:18:54.022 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.776Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-05T07:18:54.022 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.776Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-02-05T07:18:54.023 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.776Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-02-05T07:18:54.023 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-02-05T07:18:54.023 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=arp 2024-02-05T07:18:54.023 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=bcache 2024-02-05T07:18:54.023 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=bonding 2024-02-05T07:18:54.023 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=btrfs 2024-02-05T07:18:54.023 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=conntrack 2024-02-05T07:18:54.023 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=cpu 2024-02-05T07:18:54.023 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-02-05T07:18:54.024 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=diskstats 2024-02-05T07:18:54.024 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=dmi 2024-02-05T07:18:54.024 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=edac 2024-02-05T07:18:54.024 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=entropy 2024-02-05T07:18:54.024 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-02-05T07:18:54.024 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=filefd 2024-02-05T07:18:54.024 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=filesystem 2024-02-05T07:18:54.024 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=hwmon 2024-02-05T07:18:54.024 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=infiniband 2024-02-05T07:18:54.024 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=ipvs 2024-02-05T07:18:54.024 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=loadavg 2024-02-05T07:18:54.025 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=mdadm 2024-02-05T07:18:54.025 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=meminfo 2024-02-05T07:18:54.025 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=netclass 2024-02-05T07:18:54.025 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=netdev 2024-02-05T07:18:54.025 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=netstat 2024-02-05T07:18:54.025 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=nfs 2024-02-05T07:18:54.025 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=nfsd 2024-02-05T07:18:54.025 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=nvme 2024-02-05T07:18:54.025 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=os 2024-02-05T07:18:54.025 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-02-05T07:18:54.025 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=pressure 2024-02-05T07:18:54.025 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=rapl 2024-02-05T07:18:54.025 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=schedstat 2024-02-05T07:18:54.025 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=selinux 2024-02-05T07:18:54.026 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=sockstat 2024-02-05T07:18:54.026 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=softnet 2024-02-05T07:18:54.026 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=stat 2024-02-05T07:18:54.026 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=tapestats 2024-02-05T07:18:54.026 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=textfile 2024-02-05T07:18:54.026 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-02-05T07:18:54.026 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=time 2024-02-05T07:18:54.026 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-02-05T07:18:54.026 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=uname 2024-02-05T07:18:54.026 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=vmstat 2024-02-05T07:18:54.026 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=xfs 2024-02-05T07:18:54.026 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=node_exporter.go:117 level=info collector=zfs 2024-02-05T07:18:54.026 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-02-05T07:18:54.026 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a[79357]: ts=2024-02-05T07:18:53.777Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-02-05T07:18:54.027 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 bash[79307]: 2fa7beb4099097a81cf69646a005956d6e6a6fffa519ee58bd927c0605eb9cbf 2024-02-05T07:18:54.027 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:18:53 smithi184 systemd[1]: Started Ceph node-exporter.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:18:54.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:54 smithi188 ceph-mon[33283]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:54.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:54 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:54.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:54 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:54.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:54 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:54.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:54 smithi184 ceph-mon[29861]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:54.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:54 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:54.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:54 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:54.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:54 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:54.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:54 smithi184 ceph-mon[41609]: pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:18:54.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:54 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:54.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:54 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:54.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:54 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:55.195 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:55 smithi188 bash[66563]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-02-05T07:18:55.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:55 smithi188 ceph-mon[33283]: Deploying daemon node-exporter.b on smithi188 2024-02-05T07:18:55.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:55 smithi184 ceph-mon[29861]: Deploying daemon node-exporter.b on smithi188 2024-02-05T07:18:55.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:55 smithi184 ceph-mon[41609]: Deploying daemon node-exporter.b on smithi188 2024-02-05T07:18:55.999 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:55 smithi188 bash[66563]: Getting image source signatures 2024-02-05T07:18:55.999 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:55 smithi188 bash[66563]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-02-05T07:18:55.999 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:55 smithi188 bash[66563]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-02-05T07:18:55.999 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:55 smithi188 bash[66563]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-02-05T07:18:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:56 smithi188 ceph-mon[33283]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:56.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:56 smithi184 ceph-mon[29861]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:56.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:56 smithi184 ceph-mon[41609]: pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:57.452 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:18:57.453 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 bash[66563]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-02-05T07:18:57.453 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 bash[66563]: Writing manifest to image destination 2024-02-05T07:18:57.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:18:57.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:18:57.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:18:57.748 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 podman[66563]: 2024-02-05 07:18:57.533449084 +0000 UTC m=+2.551788051 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-02-05T07:18:57.748 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 podman[66563]: 2024-02-05 07:18:57.623887409 +0000 UTC m=+2.642226358 container create 5e788acdaa7eda1a447f72192897b22c087e78c7be2f72053b0bd33f257489b8 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-02-05T07:18:58.204 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 podman[66563]: 2024-02-05 07:18:57.876130337 +0000 UTC m=+2.894469291 container init 5e788acdaa7eda1a447f72192897b22c087e78c7be2f72053b0bd33f257489b8 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-02-05T07:18:58.204 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 podman[66563]: 2024-02-05 07:18:57.881527409 +0000 UTC m=+2.899866359 container start 5e788acdaa7eda1a447f72192897b22c087e78c7be2f72053b0bd33f257489b8 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-02-05T07:18:58.204 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.885Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-02-05T07:18:58.204 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.885Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-02-05T07:18:58.204 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-02-05T07:18:58.204 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-05T07:18:58.204 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-02-05T07:18:58.204 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-02-05T07:18:58.204 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-02-05T07:18:58.204 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=arp 2024-02-05T07:18:58.204 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=bcache 2024-02-05T07:18:58.205 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=bonding 2024-02-05T07:18:58.205 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=btrfs 2024-02-05T07:18:58.205 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=conntrack 2024-02-05T07:18:58.205 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=cpu 2024-02-05T07:18:58.205 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-02-05T07:18:58.205 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=diskstats 2024-02-05T07:18:58.205 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=dmi 2024-02-05T07:18:58.205 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=edac 2024-02-05T07:18:58.205 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=entropy 2024-02-05T07:18:58.206 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-02-05T07:18:58.206 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=filefd 2024-02-05T07:18:58.206 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=filesystem 2024-02-05T07:18:58.206 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=hwmon 2024-02-05T07:18:58.206 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=infiniband 2024-02-05T07:18:58.206 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=ipvs 2024-02-05T07:18:58.206 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=loadavg 2024-02-05T07:18:58.206 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=mdadm 2024-02-05T07:18:58.206 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=meminfo 2024-02-05T07:18:58.206 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=netclass 2024-02-05T07:18:58.206 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=netdev 2024-02-05T07:18:58.206 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=netstat 2024-02-05T07:18:58.206 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=nfs 2024-02-05T07:18:58.206 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=nfsd 2024-02-05T07:18:58.206 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=nvme 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=os 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=pressure 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=rapl 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=schedstat 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=selinux 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=sockstat 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=softnet 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=stat 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=tapestats 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=textfile 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=time 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=uname 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=vmstat 2024-02-05T07:18:58.207 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=xfs 2024-02-05T07:18:58.208 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.886Z caller=node_exporter.go:117 level=info collector=zfs 2024-02-05T07:18:58.208 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.887Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-02-05T07:18:58.208 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b[66615]: ts=2024-02-05T07:18:57.887Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-02-05T07:18:58.208 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 bash[66563]: 5e788acdaa7eda1a447f72192897b22c087e78c7be2f72053b0bd33f257489b8 2024-02-05T07:18:58.208 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:18:57 smithi188 systemd[1]: Started Ceph node-exporter.b for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:18:58.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:58 smithi188 ceph-mon[33283]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:58.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:58.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:58.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:58.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:58.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:58.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:58 smithi184 ceph-mon[29861]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:58.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:58.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:58.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:58.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:58.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:58.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:58 smithi184 ceph-mon[41609]: pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:18:58.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:58.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:58.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:58.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:58.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:18:59.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:59.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:18:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:18:59.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:59.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:18:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:18:59.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:18:59.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:18:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:19:00.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:00 smithi188 ceph-mon[33283]: pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:00.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:00 smithi184 ceph-mon[29861]: pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:00 smithi184 ceph-mon[41609]: pgmap v34: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:02.212 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:19:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:19:02.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:02 smithi188 ceph-mon[33283]: pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:02.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:02 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:02.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:02 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:02.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:02 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:02.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:02 smithi184 ceph-mon[29861]: pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:02.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:02 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:02.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:02 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:02.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:02 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:02.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:02 smithi184 ceph-mon[41609]: pgmap v35: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:02.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:02 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:02.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:02 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:02.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:02 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:03.981 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[29861]: pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:03.981 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:03.981 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:03.982 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:19:03.982 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:19:03.982 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:03.982 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[29861]: Reconfiguring alertmanager.a (dependencies changed)... 2024-02-05T07:19:03.982 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[29861]: Reconfiguring daemon alertmanager.a on smithi184 2024-02-05T07:19:03.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[41609]: pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:03.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:03.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:03.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:19:03.982 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:19:03.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:03.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[41609]: Reconfiguring alertmanager.a (dependencies changed)... 2024-02-05T07:19:03.983 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:03 smithi184 ceph-mon[41609]: Reconfiguring daemon alertmanager.a on smithi184 2024-02-05T07:19:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:03 smithi188 ceph-mon[33283]: pgmap v36: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:03 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:03 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:03 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:19:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:03 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:19:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:03 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:03 smithi188 ceph-mon[33283]: Reconfiguring alertmanager.a (dependencies changed)... 2024-02-05T07:19:03.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:03 smithi188 ceph-mon[33283]: Reconfiguring daemon alertmanager.a on smithi184 2024-02-05T07:19:06.427 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:06 smithi184 ceph-mon[29861]: pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:06.427 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:06 smithi184 ceph-mon[41609]: pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:06.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:06 smithi188 ceph-mon[33283]: pgmap v37: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:06.772 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:06 smithi184 systemd[1]: Stopping Ceph alertmanager.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:19:07.107 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:06 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[78025]: ts=2024-02-05T07:19:06.799Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-02-05T07:19:07.108 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:06 smithi184 podman[80177]: 2024-02-05 07:19:06.820104927 +0000 UTC m=+0.110204186 container died ab9854627eb36e3d973eb18cbfcafe68e230ea8a232348db1b187d03fed69f5c (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-02-05T07:19:07.521 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:07 smithi184 podman[80177]: 2024-02-05 07:19:07.296791812 +0000 UTC m=+0.586891120 container cleanup ab9854627eb36e3d973eb18cbfcafe68e230ea8a232348db1b187d03fed69f5c (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-02-05T07:19:07.521 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:07 smithi184 bash[80177]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a 2024-02-05T07:19:07.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:19:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:19:07.975 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:07 smithi184 podman[80196]: 2024-02-05 07:19:07.556436909 +0000 UTC m=+0.735569969 container remove ab9854627eb36e3d973eb18cbfcafe68e230ea8a232348db1b187d03fed69f5c (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-02-05T07:19:07.976 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:07 smithi184 podman[80196]: 2024-02-05 07:19:07.632207751 +0000 UTC m=+0.811340811 volume remove 20a3ae0b323f831328f8ca676811f94efda8419d4547a75bb7be2de21db74586 2024-02-05T07:19:07.976 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:07 smithi184 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@alertmanager.a.service: Deactivated successfully. 2024-02-05T07:19:07.976 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:07 smithi184 systemd[1]: Stopped Ceph alertmanager.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:19:07.976 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:07 smithi184 systemd[1]: Starting Ceph alertmanager.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:19:08.246 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:08 smithi184 ceph-mon[29861]: pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:08.247 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:08 smithi184 ceph-mon[41609]: pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:08.247 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:07 smithi184 podman[80296]: 2024-02-05 07:19:07.974601873 +0000 UTC m=+0.098879158 volume create 16ad05d7ee50eb614c5ad0176d4745997d86f5aa1500120ec409969a41e1c712 2024-02-05T07:19:08.247 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:07 smithi184 podman[80296]: 2024-02-05 07:19:07.894504402 +0000 UTC m=+0.018781688 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-02-05T07:19:08.247 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:08 smithi184 podman[80296]: 2024-02-05 07:19:08.050016211 +0000 UTC m=+0.174293499 container create dde10d75aa33646347ca79b6e296ee5a3e891aef0d412345939df73f439b0031 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-02-05T07:19:08.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:08 smithi188 ceph-mon[33283]: pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:08.772 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:08 smithi184 podman[80296]: 2024-02-05 07:19:08.3447704 +0000 UTC m=+0.469047686 container init dde10d75aa33646347ca79b6e296ee5a3e891aef0d412345939df73f439b0031 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-02-05T07:19:08.772 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:08 smithi184 podman[80296]: 2024-02-05 07:19:08.349993566 +0000 UTC m=+0.474270854 container start dde10d75aa33646347ca79b6e296ee5a3e891aef0d412345939df73f439b0031 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-02-05T07:19:08.772 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:08 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[80311]: ts=2024-02-05T07:19:08.361Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-02-05T07:19:08.772 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:08 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[80311]: ts=2024-02-05T07:19:08.362Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-02-05T07:19:08.772 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:08 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[80311]: ts=2024-02-05T07:19:08.363Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.184 port=9094 2024-02-05T07:19:08.772 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:08 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[80311]: ts=2024-02-05T07:19:08.363Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-05T07:19:08.772 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:08 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[80311]: ts=2024-02-05T07:19:08.386Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-05T07:19:08.772 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:08 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[80311]: ts=2024-02-05T07:19:08.387Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-05T07:19:08.772 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:08 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[80311]: ts=2024-02-05T07:19:08.389Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-02-05T07:19:08.772 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:08 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[80311]: ts=2024-02-05T07:19:08.389Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-02-05T07:19:08.773 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:08 smithi184 bash[80296]: dde10d75aa33646347ca79b6e296ee5a3e891aef0d412345939df73f439b0031 2024-02-05T07:19:08.773 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:08 smithi184 systemd[1]: Started Ceph alertmanager.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:19:09.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:09.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:09 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:09.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:09 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:09.514 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:09.514 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:09 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:09.514 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:09 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:09.515 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:09.515 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:09 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:09.515 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:09 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:10.484 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:10 smithi188 ceph-mon[33283]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:10.484 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:10 smithi188 ceph-mon[33283]: Reconfiguring prometheus.a (dependencies changed)... 2024-02-05T07:19:10.484 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:10 smithi188 ceph-mon[33283]: Reconfiguring daemon prometheus.a on smithi188 2024-02-05T07:19:10.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:10 smithi184 ceph-mon[29861]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:10.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:10 smithi184 ceph-mon[29861]: Reconfiguring prometheus.a (dependencies changed)... 2024-02-05T07:19:10.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:10 smithi184 ceph-mon[29861]: Reconfiguring daemon prometheus.a on smithi188 2024-02-05T07:19:10.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:10 smithi184 ceph-mon[41609]: pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:10.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:10 smithi184 ceph-mon[41609]: Reconfiguring prometheus.a (dependencies changed)... 2024-02-05T07:19:10.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:10 smithi184 ceph-mon[41609]: Reconfiguring daemon prometheus.a on smithi188 2024-02-05T07:19:10.522 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:10 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[80311]: ts=2024-02-05T07:19:10.364Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000239302s 2024-02-05T07:19:12.202 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 systemd[1]: Stopping Ceph prometheus.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:19:12.202 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:19:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:19:12.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:12 smithi188 ceph-mon[33283]: pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:12.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:12 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:19:12.499 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:19:12.313Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-05T07:19:12.499 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:19:12.313Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-02-05T07:19:12.499 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:19:12.313Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-02-05T07:19:12.499 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:19:12.313Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-05T07:19:12.500 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:19:12.313Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-02-05T07:19:12.500 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:19:12.313Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-02-05T07:19:12.500 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:19:12.313Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-02-05T07:19:12.500 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:19:12.313Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-02-05T07:19:12.500 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:19:12.313Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-02-05T07:19:12.500 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:19:12.313Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-02-05T07:19:12.500 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:19:12.313Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-02-05T07:19:12.500 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[64253]: ts=2024-02-05T07:19:12.313Z caller=main.go:1147 level=info msg="See you next time!" 2024-02-05T07:19:12.500 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 podman[67658]: 2024-02-05 07:19:12.323970138 +0000 UTC m=+0.137451545 container died 69763a4bcbf22f7d7afa001dc409759808ae26968eff5b66a4000d3eb2c9bd0e (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-02-05T07:19:12.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:12 smithi184 ceph-mon[29861]: pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:12.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:12 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:19:12.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:12 smithi184 ceph-mon[41609]: pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:12.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:12 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:19:12.979 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 podman[67658]: 2024-02-05 07:19:12.702137493 +0000 UTC m=+0.515618898 container cleanup 69763a4bcbf22f7d7afa001dc409759808ae26968eff5b66a4000d3eb2c9bd0e (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-02-05T07:19:12.979 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 bash[67658]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a 2024-02-05T07:19:13.249 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:12 smithi188 podman[67677]: 2024-02-05 07:19:12.978239831 +0000 UTC m=+0.653365500 container remove 69763a4bcbf22f7d7afa001dc409759808ae26968eff5b66a4000d3eb2c9bd0e (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-02-05T07:19:13.249 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@prometheus.a.service: Deactivated successfully. 2024-02-05T07:19:13.249 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 systemd[1]: Stopped Ceph prometheus.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:19:13.249 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@prometheus.a.service: Consumed 1.120s CPU time. 2024-02-05T07:19:13.249 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 systemd[1]: Starting Ceph prometheus.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:19:13.590 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 podman[67775]: 2024-02-05 07:19:13.236931038 +0000 UTC m=+0.018861857 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-02-05T07:19:13.591 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 podman[67775]: 2024-02-05 07:19:13.362453371 +0000 UTC m=+0.144384190 container create 639dafe5f2ed55eabc8832a4bd429fc0eb30d198ceb6bd6bc367d63a1af5dece (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-02-05T07:19:13.591 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 podman[67775]: 2024-02-05 07:19:13.589568528 +0000 UTC m=+0.371499347 container init 639dafe5f2ed55eabc8832a4bd429fc0eb30d198ceb6bd6bc367d63a1af5dece (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-02-05T07:19:13.999 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 podman[67775]: 2024-02-05 07:19:13.59517689 +0000 UTC m=+0.377107711 container start 639dafe5f2ed55eabc8832a4bd429fc0eb30d198ceb6bd6bc367d63a1af5dece (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-02-05T07:19:13.999 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.619Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-02-05T07:19:14.000 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.619Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-02-05T07:19:14.000 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.619Z caller=main.go:570 level=info host_details="(Linux 5.14.0-416.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jan 31 22:52:48 UTC 2024 x86_64 smithi188 (none))" 2024-02-05T07:19:14.000 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.619Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-05T07:19:14.000 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.619Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-05T07:19:14.000 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.620Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-02-05T07:19:14.000 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.621Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-02-05T07:19:14.000 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.622Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-02-05T07:19:14.000 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.622Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-02-05T07:19:14.000 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.624Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-05T07:19:14.000 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.624Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.034µs 2024-02-05T07:19:14.000 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.624Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-05T07:19:14.001 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.624Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-02-05T07:19:14.001 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.624Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-02-05T07:19:14.001 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.624Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=19.886µs wal_replay_duration=464.935µs wbl_replay_duration=95ns total_replay_duration=506.553µs 2024-02-05T07:19:14.001 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.625Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-02-05T07:19:14.001 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.625Z caller=main.go:1029 level=info msg="TSDB started" 2024-02-05T07:19:14.001 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.625Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-05T07:19:14.001 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.642Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=17.158904ms db_storage=695ns remote_storage=1.051µs web_handler=258ns query_engine=645ns scrape=580.798µs scrape_sd=68.815µs notify=13.458µs notify_sd=11.958µs rules=16.28294ms tracing=6.871µs 2024-02-05T07:19:14.001 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.642Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-02-05T07:19:14.001 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:19:13.642Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-02-05T07:19:14.491 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-mon[29861]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:14.492 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-mon[41609]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:14.492 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE Bus STOPPING 2024-02-05T07:19:14.492 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-05T07:19:14.492 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE Bus STOPPED 2024-02-05T07:19:14.492 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE Bus STARTING 2024-02-05T07:19:14.492 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE Serving on http://:::9283 2024-02-05T07:19:14.493 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE Bus STARTED 2024-02-05T07:19:14.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:14 smithi188 ceph-mon[33283]: pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:14.499 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:14 smithi188 bash[67775]: 639dafe5f2ed55eabc8832a4bd429fc0eb30d198ceb6bd6bc367d63a1af5dece 2024-02-05T07:19:14.499 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:19:14 smithi188 systemd[1]: Started Ceph prometheus.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:19:14.771 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE Bus STOPPING 2024-02-05T07:19:14.772 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-05T07:19:14.772 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE Bus STOPPED 2024-02-05T07:19:14.772 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE Bus STARTING 2024-02-05T07:19:14.772 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE Serving on http://:::9283 2024-02-05T07:19:14.772 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE Bus STARTED 2024-02-05T07:19:14.772 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE Bus STOPPING 2024-02-05T07:19:14.772 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-05T07:19:14.772 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE Bus STOPPED 2024-02-05T07:19:14.772 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE Bus STARTING 2024-02-05T07:19:14.772 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE Serving on http://:::9283 2024-02-05T07:19:14.772 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:14 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:19:14] ENGINE Bus STARTED 2024-02-05T07:19:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-05T07:19:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-05T07:19:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi184.front.sepia.ceph.com:9093"}]: dispatch 2024-02-05T07:19:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi184.front.sepia.ceph.com:9093"}]: dispatch 2024-02-05T07:19:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-05T07:19:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-05T07:19:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi188.front.sepia.ceph.com:9095"}]: dispatch 2024-02-05T07:19:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi188.front.sepia.ceph.com:9095"}]: dispatch 2024-02-05T07:19:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-05T07:19:15.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-05T07:19:15.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi188.front.sepia.ceph.com:3000"}]: dispatch 2024-02-05T07:19:15.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi188.front.sepia.ceph.com:3000"}]: dispatch 2024-02-05T07:19:15.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:15.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:19:15.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:15.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:15.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-05T07:19:15.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-05T07:19:15.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi184.front.sepia.ceph.com:9093"}]: dispatch 2024-02-05T07:19:15.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi184.front.sepia.ceph.com:9093"}]: dispatch 2024-02-05T07:19:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-05T07:19:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-05T07:19:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi188.front.sepia.ceph.com:9095"}]: dispatch 2024-02-05T07:19:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi188.front.sepia.ceph.com:9095"}]: dispatch 2024-02-05T07:19:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-05T07:19:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-05T07:19:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi188.front.sepia.ceph.com:3000"}]: dispatch 2024-02-05T07:19:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi188.front.sepia.ceph.com:3000"}]: dispatch 2024-02-05T07:19:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:19:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-05T07:19:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-05T07:19:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi184.front.sepia.ceph.com:9093"}]: dispatch 2024-02-05T07:19:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi184.front.sepia.ceph.com:9093"}]: dispatch 2024-02-05T07:19:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-05T07:19:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-05T07:19:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi188.front.sepia.ceph.com:9095"}]: dispatch 2024-02-05T07:19:15.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi188.front.sepia.ceph.com:9095"}]: dispatch 2024-02-05T07:19:15.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:15.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-05T07:19:15.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-05T07:19:15.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi188.front.sepia.ceph.com:3000"}]: dispatch 2024-02-05T07:19:15.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi188.front.sepia.ceph.com:3000"}]: dispatch 2024-02-05T07:19:15.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:15.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:19:16.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:16 smithi184 ceph-mon[29861]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:16.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:16 smithi184 ceph-mon[41609]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:16.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:16 smithi188 ceph-mon[33283]: pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:17.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:19:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:19:18.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:18 smithi188 ceph-mon[33283]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:18.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:18 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:18.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:18 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:18 smithi184 ceph-mon[29861]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:18 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:18 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:18.772 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:19:18 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[80311]: ts=2024-02-05T07:19:18.367Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003847459s 2024-02-05T07:19:18.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:18 smithi184 ceph-mon[41609]: pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:18.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:18 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:18.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:18 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:19.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:19.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:19.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:20.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:20 smithi184 ceph-mon[29861]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:20.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:20 smithi184 ceph-mon[41609]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:20 smithi188 ceph-mon[33283]: pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:22.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:19:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:19:22.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:22 smithi188 ceph-mon[33283]: pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:22.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:22 smithi184 ceph-mon[29861]: pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:22.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:22 smithi184 ceph-mon[41609]: pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:24 smithi188 ceph-mon[33283]: pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:24 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:24 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:24 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:19:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:24 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:19:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:24 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:24.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:24 smithi184 ceph-mon[41609]: pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:24.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:24 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:24.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:24 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:24.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:24 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:19:24.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:24 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:19:24.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:24 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:24 smithi184 ceph-mon[29861]: pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:24 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:24 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:24 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:19:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:24 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:19:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:24 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:19:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:26 smithi188 ceph-mon[33283]: pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:26.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:26 smithi184 ceph-mon[29861]: pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:26.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:26 smithi184 ceph-mon[41609]: pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:27.733 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:27 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:19:27.733 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:19:27 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:19:27.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:27 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:19:27.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:27 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:19:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:28 smithi188 ceph-mon[33283]: pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:28.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:28 smithi184 ceph-mon[29861]: pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:28.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:28 smithi184 ceph-mon[41609]: pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:29.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:30 smithi188 ceph-mon[33283]: pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:30.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:30 smithi184 ceph-mon[29861]: pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:30.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:30 smithi184 ceph-mon[41609]: pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:32.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:19:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:19:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:32 smithi188 ceph-mon[33283]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:32.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:32 smithi184 ceph-mon[29861]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:32 smithi184 ceph-mon[41609]: pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:34 smithi188 ceph-mon[33283]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:34.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:34 smithi184 ceph-mon[29861]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:34.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:34 smithi184 ceph-mon[41609]: pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:36.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:36 smithi188 ceph-mon[33283]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:36.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:36 smithi184 ceph-mon[29861]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:36.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:36 smithi184 ceph-mon[41609]: pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:37.499 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:19:37 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:19:38.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:38 smithi188 ceph-mon[33283]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:38 smithi184 ceph-mon[29861]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:38.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:38 smithi184 ceph-mon[41609]: pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:39.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:39.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:39.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:40.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:40 smithi184 ceph-mon[29861]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:40.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:40 smithi184 ceph-mon[41609]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:40.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:40 smithi188 ceph-mon[33283]: pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:42.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:19:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:19:42.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:42 smithi188 ceph-mon[33283]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:42.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:42 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:19:42.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:42 smithi184 ceph-mon[29861]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:42.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:42 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:19:42.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:42 smithi184 ceph-mon[41609]: pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:42.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:42 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:19:44.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:44 smithi188 ceph-mon[33283]: pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:44.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:44 smithi184 ceph-mon[29861]: pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:44.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:44 smithi184 ceph-mon[41609]: pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:46.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:46 smithi188 ceph-mon[33283]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:46 smithi184 ceph-mon[29861]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:46.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:46 smithi184 ceph-mon[41609]: pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:47.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:47 smithi188 ceph-mon[33283]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:47.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:19:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:19:47.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:47 smithi184 ceph-mon[29861]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:47.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:47 smithi184 ceph-mon[41609]: pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:48.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:48 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:48.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:48 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:48.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:48 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:50.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:50 smithi188 ceph-mon[33283]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:50.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:50 smithi184 ceph-mon[29861]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:50.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:50 smithi184 ceph-mon[41609]: pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:52.196 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:19:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:19:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:19:52.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:52 smithi188 ceph-mon[33283]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:52.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:52 smithi184 ceph-mon[29861]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:52.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:52 smithi184 ceph-mon[41609]: pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:54.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:54 smithi188 ceph-mon[33283]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:54.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:54 smithi184 ceph-mon[29861]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:54.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:54 smithi184 ceph-mon[41609]: pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:19:56.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:56 smithi188 ceph-mon[33283]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:56.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:56 smithi184 ceph-mon[29861]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:56.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:56 smithi184 ceph-mon[41609]: pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:57.481 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:19:57.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:19:57.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:19:57.522 INFO:tasks.workunit.client.0.smithi184.stderr:Note: switching to '164d3be4a527be775f4d3c343ea591122f1b8921'. 2024-02-05T07:19:57.522 INFO:tasks.workunit.client.0.smithi184.stderr: 2024-02-05T07:19:57.522 INFO:tasks.workunit.client.0.smithi184.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-05T07:19:57.522 INFO:tasks.workunit.client.0.smithi184.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-05T07:19:57.522 INFO:tasks.workunit.client.0.smithi184.stderr:state without impacting any branches by switching back to a branch. 2024-02-05T07:19:57.522 INFO:tasks.workunit.client.0.smithi184.stderr: 2024-02-05T07:19:57.522 INFO:tasks.workunit.client.0.smithi184.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-05T07:19:57.523 INFO:tasks.workunit.client.0.smithi184.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-05T07:19:57.523 INFO:tasks.workunit.client.0.smithi184.stderr: 2024-02-05T07:19:57.523 INFO:tasks.workunit.client.0.smithi184.stderr: git switch -c 2024-02-05T07:19:57.523 INFO:tasks.workunit.client.0.smithi184.stderr: 2024-02-05T07:19:57.523 INFO:tasks.workunit.client.0.smithi184.stderr:Or undo this operation with: 2024-02-05T07:19:57.523 INFO:tasks.workunit.client.0.smithi184.stderr: 2024-02-05T07:19:57.523 INFO:tasks.workunit.client.0.smithi184.stderr: git switch - 2024-02-05T07:19:57.523 INFO:tasks.workunit.client.0.smithi184.stderr: 2024-02-05T07:19:57.523 INFO:tasks.workunit.client.0.smithi184.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-05T07:19:57.523 INFO:tasks.workunit.client.0.smithi184.stderr: 2024-02-05T07:19:57.523 INFO:tasks.workunit.client.0.smithi184.stderr:HEAD is now at 164d3be4a52 Merge branch 'subclass-thread' of https://github.com/guits/ceph into wip-guits-testing-3-2024-02-04-2254 2024-02-05T07:19:57.525 DEBUG:teuthology.orchestra.run.smithi184:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-05T07:19:57.557 INFO:tasks.workunit.client.0.smithi184.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-05T07:19:57.559 INFO:tasks.workunit.client.0.smithi184.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-05T07:19:57.559 INFO:tasks.workunit.client.0.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-05T07:19:57.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:19:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:19:58.350 INFO:tasks.workunit.client.0.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-05T07:19:58.418 INFO:tasks.workunit.client.0.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-05T07:19:58.458 INFO:tasks.workunit.client.0.smithi184.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-05T07:19:58.460 INFO:tasks.workunit.client.0.smithi184.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-05T07:19:58.460 INFO:tasks.workunit.client.0.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-05T07:19:58.498 INFO:tasks.workunit.client.0.smithi184.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-05T07:19:58.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:58 smithi188 ceph-mon[33283]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:58.501 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-05T07:19:58.501 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-05T07:19:58.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:58 smithi184 ceph-mon[29861]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:58.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:58 smithi184 ceph-mon[41609]: pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:19:58.536 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-02-05T07:19:58.537 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-02-05T07:19:58.537 DEBUG:teuthology.orchestra.run.smithi184:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=164d3be4a527be775f4d3c343ea591122f1b8921 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-02-05T07:19:58.612 INFO:tasks.workunit.client.0.smithi184.stderr:+ parallel=1 2024-02-05T07:19:58.612 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' '' = --serial ']' 2024-02-05T07:19:58.612 INFO:tasks.workunit.client.0.smithi184.stderr:+ crimson=0 2024-02-05T07:19:58.612 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' '' = --crimson ']' 2024-02-05T07:19:58.612 INFO:tasks.workunit.client.0.smithi184.stderr:+ color= 2024-02-05T07:19:58.612 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -t 1 ']' 2024-02-05T07:19:58.613 INFO:tasks.workunit.client.0.smithi184.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-02-05T07:19:58.613 INFO:tasks.workunit.client.0.smithi184.stderr:+ GTEST_OUTPUT=xml:/home/ubuntu/cephtest/archive/gtest_xml_report 2024-02-05T07:19:58.613 INFO:tasks.workunit.client.0.smithi184.stderr:+ declare -A pids 2024-02-05T07:19:58.613 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.613 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.613 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_aio 2024-02-05T07:19:58.613 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_aio' 2024-02-05T07:19:58.613 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_aio 2024-02-05T07:19:58.613 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.614 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_aio 2024-02-05T07:19:58.614 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81144 2024-02-05T07:19:58.614 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_aio on pid 81144' 2024-02-05T07:19:58.614 INFO:tasks.workunit.client.0.smithi184.stdout:test api_aio on pid 81144 2024-02-05T07:19:58.617 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81144 2024-02-05T07:19:58.617 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.617 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.617 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-02-05T07:19:58.617 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_aio_pp 2024-02-05T07:19:58.617 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_aio_pp' 2024-02-05T07:19:58.617 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_aio_pp 2024-02-05T07:19:58.618 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.618 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.618 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.618 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.618 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.618 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.618 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.618 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.618 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.618 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.619 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.619 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.619 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.619 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.619 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.619 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.620 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.620 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.620 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.620 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.620 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.620 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.620 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.621 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.621 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_aio_pp 2024-02-05T07:19:58.621 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81151 2024-02-05T07:19:58.621 INFO:tasks.workunit.client.0.smithi184.stdout:test api_aio_pp on pid 81151 2024-02-05T07:19:58.626 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_aio_pp on pid 81151' 2024-02-05T07:19:58.627 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81151 2024-02-05T07:19:58.627 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.627 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.627 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-02-05T07:19:58.627 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_io 2024-02-05T07:19:58.627 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_io' 2024-02-05T07:19:58.627 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_io 2024-02-05T07:19:58.627 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.627 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.627 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.627 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.627 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.627 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.628 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.628 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.628 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.628 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.628 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.628 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.628 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.628 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.628 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.628 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.628 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.628 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.628 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.628 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.629 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.629 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.629 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.629 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.629 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.629 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.629 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.629 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.629 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.629 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.629 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.629 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.629 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.629 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.630 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.630 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.630 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.630 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.630 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.630 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.630 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.630 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.630 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.630 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.630 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.630 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.630 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_io 2024-02-05T07:19:58.630 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81160 2024-02-05T07:19:58.631 INFO:tasks.workunit.client.0.smithi184.stdout:test api_io on pid 81160 2024-02-05T07:19:58.634 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_io on pid 81160' 2024-02-05T07:19:58.635 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81160 2024-02-05T07:19:58.635 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.635 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-02-05T07:19:58.635 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.635 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_io_pp 2024-02-05T07:19:58.635 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_io_pp' 2024-02-05T07:19:58.635 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_io_pp 2024-02-05T07:19:58.635 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.635 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.635 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.635 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.635 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.635 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.636 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.636 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.636 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.636 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.636 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.636 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.636 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.636 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.636 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.636 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.636 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.636 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.636 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.636 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.637 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.637 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.637 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.637 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.637 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.637 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.637 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.637 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.637 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.637 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.637 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.637 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.637 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.637 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.638 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.638 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.638 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.638 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.638 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.638 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.638 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.638 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.638 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.638 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.638 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.638 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.638 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.638 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.639 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.639 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.639 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.639 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.639 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.639 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.639 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.639 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_io_pp 2024-02-05T07:19:58.639 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81173 2024-02-05T07:19:58.639 INFO:tasks.workunit.client.0.smithi184.stdout:test api_io_pp on pid 81173 2024-02-05T07:19:58.645 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_io_pp on pid 81173' 2024-02-05T07:19:58.645 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81173 2024-02-05T07:19:58.646 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-02-05T07:19:58.646 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.646 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.646 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_asio 2024-02-05T07:19:58.646 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_asio' 2024-02-05T07:19:58.646 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.646 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.646 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.646 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.646 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.646 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.646 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.646 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.647 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.647 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.647 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.647 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.647 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.647 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.647 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.647 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.647 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_asio 2024-02-05T07:19:58.647 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.647 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.647 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.647 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.647 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.648 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.648 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.648 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.648 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.648 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.648 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.648 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.648 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.648 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.648 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.648 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.648 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.648 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.649 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.649 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.649 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.649 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.649 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.649 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.649 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.649 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.649 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.649 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.649 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.649 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.649 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.649 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.649 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.650 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.650 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.650 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.650 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.650 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.650 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.650 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.650 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.650 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.650 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.650 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.650 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.650 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.650 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.651 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.651 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.651 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.651 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.651 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.651 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.651 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.651 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.651 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.651 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.651 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.651 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.651 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.651 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.652 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.652 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.652 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_asio 2024-02-05T07:19:58.652 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.652 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.652 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.652 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.652 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81188 2024-02-05T07:19:58.652 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.652 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_asio on pid 81188' 2024-02-05T07:19:58.652 INFO:tasks.workunit.client.0.smithi184.stdout:test api_asio on pid 81188 2024-02-05T07:19:58.659 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81188 2024-02-05T07:19:58.660 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.660 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.660 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.660 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.660 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.660 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-02-05T07:19:58.660 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.660 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.660 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.660 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.660 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.660 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.660 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.661 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.661 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_list 2024-02-05T07:19:58.661 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.661 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.661 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.661 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.661 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.661 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.661 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.661 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.661 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.661 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.661 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.661 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.661 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_list' 2024-02-05T07:19:58.662 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.662 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.662 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.662 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.662 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.662 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.662 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.662 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.662 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.662 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.662 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_list 2024-02-05T07:19:58.662 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81144/exe 2024-02-05T07:19:58.662 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.662 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.663 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.663 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.663 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.663 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.663 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.663 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.663 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.663 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.663 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.663 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.663 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.663 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.663 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.664 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.664 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.664 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.664 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.664 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.664 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.664 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.664 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.664 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.664 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.664 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.664 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.664 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.664 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.665 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.665 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.665 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.665 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.665 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.665 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.665 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.665 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.665 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.665 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.665 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.665 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.665 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.665 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.666 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.666 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.666 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.666 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.666 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.666 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.666 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.666 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.666 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.666 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.666 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.666 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.666 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.666 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.667 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.667 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.667 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.667 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.667 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.667 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.667 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.667 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.667 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.667 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.667 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.667 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.667 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.667 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_list 2024-02-05T07:19:58.667 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.668 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.668 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81205 2024-02-05T07:19:58.668 INFO:tasks.workunit.client.0.smithi184.stdout:test api_list on pid 81205 2024-02-05T07:19:58.670 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_list on pid 81205' 2024-02-05T07:19:58.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81205 2024-02-05T07:19:58.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-02-05T07:19:58.671 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_lock 2024-02-05T07:19:58.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio.xml 2024-02-05T07:19:58.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_lock' 2024-02-05T07:19:58.671 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_aio.log 2024-02-05T07:19:58.671 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.671 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.671 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.671 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.671 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.672 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.672 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.672 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.672 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.672 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.672 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.672 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.672 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.672 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.672 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.672 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.672 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.672 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.672 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.673 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.673 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.673 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.673 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.673 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.673 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.673 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.673 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.673 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.673 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.673 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.673 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.673 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.673 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.674 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.674 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.674 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.674 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.674 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.674 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.674 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.674 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.674 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.674 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.674 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.674 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.674 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.674 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.674 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.675 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.675 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.675 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.675 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_aio: /' 2024-02-05T07:19:58.675 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.675 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.675 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.675 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.675 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.675 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81151/exe 2024-02-05T07:19:58.675 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.675 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.675 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.675 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.675 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.676 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.676 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.676 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.676 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.676 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.676 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.676 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.676 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.676 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.676 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.676 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.676 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.676 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.676 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.677 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.677 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.677 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.677 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.677 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.677 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.677 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.677 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.677 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.677 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.677 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.677 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.677 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.677 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.678 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.678 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.678 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.678 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.678 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.678 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.678 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.678 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.678 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.678 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.678 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.678 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_lock 2024-02-05T07:19:58.678 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.679 INFO:tasks.workunit.client.0.smithi184.stdout:test api_lock on pid 81225 2024-02-05T07:19:58.681 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_lock 2024-02-05T07:19:58.681 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81225 2024-02-05T07:19:58.681 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_lock on pid 81225' 2024-02-05T07:19:58.681 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81225 2024-02-05T07:19:58.681 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.681 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.681 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-02-05T07:19:58.681 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.681 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.681 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.681 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.681 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.682 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.682 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.682 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.682 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.682 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_lock_pp 2024-02-05T07:19:58.682 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.682 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.682 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.682 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.682 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.682 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.682 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.682 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.682 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.683 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_lock_pp' 2024-02-05T07:19:58.683 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.683 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.683 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.683 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.683 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.683 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.683 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.683 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.683 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.683 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.683 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.683 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.683 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.684 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.684 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.684 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.684 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.684 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.684 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-02-05T07:19:58.684 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.684 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.684 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.684 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.684 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.684 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.684 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.684 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.685 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.685 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.685 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.685 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.685 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.685 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.685 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.685 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.685 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.685 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.685 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.685 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.685 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.685 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.686 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.686 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.686 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.686 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.686 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.686 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.686 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.686 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.686 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.686 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.686 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.686 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81160/exe 2024-02-05T07:19:58.686 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.686 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.687 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.687 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.687 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.687 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.687 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.687 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2024-02-05T07:19:58.687 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.687 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.687 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.687 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.687 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.687 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.687 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.687 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.688 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.688 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.688 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.688 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.688 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.688 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.688 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.688 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.688 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.688 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.688 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.688 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.688 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.688 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.689 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.689 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.689 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.689 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.689 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.689 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.689 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.689 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.689 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.689 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.689 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.689 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.689 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_lock_pp 2024-02-05T07:19:58.689 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_lock_pp 2024-02-05T07:19:58.690 INFO:tasks.workunit.client.0.smithi184.stdout:test api_lock_pp on pid 81244 2024-02-05T07:19:58.694 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81244 2024-02-05T07:19:58.694 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_lock_pp on pid 81244' 2024-02-05T07:19:58.694 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.694 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81244 2024-02-05T07:19:58.694 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.695 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.695 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.695 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-02-05T07:19:58.695 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.695 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.695 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.695 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.695 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.695 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.695 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.695 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.695 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.695 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.695 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.696 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.696 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.696 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.696 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.696 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.696 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.696 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_io.log 2024-02-05T07:19:58.696 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.696 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.696 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.696 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.696 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.696 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.696 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.697 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.697 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.697 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.697 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.697 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.697 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_io: /' 2024-02-05T07:19:58.697 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.697 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.697 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.697 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.697 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.697 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.697 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.697 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.697 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.698 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.698 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.698 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.698 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.698 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io.xml 2024-02-05T07:19:58.698 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.698 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.698 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.698 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.698 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.698 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.698 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.698 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.698 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.698 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.699 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.699 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.699 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.699 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.699 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.699 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.699 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.699 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.699 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.699 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.699 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.699 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.699 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.699 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.699 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.700 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.700 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.700 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.700 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.700 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.700 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.700 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.700 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.700 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.700 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.700 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.700 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.700 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.700 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.701 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.702 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.702 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.702 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.702 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.702 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_misc 2024-02-05T07:19:58.702 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.702 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_aio_pp: /' 2024-02-05T07:19:58.702 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_misc' 2024-02-05T07:19:58.702 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.702 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.702 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.702 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.702 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.702 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.702 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81173/exe 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_misc 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.703 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.704 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.704 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.704 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.704 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.704 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.704 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.704 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.704 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.704 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.704 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.704 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.704 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.704 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.704 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.705 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.706 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.706 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.706 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.706 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.706 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.706 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.706 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.706 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.706 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.706 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.706 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.706 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.706 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.706 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.707 INFO:tasks.workunit.client.0.smithi184.stdout:test api_misc on pid 81275 2024-02-05T07:19:58.714 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.714 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.714 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.714 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.714 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.714 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.714 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.714 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.714 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.714 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.714 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.715 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.715 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.715 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.715 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.715 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_misc 2024-02-05T07:19:58.715 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.715 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.715 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.715 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.715 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.715 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io_pp.xml 2024-02-05T07:19:58.715 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.715 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81275 2024-02-05T07:19:58.715 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_misc on pid 81275' 2024-02-05T07:19:58.715 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81275 2024-02-05T07:19:58.716 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.716 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.716 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-02-05T07:19:58.716 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_io_pp: /' 2024-02-05T07:19:58.716 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-02-05T07:19:58.716 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.716 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.716 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.716 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.716 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.716 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.716 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.716 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.716 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.717 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.717 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.717 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.717 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.717 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.717 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.717 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.717 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.717 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.717 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.717 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.717 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.717 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.717 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.718 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.718 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.718 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.718 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.718 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.718 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.718 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.718 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.718 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_misc_pp 2024-02-05T07:19:58.718 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_misc_pp' 2024-02-05T07:19:58.718 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.718 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_misc_pp 2024-02-05T07:19:58.718 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.718 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.718 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.719 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.719 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.719 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.719 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.719 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.719 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.719 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.719 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.719 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.719 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.719 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.719 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.720 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.720 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.720 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.720 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.720 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.720 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.720 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.720 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.720 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.720 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.720 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.720 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.720 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.720 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.721 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.721 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.721 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.721 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.721 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.721 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.721 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.721 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.721 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.721 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.721 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.721 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81188/exe 2024-02-05T07:19:58.721 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.721 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.722 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.722 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.722 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.722 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.722 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.722 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.722 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.722 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.722 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.722 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.722 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.722 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.722 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.722 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.723 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.723 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.723 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.723 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.723 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.723 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.723 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.723 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.723 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.723 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.723 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.723 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.723 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.723 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.724 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.724 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.724 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.724 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.724 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.724 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.724 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.724 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.724 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.724 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.724 INFO:tasks.workunit.client.0.smithi184.stdout:test api_misc_pp on pid 81293 2024-02-05T07:19:58.729 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.729 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_misc_pp 2024-02-05T07:19:58.730 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.730 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.730 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.730 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.730 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.730 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.730 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81293 2024-02-05T07:19:58.730 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.730 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.730 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_misc_pp on pid 81293' 2024-02-05T07:19:58.730 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81293 2024-02-05T07:19:58.730 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.730 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.730 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.731 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.731 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.731 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.731 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.731 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.731 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.731 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.731 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.731 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.731 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.731 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.731 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.731 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.731 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.732 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81205/exe 2024-02-05T07:19:58.732 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_tier_pp 2024-02-05T07:19:58.732 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_tier_pp' 2024-02-05T07:19:58.732 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-02-05T07:19:58.732 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81225/exe 2024-02-05T07:19:58.732 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_asio.xml 2024-02-05T07:19:58.732 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.732 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_asio: /' 2024-02-05T07:19:58.732 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.732 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.732 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.732 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.732 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.733 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.733 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.733 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.733 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.733 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.733 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.733 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.733 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.733 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.733 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.733 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.733 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.733 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.733 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.734 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.734 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.734 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.734 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.734 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.734 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.734 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.734 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.734 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.734 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.734 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.734 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.734 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.734 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.735 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.735 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.735 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.735 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.735 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.735 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.735 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.735 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.735 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.735 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.735 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.735 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.735 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.735 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock.xml 2024-02-05T07:19:58.735 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.736 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.736 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.736 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.736 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.736 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.736 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.736 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.736 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.736 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.736 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.736 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.736 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.736 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_list.xml 2024-02-05T07:19:58.736 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.737 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.737 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.737 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.737 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.737 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.737 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.737 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_list: /' 2024-02-05T07:19:58.737 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_lock.log 2024-02-05T07:19:58.737 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.737 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.737 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.737 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.737 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.737 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.737 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.738 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.738 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.738 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.738 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.738 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.738 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.738 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.738 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.738 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.738 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.738 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.738 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.738 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.738 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.739 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.739 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.739 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.739 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.739 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.739 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.739 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_lock: /' 2024-02-05T07:19:58.739 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81244/exe 2024-02-05T07:19:58.739 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.739 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.739 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.739 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.739 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.739 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.740 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.740 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.740 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.740 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.740 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.740 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-02-05T07:19:58.740 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.740 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.740 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.740 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_list.log 2024-02-05T07:19:58.740 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.740 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.740 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.741 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.741 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.741 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.741 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.741 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.741 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.741 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.741 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.741 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.741 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.741 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.741 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.741 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.741 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.741 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_asio.log 2024-02-05T07:19:58.742 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.742 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.742 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.742 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.742 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.742 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.742 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.742 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.742 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.742 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_lock_pp: /' 2024-02-05T07:19:58.742 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.742 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.742 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.742 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.743 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.743 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.743 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.743 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.743 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.743 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.743 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.743 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.743 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.743 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.743 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.743 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.743 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.743 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.744 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock_pp.xml 2024-02-05T07:19:58.744 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.744 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.744 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.744 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.744 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.744 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.744 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.744 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_tier_pp 2024-02-05T07:19:58.744 INFO:tasks.workunit.client.0.smithi184.stdout:test api_tier_pp on pid 81342 2024-02-05T07:19:58.748 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.748 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.748 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.749 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.749 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.749 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.749 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.749 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.749 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.749 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_tier_pp 2024-02-05T07:19:58.749 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.749 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.749 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.749 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.749 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.749 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.750 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.750 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81342 2024-02-05T07:19:58.750 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.750 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.750 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_tier_pp on pid 81342' 2024-02-05T07:19:58.750 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.750 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81342 2024-02-05T07:19:58.750 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.750 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.750 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.750 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.750 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81275/exe 2024-02-05T07:19:58.750 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-02-05T07:19:58.750 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.751 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.751 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.751 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.751 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.751 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.751 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.751 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.751 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.751 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.751 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.751 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.751 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.751 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.751 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.751 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.752 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.752 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_misc: /' 2024-02-05T07:19:58.752 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc.xml 2024-02-05T07:19:58.752 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.752 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.752 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.752 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.752 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.752 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.752 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.752 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.752 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.752 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.753 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.754 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.754 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.754 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.754 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_pool 2024-02-05T07:19:58.754 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.754 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.754 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.754 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.754 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.754 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.754 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.754 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.754 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.754 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.755 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.755 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.755 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.755 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.755 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.755 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.755 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.755 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.755 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.755 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_pool' 2024-02-05T07:19:58.755 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.755 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.755 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.755 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.756 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.756 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.756 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.756 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.756 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.756 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.756 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.756 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.756 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.756 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.756 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.756 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.756 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.756 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.757 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.757 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.757 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.757 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.757 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.757 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.757 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.757 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.757 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.757 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.757 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.757 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.757 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.757 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.758 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.758 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.758 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.758 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.758 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.758 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.758 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.758 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.758 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.758 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.758 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.758 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.758 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.759 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.759 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.759 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.759 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.759 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.759 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.759 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.759 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.759 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.759 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_misc.log 2024-02-05T07:19:58.759 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81293/exe 2024-02-05T07:19:58.759 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.759 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.759 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.760 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.760 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.760 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.760 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.760 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.760 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.760 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.760 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.760 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.760 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.760 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.760 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.760 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.760 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.761 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.761 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.761 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.761 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.761 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.761 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.761 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.761 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.761 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.761 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.761 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.761 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.761 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc_pp.xml 2024-02-05T07:19:58.761 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_pool 2024-02-05T07:19:58.762 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-02-05T07:19:58.762 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_misc_pp: /' 2024-02-05T07:19:58.762 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.762 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.762 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.762 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.762 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.762 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.762 INFO:tasks.workunit.client.0.smithi184.stdout:test api_pool on pid 81420 2024-02-05T07:19:58.764 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_pool 2024-02-05T07:19:58.764 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81420 2024-02-05T07:19:58.764 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_pool on pid 81420' 2024-02-05T07:19:58.764 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81420 2024-02-05T07:19:58.764 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.764 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.764 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_snapshots 2024-02-05T07:19:58.764 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_snapshots' 2024-02-05T07:19:58.765 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-02-05T07:19:58.765 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.765 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.765 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.765 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.765 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.765 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.765 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.765 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.765 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.765 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.765 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.765 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.765 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.766 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.766 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.766 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.766 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.766 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.766 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.766 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.766 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.766 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.766 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.766 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.766 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.766 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_snapshots 2024-02-05T07:19:58.766 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.767 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.767 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_snapshots 2024-02-05T07:19:58.767 INFO:tasks.workunit.client.0.smithi184.stdout:test api_snapshots on pid 81444 2024-02-05T07:19:58.769 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81444 2024-02-05T07:19:58.769 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_snapshots on pid 81444' 2024-02-05T07:19:58.769 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81444 2024-02-05T07:19:58.769 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.769 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.769 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_snapshots_pp 2024-02-05T07:19:58.770 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_snapshots_pp' 2024-02-05T07:19:58.770 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-02-05T07:19:58.770 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.770 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.770 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.770 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.770 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.770 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.770 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.770 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.770 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.770 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.770 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.770 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.771 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.771 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.771 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.771 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.771 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.771 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.771 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.771 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.771 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.771 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.771 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.771 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.771 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.771 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.772 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.772 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.772 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.772 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.772 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.772 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.772 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.772 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.772 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.772 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.772 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.772 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.772 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.772 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.773 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.773 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.773 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.773 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.773 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.773 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.773 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.773 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.773 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.773 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.773 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.773 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.773 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.773 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.773 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.774 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.774 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.774 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.774 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.774 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.774 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.774 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.774 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.774 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.774 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.774 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.774 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81342/exe 2024-02-05T07:19:58.774 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_snapshots_pp 2024-02-05T07:19:58.774 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.775 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.775 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.775 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.775 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.775 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.775 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.775 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.775 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.775 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.775 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.775 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.775 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.775 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.775 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.775 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.776 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.776 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.776 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.776 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.776 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.776 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.776 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.776 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.776 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.776 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.776 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.776 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.776 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.776 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.777 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.777 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.777 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.777 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.777 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.777 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.777 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.777 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.777 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.777 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.777 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.777 INFO:tasks.workunit.client.0.smithi184.stdout:test api_snapshots_pp on pid 81481 2024-02-05T07:19:58.780 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_snapshots_pp 2024-02-05T07:19:58.780 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-02-05T07:19:58.780 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81481 2024-02-05T07:19:58.780 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_snapshots_pp on pid 81481' 2024-02-05T07:19:58.780 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81481 2024-02-05T07:19:58.781 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.781 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.781 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_stat 2024-02-05T07:19:58.781 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_stat' 2024-02-05T07:19:58.781 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_tier_pp: /' 2024-02-05T07:19:58.781 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-02-05T07:19:58.781 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_stat 2024-02-05T07:19:58.781 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.781 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.781 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.781 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.781 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.781 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.781 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.781 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.782 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.782 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.782 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.782 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.782 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.782 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.782 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.782 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.782 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.782 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.782 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.782 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.782 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.782 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.783 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.783 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.783 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.783 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.783 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.783 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.783 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.783 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.783 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.783 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.783 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.783 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.783 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.783 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.783 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.784 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.784 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.784 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.784 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.784 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.784 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.784 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.784 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.784 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.784 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.784 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.784 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.784 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.785 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.785 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.785 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.785 INFO:tasks.workunit.client.0.smithi184.stdout:test api_stat on pid 81500 2024-02-05T07:19:58.786 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_stat 2024-02-05T07:19:58.787 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81500 2024-02-05T07:19:58.787 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_stat on pid 81500' 2024-02-05T07:19:58.787 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81500 2024-02-05T07:19:58.787 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.787 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.787 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_stat_pp 2024-02-05T07:19:58.787 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_stat_pp' 2024-02-05T07:19:58.787 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-02-05T07:19:58.787 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.787 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.787 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.787 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.788 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.788 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.788 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_stat_pp 2024-02-05T07:19:58.788 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.788 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.788 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.788 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.788 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.788 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.788 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.788 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.788 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.788 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.788 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.789 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.789 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.789 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.789 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.789 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.789 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.789 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.789 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.789 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.789 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.789 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.789 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.789 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.790 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.790 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.790 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_stat_pp 2024-02-05T07:19:58.790 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81519 2024-02-05T07:19:58.790 INFO:tasks.workunit.client.0.smithi184.stdout:test api_stat_pp on pid 81519 2024-02-05T07:19:58.794 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_stat_pp on pid 81519' 2024-02-05T07:19:58.795 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81519 2024-02-05T07:19:58.795 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.795 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.795 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-02-05T07:19:58.795 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_watch_notify 2024-02-05T07:19:58.795 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.795 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.795 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.795 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.795 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.795 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.795 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.796 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_watch_notify' 2024-02-05T07:19:58.796 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.796 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.796 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.796 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.796 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.796 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.796 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.796 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.796 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.796 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.796 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.796 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.796 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.797 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_tier_pp.xml 2024-02-05T07:19:58.797 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.797 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.797 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.797 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.797 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.797 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.797 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.797 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.797 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.797 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.797 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.797 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.797 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.798 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.798 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.798 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.798 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.798 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.798 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.798 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.798 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.798 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.798 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81420/exe 2024-02-05T07:19:58.798 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_watch_notify 2024-02-05T07:19:58.798 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.798 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.798 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.799 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.799 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.799 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.799 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.799 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.799 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.799 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.799 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.799 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.799 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.799 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.799 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.799 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.799 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.800 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.800 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.800 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.800 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.800 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.800 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.800 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.800 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.800 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.800 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.800 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.800 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.800 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.800 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.801 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.801 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.801 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.801 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.801 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.801 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.801 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.801 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.801 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.801 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.801 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.801 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.801 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.801 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.801 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.802 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.802 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.802 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.802 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.802 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.802 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.802 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.802 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.802 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.802 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.802 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.802 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.802 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.802 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.803 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.803 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.803 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.803 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.803 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.803 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.803 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.803 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.803 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.803 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.803 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.803 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.803 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.803 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.803 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.804 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.804 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.804 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.804 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.804 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.804 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.804 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.804 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.804 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_watch_notify 2024-02-05T07:19:58.804 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_pool.xml 2024-02-05T07:19:58.804 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81548 2024-02-05T07:19:58.805 INFO:tasks.workunit.client.0.smithi184.stdout:test api_watch_notify on pid 81548 2024-02-05T07:19:58.808 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_watch_notify on pid 81548' 2024-02-05T07:19:58.808 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81548 2024-02-05T07:19:58.808 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.808 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.808 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.808 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.808 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.808 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.809 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.809 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.809 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.809 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-02-05T07:19:58.809 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.809 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.809 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.809 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.809 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.809 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.809 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.809 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.809 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.810 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.810 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.810 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.810 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.810 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.810 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.810 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.810 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.810 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.810 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.810 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.810 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.810 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.810 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.811 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.811 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.811 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.811 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_pool.log 2024-02-05T07:19:58.811 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.811 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.811 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.811 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.811 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.811 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.811 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.811 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.811 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.812 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.812 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.812 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.812 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.812 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.812 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.812 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_watch_notify_pp 2024-02-05T07:19:58.812 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_watch_notify_pp' 2024-02-05T07:19:58.812 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.812 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.812 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.812 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.812 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.812 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.813 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.813 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.813 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.813 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.813 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.813 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.813 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.813 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.813 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.813 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.813 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.813 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.813 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.813 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.814 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_pool: /' 2024-02-05T07:19:58.814 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.814 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.814 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.814 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.814 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.814 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.814 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.814 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.814 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.814 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.814 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.814 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.814 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.815 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.815 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.815 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.815 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.815 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.815 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.815 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.815 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.815 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.815 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.815 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.815 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.815 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.815 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.816 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.816 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.816 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.816 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.816 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81444/exe 2024-02-05T07:19:58.816 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.816 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.816 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.816 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.816 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.816 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.816 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.816 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.817 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.817 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.817 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.817 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots.xml 2024-02-05T07:19:58.817 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.817 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.817 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.817 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_snapshots: /' 2024-02-05T07:19:58.817 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.817 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.817 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.817 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.817 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.817 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.818 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.818 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.818 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.818 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.818 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.818 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.818 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.818 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.818 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-02-05T07:19:58.818 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_watch_notify_pp 2024-02-05T07:19:58.818 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.818 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.818 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.818 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.819 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.819 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.819 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.819 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.819 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.819 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.819 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.819 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.819 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.819 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.819 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.819 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.820 INFO:tasks.workunit.client.0.smithi184.stdout:test api_watch_notify_pp on pid 81591 2024-02-05T07:19:58.822 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.822 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.822 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.822 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.822 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.822 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.822 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.822 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.822 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.822 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.822 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.823 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.823 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.823 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.823 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.823 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.823 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.823 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_watch_notify_pp 2024-02-05T07:19:58.823 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.823 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.823 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.823 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.823 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.823 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81591 2024-02-05T07:19:58.823 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_watch_notify_pp on pid 81591' 2024-02-05T07:19:58.824 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81591 2024-02-05T07:19:58.824 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.824 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.824 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_cmd 2024-02-05T07:19:58.824 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_cmd' 2024-02-05T07:19:58.824 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81481/exe 2024-02-05T07:19:58.824 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.824 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.824 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.824 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.824 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.824 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_cmd 2024-02-05T07:19:58.824 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.825 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.825 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.825 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.825 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.825 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.825 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.825 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.825 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.825 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.825 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.825 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.825 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.825 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.825 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.826 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.826 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.826 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.826 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.826 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.826 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.826 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.826 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.826 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.826 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.826 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.826 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.826 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.826 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.826 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.827 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.827 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.827 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-02-05T07:19:58.827 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.827 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.827 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.827 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.827 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.827 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.827 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.827 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.827 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.827 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.827 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.828 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.828 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.828 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.828 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.828 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.828 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.828 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.828 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.828 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.828 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.828 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.828 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.828 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.828 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.829 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.829 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.829 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.829 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.829 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.829 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.829 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.829 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.829 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.829 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.829 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.829 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.829 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.829 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.829 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.830 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_cmd 2024-02-05T07:19:58.830 INFO:tasks.workunit.client.0.smithi184.stdout:test api_cmd on pid 81613 2024-02-05T07:19:58.835 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81613 2024-02-05T07:19:58.835 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_cmd on pid 81613' 2024-02-05T07:19:58.835 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81613 2024-02-05T07:19:58.835 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.835 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.835 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-02-05T07:19:58.835 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.835 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.835 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.835 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.835 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.836 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.836 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81500/exe 2024-02-05T07:19:58.836 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.836 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.836 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.836 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.836 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.836 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.836 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.836 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.836 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.836 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.836 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.836 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.837 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.837 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.837 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.837 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.837 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.837 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.837 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.837 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.837 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.837 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.837 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots_pp.xml 2024-02-05T07:19:58.837 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.837 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.837 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-02-05T07:19:58.838 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.838 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.838 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.838 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.838 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.838 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.838 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.838 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.838 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.838 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.838 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.838 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.838 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.838 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.838 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.839 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.839 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_cmd_pp 2024-02-05T07:19:58.839 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.839 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.839 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.839 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.839 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.839 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.839 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.839 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_cmd_pp' 2024-02-05T07:19:58.839 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.839 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.839 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.839 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.839 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.840 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.840 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-02-05T07:19:58.840 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_cmd_pp 2024-02-05T07:19:58.840 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81519/exe 2024-02-05T07:19:58.840 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.840 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.840 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.840 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.840 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.840 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.840 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.840 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.840 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.840 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.841 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.841 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.841 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.841 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.841 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.841 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.841 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.841 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.841 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.841 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.841 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.841 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.841 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.841 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.841 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.842 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.842 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.842 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.842 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.842 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.842 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.842 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.842 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.842 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.842 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_stat.log 2024-02-05T07:19:58.842 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.842 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.842 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.842 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.842 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.843 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat.xml 2024-02-05T07:19:58.843 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.843 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat_pp.xml 2024-02-05T07:19:58.843 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.843 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.843 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.843 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.843 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.843 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.843 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.843 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.843 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.843 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_stat: /' 2024-02-05T07:19:58.843 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.843 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-02-05T07:19:58.844 INFO:tasks.workunit.client.0.smithi184.stdout:test api_cmd_pp on pid 81656 2024-02-05T07:19:58.846 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_cmd_pp 2024-02-05T07:19:58.846 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_stat_pp: /' 2024-02-05T07:19:58.846 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81656 2024-02-05T07:19:58.846 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_cmd_pp on pid 81656' 2024-02-05T07:19:58.846 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81656 2024-02-05T07:19:58.846 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.846 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.846 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-02-05T07:19:58.846 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.846 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.846 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.846 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.846 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.847 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.847 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.847 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.847 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.847 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.847 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.847 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.847 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.847 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.847 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.847 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.847 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.847 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.847 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.847 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.848 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_service 2024-02-05T07:19:58.848 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.848 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.848 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_service' 2024-02-05T07:19:58.848 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.848 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.848 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.848 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.848 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_service 2024-02-05T07:19:58.848 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.848 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.848 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.848 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.848 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.849 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.849 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.849 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.849 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.849 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.849 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.849 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.849 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.849 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.849 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.849 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.849 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.849 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.849 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.849 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.850 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.851 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.851 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.851 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.851 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.851 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.851 INFO:tasks.workunit.client.0.smithi184.stdout:test api_service on pid 81673 2024-02-05T07:19:58.855 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_service 2024-02-05T07:19:58.855 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81673 2024-02-05T07:19:58.855 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_service on pid 81673' 2024-02-05T07:19:58.855 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81673 2024-02-05T07:19:58.855 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.855 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.856 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-02-05T07:19:58.856 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.856 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.856 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.856 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.856 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.856 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.856 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.856 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.856 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.856 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_service_pp 2024-02-05T07:19:58.856 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_service_pp' 2024-02-05T07:19:58.856 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.856 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.857 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.857 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.857 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.857 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.857 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.857 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.857 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.857 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.857 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.857 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.857 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.857 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.857 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.857 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.858 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.858 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.858 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.858 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.858 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.858 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.858 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.858 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.858 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.858 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.858 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.858 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.858 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.858 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.859 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.859 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.859 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.859 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.859 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.859 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.859 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.859 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.859 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.859 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.859 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.859 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.859 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.860 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.860 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.860 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.860 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.860 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.860 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.860 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.860 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.860 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.860 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.860 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.860 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.860 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.860 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.861 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_service_pp 2024-02-05T07:19:58.861 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.861 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.861 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.861 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.861 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.861 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.861 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.861 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.861 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.861 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.861 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.861 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.861 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.862 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.862 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.862 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.862 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.862 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.862 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.862 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.862 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.862 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.862 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.862 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.862 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.862 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.862 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.863 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.863 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.863 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.863 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.863 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.863 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.863 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.863 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.863 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.863 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.863 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.863 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.863 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.864 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.864 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.864 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.864 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.864 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.864 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.864 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.864 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.864 INFO:tasks.workunit.client.0.smithi184.stdout:test api_service_pp on pid 81724 2024-02-05T07:19:58.866 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_service_pp 2024-02-05T07:19:58.866 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.866 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.866 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81724 2024-02-05T07:19:58.866 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_service_pp on pid 81724' 2024-02-05T07:19:58.866 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81724 2024-02-05T07:19:58.866 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.866 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.866 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.866 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.866 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.866 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_c_write_operations 2024-02-05T07:19:58.867 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.867 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.867 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.867 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-02-05T07:19:58.867 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.867 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.867 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.867 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.867 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_c_write_operations' 2024-02-05T07:19:58.867 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.867 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.867 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.867 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.867 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.868 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.868 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.868 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.868 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.868 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.868 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.868 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.868 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.868 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.868 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.868 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.868 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.868 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.868 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.869 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.869 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.869 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.869 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.869 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.869 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.869 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.869 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.869 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_c_write_operations 2024-02-05T07:19:58.869 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.869 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.869 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.869 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.869 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.870 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.870 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.870 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.870 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.870 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.870 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.870 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.870 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.870 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.870 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.870 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.870 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.870 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.870 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.871 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.871 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.871 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.871 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.871 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.871 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81591/exe 2024-02-05T07:19:58.871 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.871 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.871 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.871 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.871 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.871 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.871 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.872 INFO:tasks.workunit.client.0.smithi184.stdout:test api_c_write_operations on pid 81738 2024-02-05T07:19:58.875 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_c_write_operations 2024-02-05T07:19:58.875 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81738 2024-02-05T07:19:58.876 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_c_write_operations on pid 81738' 2024-02-05T07:19:58.876 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81738 2024-02-05T07:19:58.876 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.876 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.876 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.876 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.876 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-02-05T07:19:58.876 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.876 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.876 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.876 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.876 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.876 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.877 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.877 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.877 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.877 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.877 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.877 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.877 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.877 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.877 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.877 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.877 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.877 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.877 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.877 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.878 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.878 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.878 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.878 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.878 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.878 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.878 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.878 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.878 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.878 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.878 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.878 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_c_read_operations 2024-02-05T07:19:58.878 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.878 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.879 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.879 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.879 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.879 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify_pp.xml 2024-02-05T07:19:58.879 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.879 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_c_read_operations' 2024-02-05T07:19:58.879 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-02-05T07:19:58.879 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.879 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.879 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.879 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.879 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.879 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.879 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.880 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.880 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.880 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.880 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.880 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.880 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.880 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.880 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.880 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.880 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.880 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.880 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.880 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.880 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.880 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.881 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.881 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.881 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.881 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.881 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.881 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.881 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.881 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.881 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.881 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.881 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.881 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.881 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.881 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.882 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.882 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.882 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.882 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.882 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.882 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-02-05T07:19:58.882 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.882 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.882 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.882 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.882 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.882 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.882 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.882 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.882 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.883 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.883 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.883 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.883 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.883 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.883 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.883 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.883 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.883 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.883 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.883 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81548/exe 2024-02-05T07:19:58.883 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.883 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.883 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.883 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.884 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.884 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.884 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.884 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.884 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.884 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.884 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.884 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.884 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.884 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.884 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.884 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.884 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.885 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_c_read_operations 2024-02-05T07:19:58.885 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.885 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.885 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.885 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.885 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.885 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.885 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.885 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.885 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.885 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.885 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.885 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.885 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.885 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.886 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.886 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.886 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.886 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.886 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.886 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.886 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.886 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.886 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.886 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.886 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.886 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.886 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.886 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.887 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.887 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.887 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.887 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.887 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.887 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.887 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.887 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.887 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.887 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.887 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.887 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.887 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.887 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.888 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.888 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.888 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.888 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.888 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.888 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.888 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.888 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.888 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.888 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.888 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.888 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.888 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.888 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.889 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.889 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.889 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.889 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.889 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.889 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.889 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.889 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.889 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.889 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.889 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.889 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.889 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.889 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81613/exe 2024-02-05T07:19:58.889 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.890 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.890 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.890 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.890 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.890 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.890 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_watch_notify: /' 2024-02-05T07:19:58.890 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-02-05T07:19:58.890 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_c_read_operations 2024-02-05T07:19:58.890 INFO:tasks.workunit.client.0.smithi184.stdout:test api_c_read_operations on pid 81813 2024-02-05T07:19:58.896 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81813 2024-02-05T07:19:58.896 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_c_read_operations on pid 81813' 2024-02-05T07:19:58.896 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81813 2024-02-05T07:19:58.896 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.896 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.896 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.896 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.896 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.897 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.897 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.897 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.897 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.897 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.897 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.897 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.897 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.897 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.897 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.897 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.897 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.897 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.897 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.898 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.898 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.898 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify.xml 2024-02-05T07:19:58.898 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_cmd: /' 2024-02-05T07:19:58.898 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.898 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.898 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.898 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.898 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.898 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.898 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.898 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.898 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.899 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.899 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_cmd.log 2024-02-05T07:19:58.899 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-02-05T07:19:58.899 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.899 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.899 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.899 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.899 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.899 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.899 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.899 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.899 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.899 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.899 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.899 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.900 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.900 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.900 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.900 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.900 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.900 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.900 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.900 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.900 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.900 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.900 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.900 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.900 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.900 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.901 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.901 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.901 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.901 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.901 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.901 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.901 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.901 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.901 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.901 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.901 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.901 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.901 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.901 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.902 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.902 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.902 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.902 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.902 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.902 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd.xml 2024-02-05T07:19:58.902 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.902 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.902 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.902 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.902 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.902 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.902 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.902 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.903 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.903 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.903 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.903 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.903 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.903 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.903 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.903 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.903 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.903 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.903 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.903 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.903 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.903 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.904 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.904 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.904 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.904 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.904 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.904 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.904 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.904 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.904 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.904 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.904 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.904 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.904 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.904 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.905 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.905 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.905 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.905 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.905 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.905 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.905 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.905 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.905 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.905 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.905 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.905 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.906 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.906 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.906 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.906 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.906 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.906 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.906 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.906 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.906 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.906 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.906 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.906 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.906 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.906 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.906 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.907 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.907 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81656/exe 2024-02-05T07:19:58.907 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s api_cls_remote_reads 2024-02-05T07:19:58.907 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.907 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.907 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' api_cls_remote_reads' 2024-02-05T07:19:58.907 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.907 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.907 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.907 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.907 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.907 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.907 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.907 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.907 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.908 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.908 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.908 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81673/exe 2024-02-05T07:19:58.908 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.908 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.908 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.908 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.908 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.908 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.908 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.908 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.908 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.908 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.908 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.909 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.909 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.909 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo api_cls_remote_reads 2024-02-05T07:19:58.909 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.909 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.909 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.909 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.909 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.909 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.909 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.909 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.909 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.909 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.909 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.910 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.911 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.912 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.912 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.912 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.912 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd_pp.xml 2024-02-05T07:19:58.912 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81724/exe 2024-02-05T07:19:58.912 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.912 INFO:tasks.workunit.client.0.smithi184.stdout:test api_cls_remote_reads on pid 81860 2024-02-05T07:19:58.914 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=api_cls_remote_reads 2024-02-05T07:19:58.914 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_service.log 2024-02-05T07:19:58.914 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81860 2024-02-05T07:19:58.914 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test api_cls_remote_reads on pid 81860' 2024-02-05T07:19:58.914 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81860 2024-02-05T07:19:58.914 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.914 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.915 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.915 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.915 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.915 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.915 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.915 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.915 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.915 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.915 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.915 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.915 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.915 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.915 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.915 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.916 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.916 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.916 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.916 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.916 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.916 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.916 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.916 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.916 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.916 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.916 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.916 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.916 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cls_remote_reads.xml 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2024-02-05T07:19:58.916 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.917 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.917 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service.xml 2024-02-05T07:19:58.917 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.917 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.917 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.917 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.917 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.917 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.917 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.917 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.917 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.917 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.917 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.917 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.918 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.918 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.918 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-02-05T07:19:58.918 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_service: /' 2024-02-05T07:19:58.918 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s list_parallel 2024-02-05T07:19:58.918 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' list_parallel' 2024-02-05T07:19:58.918 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service_pp.xml 2024-02-05T07:19:58.918 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_service_pp: /' 2024-02-05T07:19:58.918 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.918 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.918 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.918 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.918 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.918 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.918 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.919 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.919 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.919 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.919 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.919 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.919 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.919 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.919 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.919 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.919 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.919 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.919 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.919 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo list_parallel 2024-02-05T07:19:58.919 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.920 INFO:tasks.workunit.client.0.smithi184.stdout:test list_parallel on pid 81877 2024-02-05T07:19:58.923 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=list_parallel 2024-02-05T07:19:58.923 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81877 2024-02-05T07:19:58.923 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test list_parallel on pid 81877' 2024-02-05T07:19:58.923 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81877 2024-02-05T07:19:58.923 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.923 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.923 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s open_pools_parallel 2024-02-05T07:19:58.923 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' open_pools_parallel' 2024-02-05T07:19:58.923 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.923 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo open_pools_parallel 2024-02-05T07:19:58.923 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-02-05T07:19:58.923 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.923 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.924 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.924 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.924 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.924 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.924 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.924 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.924 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.924 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.924 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.924 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.924 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.924 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.924 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.924 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.925 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.925 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.925 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.925 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.925 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.925 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.925 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.925 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.925 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.925 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.925 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.925 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.926 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.926 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.926 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.926 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.926 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.926 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.926 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.926 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.926 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.926 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.926 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.926 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.926 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.926 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.926 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.927 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.927 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.927 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.927 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.927 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.927 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81738/exe 2024-02-05T07:19:58.927 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.927 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.927 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.927 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.927 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.927 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.927 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.927 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.928 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.928 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.928 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.928 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.928 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.928 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.928 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.928 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.928 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.928 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.928 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.928 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.928 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.929 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.929 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.929 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.929 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.929 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.929 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.929 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.929 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.929 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.929 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.929 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-02-05T07:19:58.929 INFO:tasks.workunit.client.0.smithi184.stdout:test open_pools_parallel on pid 81897 2024-02-05T07:19:58.931 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=open_pools_parallel 2024-02-05T07:19:58.931 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81897 2024-02-05T07:19:58.931 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test open_pools_parallel on pid 81897' 2024-02-05T07:19:58.931 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81897 2024-02-05T07:19:58.931 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-05T07:19:58.931 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.931 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-02-05T07:19:58.931 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.931 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.931 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.932 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.932 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.932 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.932 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.932 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.932 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.932 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.932 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.932 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.932 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.932 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.932 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.932 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.932 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.933 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.933 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.933 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.933 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s delete_pools_parallel 2024-02-05T07:19:58.933 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' delete_pools_parallel' 2024-02-05T07:19:58.933 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.933 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.933 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.933 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.933 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.933 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.933 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.933 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo delete_pools_parallel 2024-02-05T07:19:58.933 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_write_operations.xml 2024-02-05T07:19:58.934 INFO:tasks.workunit.client.0.smithi184.stdout:test delete_pools_parallel on pid 81910 2024-02-05T07:19:58.936 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=delete_pools_parallel 2024-02-05T07:19:58.936 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81910 2024-02-05T07:19:58.936 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test delete_pools_parallel on pid 81910' 2024-02-05T07:19:58.936 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81910 2024-02-05T07:19:58.936 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.936 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-05T07:19:58.936 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.936 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.936 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.936 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.936 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.936 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.937 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.937 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.937 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.937 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.937 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.937 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.937 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.937 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.937 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.937 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.937 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.937 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.937 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.937 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.938 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.938 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.938 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.938 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.938 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.938 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.938 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.938 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.938 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.938 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s cls 2024-02-05T07:19:58.938 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' cls' 2024-02-05T07:19:58.938 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-02-05T07:19:58.938 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.938 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-02-05T07:19:58.939 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.939 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.939 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.939 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.939 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.939 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.939 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo cls 2024-02-05T07:19:58.939 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.939 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.939 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.939 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.939 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.939 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.939 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.940 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.940 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.940 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.940 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.940 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.940 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.940 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.940 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.940 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.940 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.940 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.940 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.940 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.940 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=cls 2024-02-05T07:19:58.941 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81938 2024-02-05T07:19:58.941 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test cls on pid 81938' 2024-02-05T07:19:58.941 INFO:tasks.workunit.client.0.smithi184.stdout:test cls on pid 81938 2024-02-05T07:19:58.943 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81938 2024-02-05T07:19:58.944 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-05T07:19:58.944 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.944 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.944 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.944 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.944 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.944 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.944 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.944 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.944 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.944 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.944 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.944 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.945 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.945 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2024-02-05T07:19:58.945 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.945 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.945 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.945 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.945 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.945 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.945 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s cmd 2024-02-05T07:19:58.945 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.945 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.945 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.945 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' cmd' 2024-02-05T07:19:58.945 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.946 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.946 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.946 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.946 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.946 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.946 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.946 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.946 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.946 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.946 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.946 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.946 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.946 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.946 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.946 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.947 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.947 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.947 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.947 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.947 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.947 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.947 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.947 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.947 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.947 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.947 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.947 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.947 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.947 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.948 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.948 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.948 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.948 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.948 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.948 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.948 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.948 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.948 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.948 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.948 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.948 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.948 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.948 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.949 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.949 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.949 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.949 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.949 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.949 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.949 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.949 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.949 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.949 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.949 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.949 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.949 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.949 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.949 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.950 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.950 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.950 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo cmd 2024-02-05T07:19:58.950 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.950 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.950 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.950 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.950 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.950 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.950 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.950 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.950 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.950 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.950 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.951 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.951 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.951 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.951 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.951 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.951 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.951 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.951 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.951 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.951 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.951 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.951 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.951 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.951 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.952 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.952 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.952 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.952 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.952 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.952 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.952 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.952 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81813/exe 2024-02-05T07:19:58.952 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.952 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.952 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.952 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.952 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.952 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.952 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.953 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.953 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.953 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.953 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.953 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.953 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.953 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.953 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.953 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.953 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.953 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.953 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.953 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=cmd 2024-02-05T07:19:58.953 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.954 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.954 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.954 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.954 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.954 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.954 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.954 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.954 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.954 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.954 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.954 INFO:tasks.workunit.client.0.smithi184.stdout:test cmd on pid 81989 2024-02-05T07:19:58.960 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.960 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81989 2024-02-05T07:19:58.960 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test cmd on pid 81989' 2024-02-05T07:19:58.960 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.961 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=81989 2024-02-05T07:19:58.961 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-05T07:19:58.961 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.961 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.961 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.961 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.961 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.961 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.961 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.961 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.961 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.961 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.961 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.961 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.962 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.962 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.962 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.962 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.962 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.962 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.962 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.962 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.962 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.962 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81877/exe 2024-02-05T07:19:58.962 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.962 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2024-02-05T07:19:58.962 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s handler_error 2024-02-05T07:19:58.962 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.963 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.963 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.963 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.963 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.963 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.963 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.963 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.963 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.963 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.963 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.963 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.963 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' handler_error' 2024-02-05T07:19:58.963 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.963 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.964 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.964 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.964 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.964 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.964 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.964 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.964 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.964 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.964 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.964 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.964 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.964 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.964 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.964 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.965 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.965 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.965 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.965 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.965 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.965 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.965 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.965 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.965 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.965 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.965 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.965 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_list_parallel.log 2024-02-05T07:19:58.965 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.965 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.966 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.966 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.966 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.966 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.966 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.966 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.966 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.966 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.966 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.966 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.966 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.966 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.966 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-list_parallel.xml 2024-02-05T07:19:58.966 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.966 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.967 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.967 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.967 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.967 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.967 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.967 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.967 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.967 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.967 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.967 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.967 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.967 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.967 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.967 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.968 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.968 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.968 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.968 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.968 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.968 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.968 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.968 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.968 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.968 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_read_operations.xml 2024-02-05T07:19:58.968 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-02-05T07:19:58.968 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.968 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.968 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.969 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.969 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.969 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.969 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.969 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.969 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.969 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.969 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo handler_error 2024-02-05T07:19:58.969 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.969 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-02-05T07:19:58.969 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.969 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.969 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.969 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.969 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.970 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.970 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.970 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.970 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.970 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.970 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.970 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.970 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.970 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.970 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.970 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.970 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.970 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.970 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.971 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.971 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ list_parallel: /' 2024-02-05T07:19:58.971 INFO:tasks.workunit.client.0.smithi184.stdout:test handler_error on pid 82023 2024-02-05T07:19:58.977 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=handler_error 2024-02-05T07:19:58.977 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82023 2024-02-05T07:19:58.977 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test handler_error on pid 82023' 2024-02-05T07:19:58.977 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=82023 2024-02-05T07:19:58.977 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-05T07:19:58.977 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.977 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2024-02-05T07:19:58.977 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.977 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.978 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.978 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.978 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.978 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.978 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.978 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.978 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.978 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:58.978 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:58.978 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:58.978 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:58.978 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.978 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:58.979 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:58.979 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:58.979 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:58.979 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.979 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:58.979 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.979 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:58.979 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:58.979 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.979 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.979 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:58.979 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.979 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:58.979 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.980 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s io 2024-02-05T07:19:58.980 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.980 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:58.980 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.980 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.980 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:58.980 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.980 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.980 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:58.980 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.980 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.980 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.980 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.981 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.981 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.981 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.981 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.981 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.981 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' io' 2024-02-05T07:19:58.981 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.981 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.981 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.981 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.981 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.981 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo io 2024-02-05T07:19:58.981 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.981 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.982 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.982 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.982 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.982 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.982 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.982 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.982 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.982 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.982 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.982 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.982 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.982 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.982 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.983 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.983 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.983 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.983 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.983 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.983 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.983 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.983 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.983 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.983 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.983 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.983 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:58.983 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:58.983 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:58.983 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:58.984 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.984 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:58.984 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.984 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:58.984 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:58.984 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:58.984 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.984 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:58.984 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.984 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:58.984 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:58.984 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:58.984 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.985 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:58.985 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.985 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:58.985 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.985 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.985 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.985 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.985 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.985 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.985 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.985 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.985 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.985 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.985 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.986 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.986 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.986 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.986 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.986 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.986 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.986 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.986 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.986 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.986 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.986 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.986 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.986 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.986 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.987 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.987 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.987 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.987 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.987 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.987 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.987 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81897/exe 2024-02-05T07:19:58.987 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:58.987 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:58.987 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:58.987 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.987 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:58.987 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.987 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:58.987 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:58.988 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:58.988 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:58.988 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.988 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.988 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.988 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.988 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.988 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.988 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.988 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.988 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:58.988 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.988 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.988 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:58.989 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.989 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.989 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:58.989 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:58.989 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:58.989 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:58.989 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.989 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.989 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.989 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.989 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:58.989 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.989 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:58.989 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:58.990 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:58.990 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.990 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.990 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.990 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-open_pools_parallel.xml 2024-02-05T07:19:58.990 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.990 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.990 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.990 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.990 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.990 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:58.990 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.990 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.990 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.991 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.991 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.991 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.991 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.991 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.991 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.991 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.991 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:58.991 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:58.991 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:58.991 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.991 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:58.991 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.991 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:58.991 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:58.992 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.992 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:58.992 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:58.992 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.992 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:58.992 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.992 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:58.992 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:58.992 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.992 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:58.992 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.992 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:58.992 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:58.993 INFO:tasks.workunit.client.0.smithi184.stdout:test io on pid 82075 2024-02-05T07:19:58.997 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:58.997 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:58.997 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:58.997 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.997 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:58.997 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.998 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:58.998 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:58.998 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.998 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:58.998 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.998 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:58.998 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:58.998 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:58.998 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:58.998 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:58.998 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=io 2024-02-05T07:19:58.998 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:58.998 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82075 2024-02-05T07:19:58.998 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test io on pid 82075' 2024-02-05T07:19:58.999 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=82075 2024-02-05T07:19:58.999 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-05T07:19:58.999 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:58.999 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s ec_io 2024-02-05T07:19:58.999 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.999 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:58.999 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-02-05T07:19:58.999 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.999 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.999 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:58.999 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:58.999 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:58.999 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:58.999 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:58.999 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.000 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:59.000 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:59.000 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:59.000 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:59.000 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:59.000 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.000 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:59.000 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.000 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:59.000 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:59.000 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.000 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:59.000 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.000 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:59.001 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.001 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:59.001 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.001 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:59.001 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:59.001 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' ec_io' 2024-02-05T07:19:59.001 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:59.001 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:59.001 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:59.001 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:59.001 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:59.001 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.001 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:59.001 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.001 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.002 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:59.003 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.003 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:59.003 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:59.003 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:59.003 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:59.003 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:59.003 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:59.003 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:59.003 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.003 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:59.003 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.003 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:59.003 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:59.003 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.004 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.004 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:59.004 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.004 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:59.004 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.004 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:59.004 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:59.004 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.004 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:59.004 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.004 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:59.004 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:59.004 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:59.004 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:59.004 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:59.005 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.005 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:59.005 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.005 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:59.005 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:59.005 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.005 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81989/exe 2024-02-05T07:19:59.005 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.005 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:59.005 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.005 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:59.005 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.005 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:59.005 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:59.006 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.006 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:59.006 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.006 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:59.006 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:59.006 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:59.006 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo ec_io 2024-02-05T07:19:59.006 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:59.006 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:59.006 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:59.006 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:59.006 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81860/exe 2024-02-05T07:19:59.006 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:59.006 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:59.006 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:59.007 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:59.007 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:59.007 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:59.007 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:59.007 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_neorados_cmd.log 2024-02-05T07:19:59.007 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-02-05T07:19:59.007 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:59.007 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:59.007 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:59.007 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:59.007 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:59.007 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:59.007 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:59.007 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:59.008 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:59.008 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:59.008 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ cmd: /' 2024-02-05T07:19:59.008 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2024-02-05T07:19:59.008 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81910/exe 2024-02-05T07:19:59.008 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:59.008 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:59.008 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:59.008 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:59.008 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:59.008 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:59.008 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:59.008 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:59.008 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:59.009 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:59.009 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:59.009 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2024-02-05T07:19:59.009 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-02-05T07:19:59.009 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:59.009 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2024-02-05T07:19:59.009 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:59.009 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:59.009 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:59.009 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.009 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:59.009 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-delete_pools_parallel.xml 2024-02-05T07:19:59.009 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:59.009 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:59.010 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:59.010 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.010 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:59.010 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.010 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:59.010 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:59.010 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.010 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:59.010 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.010 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:59.010 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.010 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.010 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.010 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:59.011 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.011 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:59.011 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.011 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:59.011 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cls_remote_reads.xml 2024-02-05T07:19:59.011 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_neorados_cmd 2024-02-05T07:19:59.011 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.011 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:59.011 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.011 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:59.011 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:59.012 INFO:tasks.workunit.client.0.smithi184.stdout:test ec_io on pid 82160 2024-02-05T07:19:59.015 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=ec_io 2024-02-05T07:19:59.015 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82160 2024-02-05T07:19:59.015 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test ec_io on pid 82160' 2024-02-05T07:19:59.015 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=82160 2024-02-05T07:19:59.015 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-05T07:19:59.015 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:59.015 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/81938/exe 2024-02-05T07:19:59.015 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s list 2024-02-05T07:19:59.015 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' list' 2024-02-05T07:19:59.015 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2024-02-05T07:19:59.015 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:59.015 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:59.015 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:59.016 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:59.016 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:59.016 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:59.016 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:59.016 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:59.016 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:59.016 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:59.016 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:59.016 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:59.016 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:59.016 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:59.016 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:59.016 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.017 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:59.017 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:59.017 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ cls: /' 2024-02-05T07:19:59.017 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:59.017 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:59.017 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:59.017 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.017 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:59.017 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.017 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:59.017 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:59.017 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.017 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.017 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:59.017 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:59.018 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.019 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:59.019 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:59.019 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.019 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:59.019 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.019 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:59.019 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.019 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.019 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.019 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:59.019 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.019 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:59.019 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.019 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_neorados_cls 2024-02-05T07:19:59.019 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_neorados_cls.log 2024-02-05T07:19:59.020 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo list 2024-02-05T07:19:59.020 INFO:tasks.workunit.client.0.smithi184.stdout:test list on pid 82186 2024-02-05T07:19:59.021 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=list 2024-02-05T07:19:59.021 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82186 2024-02-05T07:19:59.021 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test list on pid 82186' 2024-02-05T07:19:59.021 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=82186 2024-02-05T07:19:59.022 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-05T07:19:59.022 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:59.022 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s ec_list 2024-02-05T07:19:59.022 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' ec_list' 2024-02-05T07:19:59.022 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo ec_list 2024-02-05T07:19:59.022 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2024-02-05T07:19:59.022 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-02-05T07:19:59.022 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:59.022 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:59.022 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:59.022 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:59.022 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.022 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:59.023 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:59.023 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:59.023 INFO:tasks.workunit.client.0.smithi184.stdout:test ec_list on pid 82203 2024-02-05T07:19:59.025 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=ec_list 2024-02-05T07:19:59.025 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82203 2024-02-05T07:19:59.025 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test ec_list on pid 82203' 2024-02-05T07:19:59.025 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=82203 2024-02-05T07:19:59.026 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-05T07:19:59.026 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:59.026 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s misc 2024-02-05T07:19:59.026 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' misc' 2024-02-05T07:19:59.026 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2024-02-05T07:19:59.026 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:59.026 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:59.026 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:59.026 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:59.026 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.026 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:59.026 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:59.026 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:59.027 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/82023/exe 2024-02-05T07:19:59.027 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:59.027 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:59.027 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.027 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:59.027 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.027 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:59.027 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:59.027 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:59.027 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.027 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:59.027 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.027 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:59.027 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:59.028 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:59.028 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.028 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:59.028 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.028 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:59.028 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.028 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:59.028 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:59.028 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:59.028 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.028 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:59.028 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.028 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:59.028 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:59.029 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:59.029 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.029 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:59.029 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.029 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:59.029 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:59.029 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:59.029 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.029 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:59.029 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.029 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:59.029 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.029 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:59.029 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:59.030 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:59.030 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:59.030 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:59.030 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:59.030 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:59.030 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:59.030 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:59.030 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:59.030 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:59.030 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:59.030 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:59.030 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:59.030 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.030 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:59.031 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:59.031 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.031 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:59.031 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:59.031 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.031 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:59.031 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:59.031 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.031 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:59.031 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.031 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:59.031 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_neorados_handler_error 2024-02-05T07:19:59.031 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:59.031 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.032 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:59.032 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.032 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:59.032 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.032 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.032 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.032 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:59.032 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.032 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:59.032 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.032 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo misc 2024-02-05T07:19:59.032 INFO:tasks.workunit.client.0.smithi184.stdout:test misc on pid 82237 2024-02-05T07:19:59.038 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=misc 2024-02-05T07:19:59.038 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82237 2024-02-05T07:19:59.038 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test misc on pid 82237' 2024-02-05T07:19:59.039 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=82237 2024-02-05T07:19:59.039 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-05T07:19:59.039 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:59.039 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:59.039 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:59.039 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.039 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:59.039 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.039 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:59.039 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:59.039 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.039 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:59.039 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.040 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:59.040 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.040 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.040 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.040 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:59.040 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.040 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:59.040 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.040 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s pool 2024-02-05T07:19:59.040 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' pool' 2024-02-05T07:19:59.040 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2024-02-05T07:19:59.040 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ handler_error: /' 2024-02-05T07:19:59.040 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_neorados_handler_error.log 2024-02-05T07:19:59.041 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:59.041 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:59.041 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:59.041 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:59.041 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.041 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:59.041 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo pool 2024-02-05T07:19:59.041 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:59.041 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:59.041 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:59.041 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.041 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:59.041 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.041 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:59.041 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:59.042 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.042 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:59.042 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.042 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:59.042 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.042 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.042 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.042 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:59.042 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.042 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:59.042 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.042 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:59.042 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:59.042 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:59.043 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.043 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:59.043 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.043 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:59.043 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:59.043 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:59.043 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.043 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:59.043 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.043 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:59.043 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:59.043 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:59.043 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.043 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:59.044 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.044 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:59.044 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.044 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:59.044 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:59.044 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:59.044 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.044 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:59.044 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.044 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:59.044 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:59.044 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.044 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:59.044 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.045 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:59.045 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.045 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:59.045 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.045 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:59.045 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:59.045 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:59.045 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:59.045 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:59.045 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.045 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:59.045 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.045 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:59.045 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:59.045 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.046 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:59.047 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:59.047 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.047 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:59.047 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:59.047 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:59.047 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.047 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:59.047 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.047 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:59.047 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:59.047 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.047 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:59.047 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.047 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:59.047 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:59.048 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.048 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:59.048 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:59.048 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.048 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:59.048 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:59.048 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.048 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:59.048 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:59.048 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.048 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:59.048 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:59.048 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:59.048 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.049 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:59.049 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.049 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:59.049 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:59.049 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:59.049 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.049 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:59.049 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.049 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:59.049 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.049 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:59.049 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:59.049 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:59.049 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.049 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:59.050 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.050 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:59.050 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:59.050 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.050 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.050 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:59.050 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.050 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:59.050 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.050 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:59.050 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:59.050 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.050 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:59.050 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.051 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:59.051 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:59.051 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:59.051 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.051 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:59.051 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.051 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:59.051 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:59.051 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/82160/exe 2024-02-05T07:19:59.051 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:59.051 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:59.051 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:59.051 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:59.051 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.052 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:59.052 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.052 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:59.052 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:59.052 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.052 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:59.052 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.052 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:59.052 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.052 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:59.052 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.052 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:59.052 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:59.052 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:59.052 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:59.053 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:59.053 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:59.053 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:59.053 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:59.053 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:59.053 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:59.053 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:59.053 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:59.053 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:59.053 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.053 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:59.053 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.053 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:59.053 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:59.054 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:59.054 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:59.054 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.054 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:59.054 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.054 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:59.054 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:59.054 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:59.054 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:59.054 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:59.054 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.054 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:59.054 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.054 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:59.054 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.055 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:59.055 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_neorados_ec_io 2024-02-05T07:19:59.055 INFO:tasks.workunit.client.0.smithi184.stdout:test pool on pid 82332 2024-02-05T07:19:59.056 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=pool 2024-02-05T07:19:59.056 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82332 2024-02-05T07:19:59.056 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_neorados_ec_io.log 2024-02-05T07:19:59.056 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test pool on pid 82332' 2024-02-05T07:19:59.056 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=82332 2024-02-05T07:19:59.057 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-05T07:19:59.057 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:59.057 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ ec_io: /' 2024-02-05T07:19:59.057 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:59.057 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:59.057 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:59.057 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.057 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:59.057 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.057 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:59.057 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:59.057 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.057 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:59.057 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:59.057 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:59.058 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s read_operations 2024-02-05T07:19:59.058 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.058 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:59.058 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.058 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:59.058 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:59.058 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.058 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' read_operations' 2024-02-05T07:19:59.058 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:59.058 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.058 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:59.058 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.058 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:59.058 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:59.058 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:59.059 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo read_operations 2024-02-05T07:19:59.059 INFO:tasks.workunit.client.0.smithi184.stdout:test read_operations on pid 82362 2024-02-05T07:19:59.063 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=read_operations 2024-02-05T07:19:59.063 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82362 2024-02-05T07:19:59.063 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test read_operations on pid 82362' 2024-02-05T07:19:59.063 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=82362 2024-02-05T07:19:59.063 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-05T07:19:59.063 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:59.064 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2024-02-05T07:19:59.064 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:59.064 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s snapshots 2024-02-05T07:19:59.064 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' snapshots' 2024-02-05T07:19:59.064 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:59.064 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:59.064 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:59.064 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:59.064 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.064 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:59.064 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2024-02-05T07:19:59.064 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:59.064 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:59.065 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:59.065 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.065 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:59.065 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.065 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:59.065 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:59.065 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:59.065 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:59.065 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:59.065 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.065 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.065 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:59.065 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:59.065 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.066 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.066 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:59.066 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:59.066 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.066 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.066 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.066 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:59.066 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:59.066 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.066 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:59.066 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.066 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:59.066 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.066 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.067 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:59.067 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.067 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:59.067 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.067 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:59.067 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:59.067 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:59.067 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:59.067 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:59.067 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.067 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:59.067 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.067 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:59.067 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:59.068 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.068 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.068 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:59.068 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.068 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:59.068 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.068 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:59.068 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:59.068 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:59.068 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.068 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:59.068 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.068 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:59.068 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:59.068 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:59.069 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:59.069 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:59.069 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:59.069 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:59.069 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.069 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:59.069 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:59.069 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:59.069 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:59.069 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.069 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:59.069 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.069 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo snapshots 2024-02-05T07:19:59.069 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:59.070 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:59.070 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.070 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.070 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:59.070 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.070 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:59.070 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.070 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:59.070 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/82203/exe 2024-02-05T07:19:59.070 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:59.070 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.070 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:59.070 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.070 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:59.071 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.071 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:59.071 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:59.071 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.071 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:59.071 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:59.071 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:59.071 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:59.071 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:59.071 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:59.071 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:59.071 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:59.071 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.071 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.071 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:59.072 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:59.072 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.072 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.072 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:59.072 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:59.072 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:59.072 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.072 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:59.072 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.072 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:59.072 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:59.072 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.072 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:59.072 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.073 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:59.073 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:59.073 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:59.073 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.073 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:59.073 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.073 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:59.073 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.073 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.073 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.073 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:59.073 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.073 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:59.073 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.074 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:59.074 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:59.074 INFO:tasks.workunit.client.0.smithi184.stdout:test snapshots on pid 82422 2024-02-05T07:19:59.080 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:59.080 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:59.080 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:59.081 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:59.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:59.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:59.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:59.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:59.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ ec_list: /' 2024-02-05T07:19:59.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=snapshots 2024-02-05T07:19:59.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82422 2024-02-05T07:19:59.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test snapshots on pid 82422' 2024-02-05T07:19:59.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=82422 2024-02-05T07:19:59.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-05T07:19:59.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:59.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_neorados_ec_list 2024-02-05T07:19:59.081 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_neorados_ec_list.log 2024-02-05T07:19:59.082 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:59.082 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.082 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/82075/exe 2024-02-05T07:19:59.082 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:59.082 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.082 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:59.082 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:59.082 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:59.082 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:59.082 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:59.082 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:59.082 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:59.082 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:59.082 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2024-02-05T07:19:59.083 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:59.083 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:59.083 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:59.083 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:59.083 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.083 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:59.083 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:59.083 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.083 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:59.083 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:59.083 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:59.083 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.083 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:59.083 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.084 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:59.084 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:59.084 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:59.084 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:59.084 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:59.084 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:59.084 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.084 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:59.084 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.084 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:59.084 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s watch_notify 2024-02-05T07:19:59.084 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.084 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' watch_notify' 2024-02-05T07:19:59.084 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:59.085 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_neorados_io.log 2024-02-05T07:19:59.085 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:59.085 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ io: /' 2024-02-05T07:19:59.085 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:59.085 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:59.085 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:59.085 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.085 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:59.085 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.085 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:59.085 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:59.085 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:59.085 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:59.086 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:59.086 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:59.086 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:59.086 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.086 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:59.086 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.086 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:59.086 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.086 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:59.086 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:59.086 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:59.086 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.086 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:59.086 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.087 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.087 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:59.087 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:59.087 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:59.087 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.087 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.087 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.087 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:59.087 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.087 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:59.087 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.087 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:59.087 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:59.087 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.088 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:59.088 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.088 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:59.088 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:59.088 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:59.088 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:59.088 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:59.088 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.088 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:59.088 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:59.088 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:59.088 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:59.088 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.088 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:59.089 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.089 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:59.089 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:59.089 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.089 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.089 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:59.089 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.089 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:59.089 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.089 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:59.089 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:59.089 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.089 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:59.089 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:59.090 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.090 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:59.090 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:59.090 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:59.090 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:59.090 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.090 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:59.090 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.090 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:59.090 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:59.090 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.090 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:59.090 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/82237/exe 2024-02-05T07:19:59.090 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.090 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:59.091 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.091 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.091 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.091 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:59.091 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.091 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:59.091 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.091 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:59.091 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:59.091 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:59.091 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:59.091 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.091 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:59.091 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.092 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:59.092 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:59.092 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.092 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:59.092 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:59.092 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_neorados_io 2024-02-05T07:19:59.092 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:59.092 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:59.092 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:59.092 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:59.092 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:59.092 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:59.092 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:59.092 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:59.093 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ misc: /' 2024-02-05T07:19:59.093 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:59.093 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:59.093 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:59.093 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.093 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:59.093 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.093 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:59.093 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:59.093 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:59.093 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.093 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:59.093 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.093 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:59.093 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:59.094 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:59.094 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.094 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:59.094 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.094 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:59.094 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.094 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_neorados_misc 2024-02-05T07:19:59.094 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo watch_notify 2024-02-05T07:19:59.094 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/82186/exe 2024-02-05T07:19:59.094 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_neorados_misc.log 2024-02-05T07:19:59.094 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:59.094 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:59.094 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:59.094 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:59.095 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:59.095 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:59.095 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:59.095 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:59.095 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:59.095 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:59.095 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:59.095 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:59.095 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ list: /' 2024-02-05T07:19:59.095 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:59.095 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:59.095 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:59.095 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.095 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:59.095 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.096 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:59.096 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:59.096 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.096 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_neorados_list 2024-02-05T07:19:59.096 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_neorados_list.log 2024-02-05T07:19:59.096 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:59.096 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:59.096 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:59.096 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.096 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:59.096 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.096 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:59.096 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:59.096 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.097 INFO:tasks.workunit.client.0.smithi184.stdout:test watch_notify on pid 82495 2024-02-05T07:19:59.101 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:59.101 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:59.101 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:59.101 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.101 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:59.101 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.101 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:59.101 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:59.101 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.101 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:59.102 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.102 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:59.102 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=watch_notify 2024-02-05T07:19:59.102 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.102 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:59.102 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.102 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:59.102 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:59.102 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82495 2024-02-05T07:19:59.102 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test watch_notify on pid 82495' 2024-02-05T07:19:59.102 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=82495 2024-02-05T07:19:59.102 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-05T07:19:59.102 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:59.102 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:59.103 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:59.103 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:59.103 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.103 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:59.103 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.103 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:59.103 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:59.103 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.103 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:59.103 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.103 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:59.103 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.103 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:59.103 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.103 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:59.104 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:59.104 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:59.104 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2024-02-05T07:19:59.104 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.104 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:59.104 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.104 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:59.104 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:59.104 INFO:tasks.workunit.client.0.smithi184.stderr:++ printf %25s write_operations 2024-02-05T07:19:59.104 INFO:tasks.workunit.client.0.smithi184.stderr:+ r=' write_operations' 2024-02-05T07:19:59.104 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:59.104 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:59.104 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:59.104 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:59.105 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.105 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:59.105 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.105 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:59.105 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:59.105 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.105 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:59.105 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.105 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:59.105 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:59.105 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:59.105 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.105 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:59.105 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.106 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:59.106 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:59.106 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:59.106 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:59.106 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.106 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:59.106 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:59.106 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:59.106 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:59.106 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:59.106 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.106 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:59.106 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.106 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:59.107 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:59.107 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:59.107 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.107 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.107 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:59.107 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.107 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:59.107 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.107 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:59.107 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:59.107 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.107 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:59.107 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.108 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:59.108 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:59.108 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.108 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:59.108 INFO:tasks.workunit.client.0.smithi184.stderr:++ echo write_operations 2024-02-05T07:19:59.108 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.108 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:59.108 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:59.108 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:59.108 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/82362/exe 2024-02-05T07:19:59.108 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:59.108 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:59.108 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:59.108 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.108 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:59.109 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.109 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:59.109 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:59.109 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.109 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:59.109 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.109 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:59.109 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.109 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.109 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.109 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:59.109 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:59.109 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.109 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:59.110 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.110 INFO:tasks.workunit.client.0.smithi184.stderr:++ awk '{print $1}' 2024-02-05T07:19:59.110 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:59.110 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:59.110 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:59.110 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:59.110 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:59.110 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:59.110 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:59.110 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:59.110 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:59.110 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:59.110 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:59.110 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:59.111 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:59.111 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.111 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:59.111 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.111 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:59.111 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:59.111 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.111 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.111 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:59.111 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.111 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:59.111 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.111 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:59.111 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:59.111 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.112 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:59.112 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.112 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:59.112 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:59.112 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.112 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:59.112 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.112 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:59.112 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_neorados_read_operations 2024-02-05T07:19:59.112 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:59.112 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ read_operations: /' 2024-02-05T07:19:59.112 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_neorados_read_operations.log 2024-02-05T07:19:59.112 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/82422/exe 2024-02-05T07:19:59.112 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:59.113 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:59.113 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:59.113 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:59.113 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.113 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:59.113 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.113 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:59.113 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:59.113 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.113 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.113 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:59.113 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.113 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:59.113 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.113 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:59.114 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:59.114 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:59.114 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.114 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:59.114 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.114 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:59.114 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:59.114 INFO:tasks.workunit.client.0.smithi184.stderr:+ ff=write_operations 2024-02-05T07:19:59.114 INFO:tasks.workunit.client.0.smithi184.stdout:test write_operations on pid 82552 2024-02-05T07:19:59.120 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82552 2024-02-05T07:19:59.120 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:59.120 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo 'test write_operations on pid 82552' 2024-02-05T07:19:59.120 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:59.120 INFO:tasks.workunit.client.0.smithi184.stderr:+ pids[$f]=82552 2024-02-05T07:19:59.120 INFO:tasks.workunit.client.0.smithi184.stderr:+ ret=0 2024-02-05T07:19:59.120 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:59.120 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:59.120 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 1 -eq 1 ']' 2024-02-05T07:19:59.120 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:59.120 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:59.120 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/82332/exe 2024-02-05T07:19:59.121 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:19:59.121 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81342 2024-02-05T07:19:59.121 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81342 2024-02-05T07:19:59.121 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:59.121 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:59.121 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:59.121 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:59.121 INFO:tasks.workunit.client.0.smithi184.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2024-02-05T07:19:59.121 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:59.121 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ snapshots: /' 2024-02-05T07:19:59.121 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:59.121 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:59.121 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:59.121 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:59.122 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:59.122 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.122 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:59.122 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:59.122 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.122 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:59.122 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:59.122 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:59.122 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:59.122 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:59.122 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:59.122 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.122 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:59.122 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.123 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:59.123 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:59.123 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:59.123 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:59.123 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.123 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:59.123 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.123 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:59.123 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.123 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:59.123 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:59.123 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:59.123 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_neorados_snapshots 2024-02-05T07:19:59.123 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_neorados_snapshots.log 2024-02-05T07:19:59.124 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -f /etc/bashrc ']' 2024-02-05T07:19:59.124 INFO:tasks.workunit.client.0.smithi184.stderr:+ . /etc/bashrc 2024-02-05T07:19:59.124 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -z '' ']' 2024-02-05T07:19:59.124 INFO:tasks.workunit.client.0.smithi184.stderr:++ BASHRCSOURCED=Y 2024-02-05T07:19:59.124 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.124 INFO:tasks.workunit.client.0.smithi184.stderr:++ shopt -q login_shell 2024-02-05T07:19:59.124 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_neorados_pool.log 2024-02-05T07:19:59.124 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ pool: /' 2024-02-05T07:19:59.124 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_neorados_pool 2024-02-05T07:19:59.124 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:59.127 INFO:tasks.workunit.client.0.smithi184.stderr:+++ umask 2024-02-05T07:19:59.127 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:59.127 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:59.127 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.127 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:59.127 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.127 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:59.127 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' 0022 -eq 0 ']' 2024-02-05T07:19:59.127 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:59.127 INFO:tasks.workunit.client.0.smithi184.stderr:++ SHELL=/bin/bash 2024-02-05T07:19:59.128 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.128 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.128 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/bash_completion.sh ']' 2024-02-05T07:19:59.128 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.128 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/bash_completion.sh 2024-02-05T07:19:59.128 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' 'x5.1.8(1)-release' '!=' x -a x '!=' x -a x = x ']' 2024-02-05T07:19:59.128 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.128 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/cobbler.sh ']' 2024-02-05T07:19:59.128 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.128 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/cobbler.sh 2024-02-05T07:19:59.128 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.128 INFO:tasks.workunit.client.0.smithi184.stderr:+++ COBBLER_SERVER=172.21.0.11 2024-02-05T07:19:59.129 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.129 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorgrep.sh ']' 2024-02-05T07:19:59.129 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.129 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorgrep.sh 2024-02-05T07:19:59.129 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.129 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:59.129 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:59.129 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:59.129 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'grep=grep --color=auto' 2024-02-05T07:19:59.129 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.129 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:59.129 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'egrep=egrep --color=auto' 2024-02-05T07:19:59.129 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.129 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:59.130 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'fgrep=fgrep --color=auto' 2024-02-05T07:19:59.130 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.130 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorls.sh ']' 2024-02-05T07:19:59.130 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.130 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:59.130 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorls.sh 2024-02-05T07:19:59.130 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.130 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:59.130 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.130 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:59.130 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' '!' -t 0 ']' 2024-02-05T07:19:59.130 INFO:tasks.workunit.client.0.smithi184.stderr:+++ return 2024-02-05T07:19:59.130 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.130 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorsysstat.sh ']' 2024-02-05T07:19:59.131 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.131 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorsysstat.sh 2024-02-05T07:19:59.131 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export S_COLORS=auto 2024-02-05T07:19:59.131 INFO:tasks.workunit.client.0.smithi184.stderr:+++ S_COLORS=auto 2024-02-05T07:19:59.131 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.131 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorxzgrep.sh ']' 2024-02-05T07:19:59.131 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.131 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.131 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorxzgrep.sh 2024-02-05T07:19:59.131 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:59.131 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.131 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:59.131 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.131 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:59.131 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:59.132 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.132 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:59.132 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.132 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:59.132 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:59.132 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:59.132 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:59.132 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:59.132 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:59.132 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.132 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:59.132 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.132 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:59.132 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:59.133 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.133 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.133 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:59.133 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.133 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:59.133 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.133 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:59.133 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:59.133 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.133 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:59.133 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.133 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:59.133 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:59.134 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzgrep=xzgrep --color=auto' 2024-02-05T07:19:59.134 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzegrep=xzegrep --color=auto' 2024-02-05T07:19:59.134 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'xzfgrep=xzfgrep --color=auto' 2024-02-05T07:19:59.134 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.134 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/colorzgrep.sh ']' 2024-02-05T07:19:59.134 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.134 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/colorzgrep.sh 2024-02-05T07:19:59.134 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /usr/libexec/grepconf.sh ']' 2024-02-05T07:19:59.134 INFO:tasks.workunit.client.0.smithi184.stderr:+++ /usr/libexec/grepconf.sh -c 2024-02-05T07:19:59.134 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/82495/exe 2024-02-05T07:19:59.134 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:59.134 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:59.134 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:59.134 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:59.135 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:59.135 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:59.135 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:59.135 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:59.135 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:59.135 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:59.135 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:59.135 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_neorados_watch_notify 2024-02-05T07:19:59.135 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ watch_notify: /' 2024-02-05T07:19:59.135 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_neorados_watch_notify.log 2024-02-05T07:19:59.135 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zgrep=zgrep --color=auto' 2024-02-05T07:19:59.135 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zfgrep=zfgrep --color=auto' 2024-02-05T07:19:59.135 INFO:tasks.workunit.client.0.smithi184.stderr:+++ alias 'zegrep=zegrep --color=auto' 2024-02-05T07:19:59.135 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.135 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/debuginfod.sh ']' 2024-02-05T07:19:59.136 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.136 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/debuginfod.sh 2024-02-05T07:19:59.136 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z 'https://debuginfod.centos.org/ ' ']' 2024-02-05T07:19:59.136 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.136 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/gawk.sh ']' 2024-02-05T07:19:59.136 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.136 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/gawk.sh 2024-02-05T07:19:59.136 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.136 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/lang.sh ']' 2024-02-05T07:19:59.136 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.136 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/lang.sh 2024-02-05T07:19:59.136 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup 2024-02-05T07:19:59.136 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/locale 2024-02-05T07:19:59.137 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.137 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG_backup=en_US.UTF-8 2024-02-05T07:19:59.137 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.137 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /etc/locale.conf ']' 2024-02-05T07:19:59.137 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -x /usr/bin/sed ']' 2024-02-05T07:19:59.137 INFO:tasks.workunit.client.0.smithi184.stderr:++++ /usr/bin/sed -r -e 's/^[[:blank:]]*([[:upper:]_]+)=([[:print:][:digit:]\._-]+|"[[:print:][:digit:]\._-]+")/export \1=\2/;t;d' /etc/locale.conf 2024-02-05T07:19:59.137 INFO:tasks.workunit.client.0.smithi184.stderr:+++ eval export 'LANG="en_US.UTF-8"' 2024-02-05T07:19:59.137 INFO:tasks.workunit.client.0.smithi184.stderr:++++ export LANG=en_US.UTF-8 2024-02-05T07:19:59.137 INFO:tasks.workunit.client.0.smithi184.stderr:++++ LANG=en_US.UTF-8 2024-02-05T07:19:59.137 INFO:tasks.workunit.client.0.smithi184.stderr:+++ for config in /etc/locale.conf "${HOME}/.i18n" 2024-02-05T07:19:59.137 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -f /home/ubuntu/.i18n ']' 2024-02-05T07:19:59.137 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.137 INFO:tasks.workunit.client.0.smithi184.stderr:+++ LANG=en_US.UTF-8 2024-02-05T07:19:59.137 INFO:tasks.workunit.client.0.smithi184.stderr:+++ unset LANG_backup config 2024-02-05T07:19:59.138 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n '' ']' 2024-02-05T07:19:59.138 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -n en_US.UTF-8 ']' 2024-02-05T07:19:59.138 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' dumb = linux ']' 2024-02-05T07:19:59.138 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.138 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/less.sh ']' 2024-02-05T07:19:59.138 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.138 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/less.sh 2024-02-05T07:19:59.138 INFO:tasks.workunit.client.0.smithi184.stderr:+++ '[' -z '||/usr/bin/lesspipe.sh %s' ']' 2024-02-05T07:19:59.138 INFO:tasks.workunit.client.0.smithi184.stderr:++ for i in /etc/profile.d/*.sh 2024-02-05T07:19:59.138 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' -r /etc/profile.d/which2.sh ']' 2024-02-05T07:19:59.138 INFO:tasks.workunit.client.0.smithi184.stderr:++ '[' '' ']' 2024-02-05T07:19:59.138 INFO:tasks.workunit.client.0.smithi184.stderr:++ . /etc/profile.d/which2.sh 2024-02-05T07:19:59.138 INFO:tasks.workunit.client.0.smithi184.stderr:+++ case "$(basename $(readlink /proc/$$/exe))" in 2024-02-05T07:19:59.138 INFO:tasks.workunit.client.0.smithi184.stderr:+++++ readlink /proc/82552/exe 2024-02-05T07:19:59.138 INFO:tasks.workunit.client.0.smithi184.stderr:++++ basename /usr/bin/bash 2024-02-05T07:19:59.139 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_declare='declare -f' 2024-02-05T07:19:59.139 INFO:tasks.workunit.client.0.smithi184.stderr:+++ which_opt=-f 2024-02-05T07:19:59.139 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export which_declare 2024-02-05T07:19:59.139 INFO:tasks.workunit.client.0.smithi184.stderr:+++ export -f which 2024-02-05T07:19:59.139 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset i 2024-02-05T07:19:59.139 INFO:tasks.workunit.client.0.smithi184.stderr:++ unset -f pathmunge 2024-02-05T07:19:59.139 INFO:tasks.workunit.client.0.smithi184.stderr:+ [[ /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin =~ /home/ubuntu/\.local/bin:/home/ubuntu/bin: ]] 2024-02-05T07:19:59.139 INFO:tasks.workunit.client.0.smithi184.stderr:+ export PATH 2024-02-05T07:19:59.139 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' -d /home/ubuntu/.bashrc.d ']' 2024-02-05T07:19:59.139 INFO:tasks.workunit.client.0.smithi184.stderr:+ unset rc 2024-02-05T07:19:59.139 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph_test_neorados_write_operations 2024-02-05T07:19:59.139 INFO:tasks.workunit.client.0.smithi184.stderr:+ tee ceph_test_neorados_write_operations.log 2024-02-05T07:19:59.139 INFO:tasks.workunit.client.0.smithi184.stderr:+ sed 's/^/ write_operations: /' 2024-02-05T07:19:59.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:59.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:19:59.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:19:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3942275240' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-02-05T07:19:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:19:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:19:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3942275240' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-02-05T07:19:59.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:19:59.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:19:59.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:19:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3942275240' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-02-05T07:20:02.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:20:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:20:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:20:04.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:04 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1090727750' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi184-82326-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:04.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:04 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1688798005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi184-82412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:04.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:04 smithi184 ceph-mon[29861]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:04.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:04 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1090727750' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi184-82326-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:04.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:04 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1688798005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi184-82412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:04.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:04 smithi184 ceph-mon[41609]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:04.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:04 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1090727750' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi184-82326-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:04.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:04 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1688798005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi184-82412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:04.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:04 smithi188 ceph-mon[33283]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:07.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:20:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:20:07.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:07 smithi188 ceph-mon[33283]: pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:20:07.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:07 smithi188 ceph-mon[33283]: from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi184-82326-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:07.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3106673358' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi184-81228-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:07 smithi188 ceph-mon[33283]: pgmap v66: 196 pgs: 64 unknown, 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:20:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:07 smithi188 ceph-mon[33283]: pgmap v67: 196 pgs: 46 creating+peering, 132 active+clean, 18 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:20:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1256105322' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-05T07:20:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:07 smithi188 ceph-mon[33283]: osdmap e73: 8 total, 8 up, 8 in 2024-02-05T07:20:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:07 smithi188 ceph-mon[33283]: overall HEALTH_OK 2024-02-05T07:20:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:07 smithi188 ceph-mon[33283]: from='client.24880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi184-82412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:07 smithi188 ceph-mon[33283]: from='client.34664 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi184-81228-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3624303289' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi184-81207-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:07 smithi188 ceph-mon[33283]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[29861]: pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:20:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[29861]: from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi184-82326-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3106673358' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi184-81228-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[29861]: pgmap v66: 196 pgs: 64 unknown, 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:20:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[29861]: pgmap v67: 196 pgs: 46 creating+peering, 132 active+clean, 18 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:20:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1256105322' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-05T07:20:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[29861]: osdmap e73: 8 total, 8 up, 8 in 2024-02-05T07:20:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[29861]: overall HEALTH_OK 2024-02-05T07:20:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[29861]: from='client.24880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi184-82412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[29861]: from='client.34664 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi184-81228-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:07.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3624303289' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi184-81207-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:07.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[29861]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[41609]: pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:20:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[41609]: from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi184-82326-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3106673358' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi184-81228-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[41609]: pgmap v66: 196 pgs: 64 unknown, 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:20:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[41609]: pgmap v67: 196 pgs: 46 creating+peering, 132 active+clean, 18 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:20:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1256105322' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-05T07:20:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[41609]: osdmap e73: 8 total, 8 up, 8 in 2024-02-05T07:20:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[41609]: overall HEALTH_OK 2024-02-05T07:20:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[41609]: from='client.24880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi184-82412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:07.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[41609]: from='client.34664 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi184-81228-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:07.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3624303289' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi184-81207-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:07.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:07 smithi184 ceph-mon[41609]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:08.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2024-02-05T07:20:08.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: [----------] Global test environment set-up. 2024-02-05T07:20:08.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: [----------] 4 tests from LibRadosService 2024-02-05T07:20:08.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-02-05T07:20:08.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5073 ms) 2024-02-05T07:20:08.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-02-05T07:20:08.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: [ OK ] LibRadosService.RegisterLate (28 ms) 2024-02-05T07:20:08.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-02-05T07:20:08.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: cluster: 2024-02-05T07:20:08.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: id: ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:20:08.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: health: HEALTH_OK 2024-02-05T07:20:08.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2024-02-05T07:20:08.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: services: 2024-02-05T07:20:08.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 6m) 2024-02-05T07:20:08.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: mgr: y(active, since 2m), standbys: x 2024-02-05T07:20:08.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: osd: 8 osds: 8 up (since 2m), 8 in (since 3m) 2024-02-05T07:20:08.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-02-05T07:20:08.121 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2024-02-05T07:20:08.121 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: data: 2024-02-05T07:20:08.121 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: pools: 6 pools, 132 pgs 2024-02-05T07:20:08.121 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: objects: 198 objects, 582 KiB 2024-02-05T07:20:08.121 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: usage: 239 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:20:08.121 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: pgs: 132 active+clean 2024-02-05T07:20:08.121 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2024-02-05T07:20:08.121 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: io: 2024-02-05T07:20:08.121 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-02-05T07:20:08.121 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2024-02-05T07:20:08.121 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2024-02-05T07:20:08.121 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: cluster: 2024-02-05T07:20:08.121 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: id: ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:20:08.121 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: health: HEALTH_OK 2024-02-05T07:20:08.121 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2024-02-05T07:20:08.122 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: services: 2024-02-05T07:20:08.122 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 6m) 2024-02-05T07:20:08.122 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: mgr: y(active, since 2m), standbys: x 2024-02-05T07:20:08.122 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: osd: 8 osds: 8 up (since 3m), 8 in (since 3m) 2024-02-05T07:20:08.122 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-02-05T07:20:08.122 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2024-02-05T07:20:08.122 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: data: 2024-02-05T07:20:08.122 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: pools: 6 pools, 132 pgs 2024-02-05T07:20:08.122 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: objects: 198 objects, 582 KiB 2024-02-05T07:20:08.122 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: usage: 239 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:20:08.122 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: pgs: 132 active+clean 2024-02-05T07:20:08.122 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2024-02-05T07:20:08.122 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: io: 2024-02-05T07:20:08.122 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-02-05T07:20:08.123 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2024-02-05T07:20:08.123 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2024-02-05T07:20:08.123 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: cluster: 2024-02-05T07:20:08.123 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: id: ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:20:08.123 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: health: HEALTH_WARN 2024-02-05T07:20:08.123 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2 pool(s) do not have an application enabled 2024-02-05T07:20:08.123 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2024-02-05T07:20:08.123 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: services: 2024-02-05T07:20:08.123 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 6m) 2024-02-05T07:20:08.123 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: mgr: y(active, since 2m), standbys: x 2024-02-05T07:20:08.123 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: osd: 8 osds: 8 up (since 3m), 8 in (since 3m) 2024-02-05T07:20:08.123 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-02-05T07:20:08.123 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-02-05T07:20:08.123 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-02-05T07:20:08.123 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2024-02-05T07:20:08.124 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: data: 2024-02-05T07:20:08.124 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: pools: 8 pools, 196 pgs 2024-02-05T07:20:08.124 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: objects: 198 objects, 582 KiB 2024-02-05T07:20:08.124 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: usage: 239 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:20:08.124 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: pgs: 9.184% pgs unknown 2024-02-05T07:20:08.124 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 23.469% pgs not active 2024-02-05T07:20:08.124 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 132 active+clean 2024-02-05T07:20:08.124 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 46 creating+peering 2024-02-05T07:20:08.124 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 18 unknown 2024-02-05T07:20:08.124 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2024-02-05T07:20:08.124 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: io: 2024-02-05T07:20:08.124 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: client: 1023 B/s rd, 0 op/s rd, 0 op/s wr 2024-02-05T07:20:08.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: pgmap v68: 196 pgs: 46 creating+peering, 132 active+clean, 18 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:20:08.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3885743535' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi184-81317-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi184-81303-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4208220677' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi184-81638-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4239499306' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi184-81307-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3603841287' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3869358426' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi184-81478-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1581121587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi184-81575-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.674 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1200932626' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi184-81609-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.674 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/55031925' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi184-81647-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.674 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1905266881' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi184-81802-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.674 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4035659134' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.674 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2446468873' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi184-82008-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.674 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3425612320' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi184-81272-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.674 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.674 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1134938965' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi184-81247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: pgmap v68: 196 pgs: 46 creating+peering, 132 active+clean, 18 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:20:08.675 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3885743535' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi184-81317-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.675 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi184-81303-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.675 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4208220677' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi184-81638-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.675 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4239499306' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi184-81307-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.675 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3603841287' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.675 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3869358426' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi184-81478-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.675 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1581121587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi184-81575-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.675 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1200932626' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi184-81609-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.675 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/55031925' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi184-81647-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.675 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1905266881' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi184-81802-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.675 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4035659134' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.675 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2446468873' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi184-82008-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.675 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3425612320' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi184-81272-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.675 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.676 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1134938965' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi184-81247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.676 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/861215046' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-05T07:20:08.676 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: pgmap v70: 900 pgs: 46 creating+peering, 132 active+clean, 722 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-05T07:20:08.676 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: osdmap e74: 8 total, 8 up, 8 in 2024-02-05T07:20:08.676 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:08.676 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:08.676 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.34700 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi184-81317-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.676 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24742 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi184-81638-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.677 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.34706 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi184-81303-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.677 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24688 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi184-81307-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.677 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.34673 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi184-81247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.677 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24718 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.678 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24727 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi184-81478-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.678 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24730 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi184-81575-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.678 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24739 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi184-81609-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.678 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24748 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi184-81647-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.678 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi184-81802-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.678 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24787 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.678 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24802 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi184-82008-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.678 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24685 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi184-81272-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.678 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24709 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.678 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:08.678 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi184-82412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:08.678 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi184-82326-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:08.678 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.34664 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi184-81228-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:08.679 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3624303289' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi184-81207-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:08.679 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1090727750' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi184-82326-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:08.679 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1688798005' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi184-82412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:08.679 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/182428375' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81815-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.679 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4125135043' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81840-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.679 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3032047324' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-82135-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.679 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: osdmap e75: 8 total, 8 up, 8 in 2024-02-05T07:20:08.679 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi184-82326-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:08.679 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24880 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi184-82412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:08.679 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24856 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81815-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.679 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24859 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81840-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.679 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.24871 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-82135-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.679 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3386322112' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-05T07:20:08.680 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/861215046' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-05T07:20:08.680 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: pgmap v70: 900 pgs: 46 creating+peering, 132 active+clean, 722 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-05T07:20:08.680 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: osdmap e74: 8 total, 8 up, 8 in 2024-02-05T07:20:08.680 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:08.680 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:08.680 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.34700 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi184-81317-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.681 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24742 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi184-81638-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.681 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.34706 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi184-81303-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.681 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24688 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi184-81307-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.681 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.34673 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi184-81247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.681 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24718 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.681 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24727 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi184-81478-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.681 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24730 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi184-81575-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.681 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24739 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi184-81609-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.681 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24748 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi184-81647-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.681 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi184-81802-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.681 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24787 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.681 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24802 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi184-82008-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.681 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24685 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi184-81272-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.681 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24709 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.682 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:08.682 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi184-82412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:08.682 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi184-82326-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:08.682 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.34664 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi184-81228-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:08.682 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3624303289' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi184-81207-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:08.682 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1090727750' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi184-82326-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:08.682 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1688798005' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi184-82412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:08.682 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/182428375' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81815-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.682 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4125135043' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81840-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.682 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3032047324' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-82135-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.682 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: osdmap e75: 8 total, 8 up, 8 in 2024-02-05T07:20:08.682 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi184-82326-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:08.682 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24880 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi184-82412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:08.682 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24856 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81815-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.683 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24859 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81840-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.683 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.24871 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-82135-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.683 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3386322112' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-05T07:20:08.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: pgmap v68: 196 pgs: 46 creating+peering, 132 active+clean, 18 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:20:08.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3885743535' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi184-81317-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi184-81303-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4208220677' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi184-81638-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4239499306' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi184-81307-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3603841287' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3869358426' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi184-81478-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1581121587' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi184-81575-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1200932626' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi184-81609-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/55031925' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi184-81647-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1905266881' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi184-81802-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4035659134' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2446468873' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi184-82008-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3425612320' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi184-81272-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1134938965' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi184-81247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/861215046' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-05T07:20:08.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: pgmap v70: 900 pgs: 46 creating+peering, 132 active+clean, 722 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-05T07:20:08.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: osdmap e74: 8 total, 8 up, 8 in 2024-02-05T07:20:08.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:08.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:08.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.34700 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi184-81317-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24742 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi184-81638-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.34706 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi184-81303-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24688 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi184-81307-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.34673 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi184-81247-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24718 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24727 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi184-81478-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24730 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi184-81575-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24739 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi184-81609-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24748 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi184-81647-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24763 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi184-81802-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24787 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24802 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi184-82008-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24685 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi184-81272-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24709 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:08.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi184-82412-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:08.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi184-82326-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:08.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.34664 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi184-81228-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:08.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3624303289' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi184-81207-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:08.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1090727750' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi184-82326-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:08.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1688798005' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi184-82412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:08.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/182428375' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81815-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4125135043' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81840-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3032047324' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-82135-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: osdmap e75: 8 total, 8 up, 8 in 2024-02-05T07:20:08.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi184-82326-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:08.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24880 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi184-82412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:08.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24856 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81815-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24859 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81840-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.24871 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-82135-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:08.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3386322112' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-05T07:20:08.800 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [==========] Running 12 tests from 1 test suite. 2024-02-05T07:20:08.800 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [----------] Global test environment set-up. 2024-02-05T07:20:08.800 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [----------] 12 tests from AsioRados 2024-02-05T07:20:08.801 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-02-05T07:20:08.801 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (1 ms) 2024-02-05T07:20:08.801 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-02-05T07:20:08.801 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (2 ms) 2024-02-05T07:20:08.802 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-02-05T07:20:08.802 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (0 ms) 2024-02-05T07:20:08.802 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-02-05T07:20:08.802 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (10 ms) 2024-02-05T07:20:08.802 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-02-05T07:20:08.802 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (2 ms) 2024-02-05T07:20:08.802 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-02-05T07:20:08.802 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (2 ms) 2024-02-05T07:20:08.802 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-02-05T07:20:08.802 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (1 ms) 2024-02-05T07:20:08.802 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-02-05T07:20:08.802 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (1 ms) 2024-02-05T07:20:08.802 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-02-05T07:20:08.802 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (0 ms) 2024-02-05T07:20:08.802 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-02-05T07:20:08.803 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (3 ms) 2024-02-05T07:20:08.803 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-02-05T07:20:08.803 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (3 ms) 2024-02-05T07:20:08.803 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-02-05T07:20:08.803 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (3 ms) 2024-02-05T07:20:08.803 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [----------] 12 tests from AsioRados (28 ms total) 2024-02-05T07:20:08.803 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: 2024-02-05T07:20:08.803 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [----------] Global test environment tear-down 2024-02-05T07:20:08.803 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (10092 ms total) 2024-02-05T07:20:08.803 INFO:tasks.workunit.client.0.smithi184.stdout: api_asio: [ PASSED ] 12 tests. 2024-02-05T07:20:09.113 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2024-02-05T07:20:09.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [----------] Global test environment set-up. 2024-02-05T07:20:09.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [----------] 7 tests from LibRadosList 2024-02-05T07:20:09.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-02-05T07:20:09.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ OK ] LibRadosList.ListObjects (428 ms) 2024-02-05T07:20:09.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-02-05T07:20:09.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (36 ms) 2024-02-05T07:20:09.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-02-05T07:20:09.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: myset foo1,foo2,foo3 2024-02-05T07:20:09.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo1 2024-02-05T07:20:09.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo2 2024-02-05T07:20:09.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo3 2024-02-05T07:20:09.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: myset foo1,foo4,foo5 2024-02-05T07:20:09.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo4 2024-02-05T07:20:09.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo5 2024-02-05T07:20:09.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo1 2024-02-05T07:20:09.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: myset foo6,foo7 2024-02-05T07:20:09.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo7 2024-02-05T07:20:09.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo6 2024-02-05T07:20:09.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-02-05T07:20:09.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: ns1:foo4 2024-02-05T07:20:09.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: ns1:foo5 2024-02-05T07:20:09.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: ns2:foo7 2024-02-05T07:20:09.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: ns2:foo6 2024-02-05T07:20:09.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: ns1:foo1 2024-02-05T07:20:09.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: :foo1 2024-02-05T07:20:09.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: :foo2 2024-02-05T07:20:09.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: :foo3 2024-02-05T07:20:09.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (74 ms) 2024-02-05T07:20:09.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-02-05T07:20:09.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 1 0 2024-02-05T07:20:09.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 10 0 2024-02-05T07:20:09.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 13 0 2024-02-05T07:20:09.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 7 0 2024-02-05T07:20:09.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 14 0 2024-02-05T07:20:09.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 0 0 2024-02-05T07:20:09.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 15 0 2024-02-05T07:20:09.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 11 0 2024-02-05T07:20:09.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 5 0 2024-02-05T07:20:09.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 8 0 2024-02-05T07:20:09.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 6 0 2024-02-05T07:20:09.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 3 0 2024-02-05T07:20:09.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 4 0 2024-02-05T07:20:09.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 12 0 2024-02-05T07:20:09.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 9 0 2024-02-05T07:20:09.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 2 0 2024-02-05T07:20:09.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-02-05T07:20:09.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (69 ms) 2024-02-05T07:20:09.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-02-05T07:20:09.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: x cursor=MIN 2024-02-05T07:20:09.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=1 cursor=14:02547ec2:::1:head 2024-02-05T07:20:09.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=10 cursor=14:52ea6a34:::10:head 2024-02-05T07:20:09.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=13 cursor=14:566253c9:::13:head 2024-02-05T07:20:09.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=7 cursor=14:5c6b0b28:::7:head 2024-02-05T07:20:09.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=14 cursor=14:62a1935d:::14:head 2024-02-05T07:20:09.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=0 cursor=14:6cac518f:::0:head 2024-02-05T07:20:09.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=15 cursor=14:863748b0:::15:head 2024-02-05T07:20:09.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=11 cursor=14:89d3ae78:::11:head 2024-02-05T07:20:09.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=5 cursor=14:b29083e3:::5:head 2024-02-05T07:20:09.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=8 cursor=14:bd63b0f1:::8:head 2024-02-05T07:20:09.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=6 cursor=14:c4fdafeb:::6:head 2024-02-05T07:20:09.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=3 cursor=14:cfc208b3:::3:head 2024-02-05T07:20:09.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=4 cursor=14:d83876eb:::4:head 2024-02-05T07:20:09.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=12 cursor=14:de5d7c5f:::12:head 2024-02-05T07:20:09.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=9 cursor=14:e960b815:::9:head 2024-02-05T07:20:09.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > oid=2 cursor=14:f905c69b:::2:head 2024-02-05T07:20:09.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: FIRST> seek to MIN oid=1 2024-02-05T07:20:09.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=1 cursor=14:02547ec2:::1:head 2024-02-05T07:20:09.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:02547ec2:::1:head 2024-02-05T07:20:09.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:02547ec2:::1:head -> 1 2024-02-05T07:20:09.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=10 cursor=14:52ea6a34:::10:head 2024-02-05T07:20:09.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:52ea6a34:::10:head 2024-02-05T07:20:09.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:52ea6a34:::10:head -> 10 2024-02-05T07:20:09.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=13 cursor=14:566253c9:::13:head 2024-02-05T07:20:09.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:566253c9:::13:head 2024-02-05T07:20:09.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:566253c9:::13:head -> 13 2024-02-05T07:20:09.119 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=7 cursor=14:5c6b0b28:::7:head 2024-02-05T07:20:09.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:5c6b0b28:::7:head 2024-02-05T07:20:09.120 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:5c6b0b28:::7:head -> 7 2024-02-05T07:20:09.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=14 cursor=14:62a1935d:::14:head 2024-02-05T07:20:09.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:62a1935d:::14:head 2024-02-05T07:20:09.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:62a1935d:::14:head -> 14 2024-02-05T07:20:09.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=0 cursor=14:6cac518f:::0:head 2024-02-05T07:20:09.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:6cac518f:::0:head 2024-02-05T07:20:09.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:6cac518f:::0:head -> 0 2024-02-05T07:20:09.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=15 cursor=14:863748b0:::15:head 2024-02-05T07:20:09.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:863748b0:::15:head 2024-02-05T07:20:09.172 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:863748b0:::15:head -> 15 2024-02-05T07:20:09.172 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=11 cursor=14:89d3ae78:::11:head 2024-02-05T07:20:09.172 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:89d3ae78:::11:head 2024-02-05T07:20:09.172 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:89d3ae78:::11:head -> 11 2024-02-05T07:20:09.172 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=5 cursor=14:b29083e3:::5:head 2024-02-05T07:20:09.172 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:b29083e3:::5:head 2024-02-05T07:20:09.172 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:b29083e3:::5:head -> 5 2024-02-05T07:20:09.172 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=8 cursor=14:bd63b0f1:::8:head 2024-02-05T07:20:09.172 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:bd63b0f1:::8:head 2024-02-05T07:20:09.172 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:bd63b0f1:::8:head -> 8 2024-02-05T07:20:09.173 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=6 cursor=14:c4fdafeb:::6:head 2024-02-05T07:20:09.173 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:c4fdafeb:::6:head 2024-02-05T07:20:09.173 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:c4fdafeb:::6:head -> 6 2024-02-05T07:20:09.173 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=3 cursor=14:cfc208b3:::3:head 2024-02-05T07:20:09.173 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:cfc208b3:::3:head 2024-02-05T07:20:09.173 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:cfc208b3:::3:head -> 3 2024-02-05T07:20:09.173 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=4 cursor=14:d83876eb:::4:head 2024-02-05T07:20:09.173 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:d83876eb:::4:head 2024-02-05T07:20:09.173 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:d83876eb:::4:head -> 4 2024-02-05T07:20:09.173 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=12 cursor=14:de5d7c5f:::12:head 2024-02-05T07:20:09.173 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:de5d7c5f:::12:head 2024-02-05T07:20:09.173 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:de5d7c5f:::12:head -> 12 2024-02-05T07:20:09.173 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=9 cursor=14:e960b815:::9:head 2024-02-05T07:20:09.174 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:e960b815:::9:head 2024-02-05T07:20:09.174 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:e960b815:::9:head -> 9 2024-02-05T07:20:09.174 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : oid=2 cursor=14:f905c69b:::2:head 2024-02-05T07:20:09.174 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:f905c69b:::2:head 2024-02-05T07:20:09.174 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:f905c69b:::2:head -> 2 2024-02-05T07:20:09.174 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:f905c69b:::2:head 2024-02-05T07:20:09.174 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:f905c69b:::2:head expected=14:f905c69b:::2:head 2024-02-05T07:20:09.174 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:f905c69b:::2:head -> 2 2024-02-05T07:20:09.174 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : entry=2 expected=2 2024-02-05T07:20:09.174 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:e960b815:::9:head 2024-02-05T07:20:09.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:e960b815:::9:head expected=14:e960b815:::9:head 2024-02-05T07:20:09.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:e960b815:::9:head -> 9 2024-02-05T07:20:09.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : entry=9 expected=9 2024-02-05T07:20:09.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:de5d7c5f:::12:head 2024-02-05T07:20:09.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:de5d7c5f:::12:head expected=14:de5d7c5f:::12:head 2024-02-05T07:20:09.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:de5d7c5f:::12:head -> 12 2024-02-05T07:20:09.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : entry=12 expected=12 2024-02-05T07:20:09.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:d83876eb:::4:head 2024-02-05T07:20:09.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:d83876eb:::4:head expected=14:d83876eb:::4:head 2024-02-05T07:20:09.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:d83876eb:::4:head -> 4 2024-02-05T07:20:09.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : entry=4 expected=4 2024-02-05T07:20:09.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:cfc208b3:::3:head 2024-02-05T07:20:09.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:cfc208b3:::3:head expected=14:cfc208b3:::3:head 2024-02-05T07:20:09.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:cfc208b3:::3:head -> 3 2024-02-05T07:20:09.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : entry=3 expected=3 2024-02-05T07:20:09.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:89d3ae78:::11:head 2024-02-05T07:20:09.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:89d3ae78:::11:head expected=14:89d3ae78:::11:head 2024-02-05T07:20:09.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:89d3ae78:::11:head -> 11 2024-02-05T07:20:09.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : entry=11 expected=11 2024-02-05T07:20:09.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:863748b0:::15:head 2024-02-05T07:20:09.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:863748b0:::15:head expected=14:863748b0:::15:head 2024-02-05T07:20:09.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:863748b0:::15:head -> 15 2024-02-05T07:20:09.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : entry=15 expected=15 2024-02-05T07:20:09.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:566253c9:::13:head 2024-02-05T07:20:09.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:566253c9:::13:head expected=14:566253c9:::13:head 2024-02-05T07:20:09.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:566253c9:::13:head -> 13 2024-02-05T07:20:09.311 INFO:tasks.workunit.client.0.smithi184.stdout: api_list list_parallel: process_1_[82044]: starting. 2024-02-05T07:20:09.311 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_1_[82044]: creating pool ceph_test_rados_list_parallel.smithi184-82002 2024-02-05T07:20:09.312 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_1_[82044]: created object 0... 2024-02-05T07:20:09.312 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_1_[82044]: created object 25... 2024-02-05T07:20:09.312 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_1_[82044]: created object 49... 2024-02-05T07:20:09.312 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_1_[82044]: finishing. 2024-02-05T07:20:09.312 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_1_[82044]: shutting down. 2024-02-05T07:20:09.312 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_2_[82046]: starting. 2024-02-05T07:20:09.312 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_2_[82046]: listing objects. 2024-02-05T07:20:09.312 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_2_[82046]: listed object 0... 2024-02-05T07:20:09.312 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_2_[82046]: listed object 25... 2024-02-05T07:20:09.312 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_2_[82046]: saw 50 objects 2024-02-05T07:20:09.312 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_2_[82046]: shutting down. 2024-02-05T07:20:09.312 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.312 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_3_[83228]: starting. 2024-02-05T07:20:09.313 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_3_[83228]: creating pool ceph_test_rados_list_parallel.smithi184-82002 2024-02-05T07:20:09.313 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_3_[83228]: created object 0... 2024-02-05T07:20:09.313 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_3_[83228]: created object 25... 2024-02-05T07:20:09.313 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_3_[83228]: created object 49... 2024-02-05T07:20:09.313 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_3_[83228]: finishing. 2024-02-05T07:20:09.313 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_3_[83228]: shutting down. 2024-02-05T07:20:09.313 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.313 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_4_[83229]: starting. 2024-02-05T07:20:09.313 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_4_[83229]: listing objects. 2024-02-05T07:20:09.313 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_4_[83229]: listed object 0... 2024-02-05T07:20:09.313 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_4_[83229]: listed object 25... 2024-02-05T07:20:09.313 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_4_[83229]: saw 43 objects 2024-02-05T07:20:09.314 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_4_[83229]: shutting down. 2024-02-05T07:20:09.314 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.314 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_5_[83230]: starting. 2024-02-05T07:20:09.314 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_5_[83230]: removed 25 objects... 2024-02-05T07:20:09.314 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_5_[83230]: removed half of the objects 2024-02-05T07:20:09.314 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_5_[83230]: removed 50 objects... 2024-02-05T07:20:09.314 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_5_[83230]: removed 50 objects 2024-02-05T07:20:09.314 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_5_[83230]: shutting down. 2024-02-05T07:20:09.314 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.314 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.314 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_6_[83319]: starting. 2024-02-05T07:20:09.314 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_6_[83319]: creating pool ceph_test_rados_list_parallel.smithi184-82002 2024-02-05T07:20:09.314 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_6_[83319]: created object 0... 2024-02-05T07:20:09.314 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_6_[83319]: created object 25... 2024-02-05T07:20:09.315 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_6_[83319]: created object 49... 2024-02-05T07:20:09.315 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_6_[83319]: finishing. 2024-02-05T07:20:09.315 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_6_[83319]: shutting down. 2024-02-05T07:20:09.315 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.315 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.315 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_7_[83320]: starting. 2024-02-05T07:20:09.315 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_7_[83320]: listing objects. 2024-02-05T07:20:09.315 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_7_[83320]: listed object 0... 2024-02-05T07:20:09.315 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_7_[83320]: listed object 25... 2024-02-05T07:20:09.315 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_7_[83320]: listed object 50... 2024-02-05T07:20:09.315 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_7_[83320]: saw 56 objects 2024-02-05T07:20:09.315 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_7_[83320]: shutting down. 2024-02-05T07:20:09.315 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.315 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.315 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_8_[83321]: starting. 2024-02-05T07:20:09.316 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_8_[83321]: added 25 objects... 2024-02-05T07:20:09.316 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_8_[83321]: added half of the objects 2024-02-05T07:20:09.316 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_8_[83321]: added 50 objects... 2024-02-05T07:20:09.316 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_8_[83321]: added 50 objects 2024-02-05T07:20:09.316 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_8_[83321]: shutting down. 2024-02-05T07:20:09.316 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.316 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.502 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.502 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_9_[83367]: starting. 2024-02-05T07:20:09.502 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_9_[83367]: creating pool ceph_test_rados_list_parallel.smithi184-82002 2024-02-05T07:20:09.503 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_9_[83367]: created object 0... 2024-02-05T07:20:09.503 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_9_[83367]: created object 25... 2024-02-05T07:20:09.503 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_9_[83367]: created object 49... 2024-02-05T07:20:09.503 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_9_[83367]: finishing. 2024-02-05T07:20:09.503 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_9_[83367]: shutting down. 2024-02-05T07:20:09.503 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.503 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.503 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.503 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_10_[83368]: starting. 2024-02-05T07:20:09.503 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_10_[83368]: listing objects. 2024-02-05T07:20:09.503 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_10_[83368]: listed object 0... 2024-02-05T07:20:09.503 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_10_[83368]: listed object 25... 2024-02-05T07:20:09.503 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_10_[83368]: listed object 50... 2024-02-05T07:20:09.504 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_10_[83368]: listed object 75... 2024-02-05T07:20:09.504 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_10_[83368]: saw 98 objects 2024-02-05T07:20:09.504 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_10_[83368]: shutting down. 2024-02-05T07:20:09.504 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.504 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.504 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.504 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_13_[83371]: starting. 2024-02-05T07:20:09.504 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_13_[83371]: removed 25 objects... 2024-02-05T07:20:09.504 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_13_[83371]: removed half of the objects 2024-02-05T07:20:09.504 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_13_[83371]: removed 50 objects... 2024-02-05T07:20:09.504 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_13_[83371]: removed 50 objects 2024-02-05T07:20:09.504 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_13_[83371]: shutting down. 2024-02-05T07:20:09.504 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.505 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.505 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.505 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_11_[83369]: starting. 2024-02-05T07:20:09.505 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_11_[83369]: added 25 objects... 2024-02-05T07:20:09.505 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_11_[83369]: added half of the objects 2024-02-05T07:20:09.505 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_11_[83369]: added 50 objects... 2024-02-05T07:20:09.505 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_11_[83369]: added 50 objects 2024-02-05T07:20:09.505 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_11_[83369]: shutting down. 2024-02-05T07:20:09.505 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.505 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.505 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.505 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_12_[83370]: starting. 2024-02-05T07:20:09.505 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_12_[83370]: added 25 objects... 2024-02-05T07:20:09.505 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_12_[83370]: added half of the objects 2024-02-05T07:20:09.506 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_12_[83370]: added 50 objects... 2024-02-05T07:20:09.506 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_12_[83370]: added 50 objects 2024-02-05T07:20:09.506 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_12_[83370]: shutting down. 2024-02-05T07:20:09.506 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.506 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.506 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.506 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.506 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_14_[83449]: starting. 2024-02-05T07:20:09.506 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_14_[83449]: creating pool ceph_test_rados_list_parallel.smithi184-82002 2024-02-05T07:20:09.506 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_14_[83449]: created object 0... 2024-02-05T07:20:09.506 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_14_[83449]: created object 25... 2024-02-05T07:20:09.506 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_14_[83449]: created object 49... 2024-02-05T07:20:09.506 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_14_[83449]: finishing. 2024-02-05T07:20:09.507 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_14_[83449]: shutting down. 2024-02-05T07:20:09.507 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.507 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.507 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.507 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:09.507 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_15_[83450]: starting. 2024-02-05T07:20:09.507 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_15_[83450]: listing objects. 2024-02-05T07:20:09.507 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_15_[83450]: listed object 0... 2024-02-05T07:20:09.930 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_15_[83450]: listed object 2 handler_error: Running main() from gmock_main.cc 2024-02-05T07:20:09.930 INFO:tasks.workunit.client.0.smithi184.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2024-02-05T07:20:09.931 INFO:tasks.workunit.client.0.smithi184.stdout: handler_error: [----------] Global test environment set-up. 2024-02-05T07:20:09.931 INFO:tasks.workunit.client.0.smithi184.stdout: handler_error: [----------] 1 test from neocls_handler_error 2024-02-05T07:20:09.931 INFO:tasks.workunit.client.0.smithi184.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2024-02-05T07:20:09.931 INFO:tasks.workunit.client.0.smithi184.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (10944 ms) 2024-02-05T07:20:09.931 INFO:tasks.workunit.client.0.smithi184.stdout: handler_error: [----------] 1 test from neocls_handler_error (10944 ms total) 2024-02-05T07:20:09.931 INFO:tasks.workunit.client.0.smithi184.stdout: handler_error: 2024-02-05T07:20:09.931 INFO:tasks.workunit.client.0.smithi184.stdout: handler_error: [----------] Global test environment tear-down 2024-02-05T07:20:09.931 INFO:tasks.workunit.client.0.smithi184.stdout: handler_error: [==========] 1 test from 1 test suite ran. (10944 ms total) 2024-02-05T07:20:09.931 INFO:tasks.workunit.client.0.smithi184.stdout: handler_error: [ PASSED ] 1 test. 2024-02-05T07:20:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.34700 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi184-81317-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24742 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi184-81638-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.34706 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi184-81303-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24688 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi184-81307-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.34673 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi184-81247-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24718 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24727 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi184-81478-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24730 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi184-81575-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24739 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi184-81609-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24748 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi184-81647-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi184-81802-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24787 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24802 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi184-82008-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24685 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi184-81272-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24709 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24766 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:10.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24856 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81815-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24859 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81840-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24871 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-82135-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi184-81742-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:10.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: osdmap e76: 8 total, 8 up, 8 in 2024-02-05T07:20:10.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi184-81742-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:10.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:10.761 INFO:tasks.workunit.client.0.smithi184.stdout:5... 2024-02-05T07:20:10.761 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_15_[83450]: listed object 50... 2024-02-05T07:20:10.761 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_15_[83450]: listed object 75... 2024-02-05T07:20:10.761 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_15_[83450]: listed object 100... 2024-02-05T07:20:10.761 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_15_[83450]: listed object 125... 2024-02-05T07:20:10.762 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_15_[83450]: saw 150 objects 2024-02-05T07:20:10.762 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_15_[83450]: shutting down. 2024-02-05T07:20:10.762 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:10.762 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:10.762 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:10.762 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:10.762 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_16_[83451]: starting. 2024-02-05T07:20:10.762 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_16_[83451]: added 25 objects... 2024-02-05T07:20:10.762 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_16_[83451]: added half of the objects 2024-02-05T07:20:10.762 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_16_[83451]: added 50 objects... 2024-02-05T07:20:10.762 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_16_[83451]: added 50 objects 2024-02-05T07:20:10.762 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: process_16_[83451]: shutting down. 2024-02-05T07:20:10.762 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:10.762 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:10.763 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:10.763 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:10.763 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******************************* 2024-02-05T07:20:10.763 INFO:tasks.workunit.client.0.smithi184.stdout: list_parallel: ******* SUCCESS ********** 2024-02-05T07:20:10.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:10.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.34700 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi184-81317-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24742 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi184-81638-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.34706 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi184-81303-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24688 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi184-81307-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.34673 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi184-81247-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24718 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24727 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi184-81478-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24730 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi184-81575-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24739 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi184-81609-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24748 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi184-81647-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi184-81802-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24787 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24802 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi184-82008-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24685 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi184-81272-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24709 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24766 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:10.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24856 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81815-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24859 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81840-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24871 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-82135-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi184-81742-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:10.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: osdmap e76: 8 total, 8 up, 8 in 2024-02-05T07:20:10.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi184-81742-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:10.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:10.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:10.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.34700 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi184-81317-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24742 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi184-81638-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.34706 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi184-81303-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24688 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi184-81307-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.34673 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi184-81247-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24718 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24727 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi184-81478-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24730 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi184-81575-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24739 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi184-81609-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24748 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi184-81647-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.777 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24763 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi184-81802-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.777 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24787 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.777 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24802 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi184-82008-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.777 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24685 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi184-81272-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.777 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24709 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.777 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24766 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:10.777 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24856 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81815-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.777 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24859 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81840-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.777 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24871 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-82135-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:10.777 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi184-81742-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:10.777 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: osdmap e76: 8 total, 8 up, 8 in 2024-02-05T07:20:10.777 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi184-81742-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:10.777 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:11.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2024-02-05T07:20:11.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2024-02-05T07:20:11.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2024-02-05T07:20:11.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2024-02-05T07:20:11.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (12796 ms) 2024-02-05T07:20:11.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (12796 ms total) 2024-02-05T07:20:11.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_cls_remote_reads: 2024-02-05T07:20:11.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2024-02-05T07:20:11.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (12801 ms total) 2024-02-05T07:20:11.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2024-02-05T07:20:11.804 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd_pp: Running main() from gmock_main.cc 2024-02-05T07:20:11.804 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-02-05T07:20:11.804 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-02-05T07:20:11.804 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-02-05T07:20:11.804 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-02-05T07:20:11.804 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (66 ms) 2024-02-05T07:20:11.804 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-02-05T07:20:11.804 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (65 ms) 2024-02-05T07:20:11.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-02-05T07:20:11.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (12821 ms) 2024-02-05T07:20:11.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (12952 ms total) 2024-02-05T07:20:11.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd_pp: 2024-02-05T07:20:11.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-02-05T07:20:11.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (12952 ms total) 2024-02-05T07:20:11.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-02-05T07:20:11.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: Running main() from gmock_main.cc 2024-02-05T07:20:11.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2024-02-05T07:20:11.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-02-05T07:20:11.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2024-02-05T07:20:11.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-02-05T07:20:11.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-02-05T07:20:11.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-02-05T07:20:11.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (340 ms) 2024-02-05T07:20:11.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-02-05T07:20:11.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (6 ms) 2024-02-05T07:20:11.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-02-05T07:20:11.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (38 ms) 2024-02-05T07:20:11.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-02-05T07:20:11.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (23 ms) 2024-02-05T07:20:11.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-02-05T07:20:11.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (7 ms) 2024-02-05T07:20:11.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-02-05T07:20:11.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (8 ms) 2024-02-05T07:20:11.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-02-05T07:20:11.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (8 ms) 2024-02-05T07:20:11.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-02-05T07:20:11.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (9 ms) 2024-02-05T07:20:11.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-02-05T07:20:11.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (4 ms) 2024-02-05T07:20:11.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-02-05T07:20:11.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (4 ms) 2024-02-05T07:20:11.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-02-05T07:20:11.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (4 ms) 2024-02-05T07:20:11.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2024-02-05T07:20:11.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (6 ms) 2024-02-05T07:20:11.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-02-05T07:20:11.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (14 ms) 2024-02-05T07:20:11.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-02-05T07:20:11.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (12 ms) 2024-02-05T07:20:11.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-02-05T07:20:11.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (8 ms) 2024-02-05T07:20:11.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-02-05T07:20:11.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (5 ms) 2024-02-05T07:20:11.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (496 ms total) 2024-02-05T07:20:11.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: 2024-02-05T07:20:11.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-02-05T07:20:11.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (12900 ms total) 2024-02-05T07:20:11.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2024-02-05T07:20:12.022 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:20:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:20:12.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[29861]: pgmap v73: 1156 pgs: 782 creating+peering, 132 active+clean, 242 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:20:12.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[29861]: from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi184-82326-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi184-82326-1"}]': finished 2024-02-05T07:20:12.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[29861]: from='client.24880 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi184-82412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi184-82412-1"}]': finished 2024-02-05T07:20:12.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:12.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[29861]: osdmap e77: 8 total, 8 up, 8 in 2024-02-05T07:20:12.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[29861]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:12.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:12.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[29861]: from='client.24766 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi184-81742-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]': finished 2024-02-05T07:20:12.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[41609]: pgmap v73: 1156 pgs: 782 creating+peering, 132 active+clean, 242 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:20:12.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[41609]: from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi184-82326-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi184-82326-1"}]': finished 2024-02-05T07:20:12.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[41609]: from='client.24880 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi184-82412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi184-82412-1"}]': finished 2024-02-05T07:20:12.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:12.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[41609]: osdmap e77: 8 total, 8 up, 8 in 2024-02-05T07:20:12.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[41609]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:12.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:12.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:11 smithi184 ceph-mon[41609]: from='client.24766 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi184-81742-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]': finished 2024-02-05T07:20:12.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:11 smithi188 ceph-mon[33283]: pgmap v73: 1156 pgs: 782 creating+peering, 132 active+clean, 242 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:20:12.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:11 smithi188 ceph-mon[33283]: from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi184-82326-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi184-82326-1"}]': finished 2024-02-05T07:20:12.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:11 smithi188 ceph-mon[33283]: from='client.24880 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi184-82412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi184-82412-1"}]': finished 2024-02-05T07:20:12.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:12.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:11 smithi188 ceph-mon[33283]: osdmap e77: 8 total, 8 up, 8 in 2024-02-05T07:20:12.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:11 smithi188 ceph-mon[33283]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:12.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:12.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:11 smithi188 ceph-mon[33283]: from='client.24766 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi184-81742-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]': finished 2024-02-05T07:20:12.838 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: Running main() from gmock_main.cc 2024-02-05T07:20:12.838 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-02-05T07:20:12.838 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: [----------] Global test environment set-up. 2024-02-05T07:20:12.838 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-02-05T07:20:12.839 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-02-05T07:20:12.839 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (55 ms) 2024-02-05T07:20:12.839 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-02-05T07:20:12.839 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (61 ms) 2024-02-05T07:20:12.839 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-02-05T07:20:12.839 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (12842 ms) 2024-02-05T07:20:12.839 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-02-05T07:20:12.839 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:09.634562+0000 mon.a [INF] from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi184-82326-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi184-82326-1"}]': finished 2024-02-05T07:20:12.839 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:09.634653+0000 mon.a [INF] from='client.24880 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi184-82412-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi184-82412-1"}]': finished 2024-02-05T07:20:12.839 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:09.927424+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:12.839 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:10.188289+0000 mon.a [INF] from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:12.839 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:10.749114+0000 mon.a [INF] from='client.24766 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi184-81742-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]': finished 2024-02-05T07:20:12.839 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:10.749223+0000 mon.a [INF] from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:12.840 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:10.759301+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/3002287215' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:12.840 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:10.759479+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/2844092183' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:12.840 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:10.814657+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:12.840 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.009910+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-02-05T07:20:12.840 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.010563+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-02-05T07:20:12.840 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.010950+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-02-05T07:20:12.840 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.011305+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-02-05T07:20:12.840 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.011667+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-02-05T07:20:12.840 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.012017+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-02-05T07:20:12.840 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.012381+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-02-05T07:20:12.840 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.012721+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-02-05T07:20:12.841 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.013087+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-02-05T07:20:12.841 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.013444+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-02-05T07:20:12.841 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.774745+0000 mon.a [INF] from='client.35090 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:12.841 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.775258+0000 mon.a [INF] from='client.35216 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:12.841 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.791074+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/4040004917' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi184-81207-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:12.841 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.794739+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/1090727750' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:12.841 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.878018+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:12.841 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.882264+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/3519761101' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-05T07:20:12.841 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.913452+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:12.841 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.937169+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:12.841 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:12.110035+0000 mon.a [INF] from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:12.841 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:12.350712+0000 mon.a [INF] from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:12.842 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:12.351061+0000 mon.a [INF] from='client.25123 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi184-81207-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: pgmap v75: 1108 pgs: 654 creating+peering, 132 active+clean, 322 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 865 B/s rd, 0 op/s 2024-02-05T07:20:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3002287215' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2844092183' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-02-05T07:20:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-02-05T07:20:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-02-05T07:20:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-02-05T07:20:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-02-05T07:20:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-02-05T07:20:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-02-05T07:20:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-02-05T07:20:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-02-05T07:20:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-02-05T07:20:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-02-05T07:20:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-02-05T07:20:13.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-02-05T07:20:13.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-02-05T07:20:13.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-02-05T07:20:13.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-02-05T07:20:13.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-02-05T07:20:13.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-02-05T07:20:13.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-02-05T07:20:13.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-02-05T07:20:13.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: 15.3 deep-scrub starts 2024-02-05T07:20:13.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: 15.3 deep-scrub ok 2024-02-05T07:20:13.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:13.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: osdmap e78: 8 total, 8 up, 8 in 2024-02-05T07:20:13.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.35090 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.35216 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4040004917' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi184-81207-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1090727750' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:13.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:13.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3519761101' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-05T07:20:13.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:13.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:13.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: osdmap e79: 8 total, 8 up, 8 in 2024-02-05T07:20:13.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:13.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:13.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:20:13.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:13.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.25123 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi184-81207-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:13.253 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:12 smithi188 ceph-mon[33283]: from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:13.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: pgmap v75: 1108 pgs: 654 creating+peering, 132 active+clean, 322 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 865 B/s rd, 0 op/s 2024-02-05T07:20:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3002287215' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2844092183' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-02-05T07:20:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-02-05T07:20:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-02-05T07:20:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-02-05T07:20:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-02-05T07:20:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-02-05T07:20:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-02-05T07:20:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-02-05T07:20:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-02-05T07:20:13.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-02-05T07:20:13.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-02-05T07:20:13.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-02-05T07:20:13.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-02-05T07:20:13.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-02-05T07:20:13.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-02-05T07:20:13.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-02-05T07:20:13.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-02-05T07:20:13.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: pgmap v75: 1108 pgs: 654 creating+peering, 132 active+clean, 322 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 865 B/s rd, 0 op/s 2024-02-05T07:20:13.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:13.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3002287215' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2844092183' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:13.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-02-05T07:20:13.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-02-05T07:20:13.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-02-05T07:20:13.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-02-05T07:20:13.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-02-05T07:20:13.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-02-05T07:20:13.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-02-05T07:20:13.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-02-05T07:20:13.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-02-05T07:20:13.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-02-05T07:20:13.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-02-05T07:20:13.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-02-05T07:20:13.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-02-05T07:20:13.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-02-05T07:20:13.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-02-05T07:20:13.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-02-05T07:20:13.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-02-05T07:20:13.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-02-05T07:20:13.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-02-05T07:20:13.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-02-05T07:20:13.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: 15.3 deep-scrub starts 2024-02-05T07:20:13.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: 15.3 deep-scrub ok 2024-02-05T07:20:13.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:13.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: osdmap e78: 8 total, 8 up, 8 in 2024-02-05T07:20:13.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.35090 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.35216 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4040004917' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi184-81207-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1090727750' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:13.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:13.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3519761101' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-05T07:20:13.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:13.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:13.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: osdmap e79: 8 total, 8 up, 8 in 2024-02-05T07:20:13.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:13.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:13.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:20:13.277 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:13.277 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.25123 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi184-81207-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.277 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:13.277 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[29861]: from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:13.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-02-05T07:20:13.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-02-05T07:20:13.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-02-05T07:20:13.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: 15.3 deep-scrub starts 2024-02-05T07:20:13.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: 15.3 deep-scrub ok 2024-02-05T07:20:13.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:13.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: osdmap e78: 8 total, 8 up, 8 in 2024-02-05T07:20:13.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.35090 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.35216 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4040004917' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi184-81207-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1090727750' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:13.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:13.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3519761101' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-05T07:20:13.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:13.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:13.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: osdmap e79: 8 total, 8 up, 8 in 2024-02-05T07:20:13.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:13.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:13.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:20:13.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:13.279 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.25123 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi184-81207-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:13.279 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:13.279 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:12 smithi184 ceph-mon[41609]: from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:14.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:14 smithi188 ceph-mon[33283]: 15.0 deep-scrub starts 2024-02-05T07:20:14.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:14 smithi188 ceph-mon[33283]: 15.0 deep-scrub ok 2024-02-05T07:20:14.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:14 smithi188 ceph-mon[33283]: 15.9 deep-scrub starts 2024-02-05T07:20:14.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:14 smithi188 ceph-mon[33283]: 15.9 deep-scrub ok 2024-02-05T07:20:14.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:14 smithi188 ceph-mon[33283]: onexx 2024-02-05T07:20:14.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:14 smithi188 ceph-mon[33283]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:14.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:14 smithi188 ceph-mon[33283]: from='client.35246 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-05T07:20:14.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:14 smithi188 ceph-mon[33283]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:14.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:14 smithi188 ceph-mon[33283]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:14.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:14 smithi188 ceph-mon[33283]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:14.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:14 smithi188 ceph-mon[33283]: from='client.35090 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:14.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[29861]: 15.0 deep-scrub starts 2024-02-05T07:20:14.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[29861]: 15.0 deep-scrub ok 2024-02-05T07:20:14.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[29861]: 15.9 deep-scrub starts 2024-02-05T07:20:14.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[29861]: 15.9 deep-scrub ok 2024-02-05T07:20:14.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[29861]: onexx 2024-02-05T07:20:14.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[29861]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:14.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[29861]: from='client.35246 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-05T07:20:14.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[29861]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:14.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[29861]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:14.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[29861]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:14.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[29861]: from='client.35090 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:14.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[41609]: 15.0 deep-scrub starts 2024-02-05T07:20:14.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[41609]: 15.0 deep-scrub ok 2024-02-05T07:20:14.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[41609]: 15.9 deep-scrub starts 2024-02-05T07:20:14.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[41609]: 15.9 deep-scrub ok 2024-02-05T07:20:14.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[41609]: onexx 2024-02-05T07:20:14.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[41609]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:14.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[41609]: from='client.35246 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-05T07:20:14.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[41609]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:14.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[41609]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:14.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[41609]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:14.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:14 smithi184 ceph-mon[41609]: from='client.35090 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:15.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: 15.2 deep-scrub starts 2024-02-05T07:20:15.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: 15.2 deep-scrub ok 2024-02-05T07:20:15.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: pgmap v78: 820 pgs: 245 creating+peering, 474 active+clean, 101 unknown; 121 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 30 MiB/s wr, 546 op/s 2024-02-05T07:20:15.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: 15.1 deep-scrub starts 2024-02-05T07:20:15.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: 15.1 deep-scrub ok 2024-02-05T07:20:15.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35216 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:15.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.25123 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi184-81207-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:15.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi184-82326-1"}]': finished 2024-02-05T07:20:15.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1090727750' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:15.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:15.503 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:15.503 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:15.503 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: 15.8 deep-scrub starts 2024-02-05T07:20:15.503 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: 15.8 deep-scrub ok 2024-02-05T07:20:15.503 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: 15.5 deep-scrub starts 2024-02-05T07:20:15.503 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: 15.5 deep-scrub ok 2024-02-05T07:20:15.503 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:15.503 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: osdmap e80: 8 total, 8 up, 8 in 2024-02-05T07:20:15.503 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi184-81247-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.503 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:15.503 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:15.503 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:15.503 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.504 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35246 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-02-05T07:20:15.504 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3519761101' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-05T07:20:15.504 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: twoxx 2024-02-05T07:20:15.504 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:15.504 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:15.505 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi184-82326-1"}]': finished 2024-02-05T07:20:15.505 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:15.505 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: osdmap e81: 8 total, 8 up, 8 in 2024-02-05T07:20:15.505 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.505 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:15.505 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3002287215' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.505 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1688798005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:15.505 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:15.506 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/501606332' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.506 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:15.506 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2150055962' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi184-82326-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.506 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:15.506 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:15.506 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi184-81247-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.506 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.506 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35246 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-05T07:20:15.506 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:15.506 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35090 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.506 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi184-81307-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.506 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:15.506 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:15.506 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35312 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi184-82326-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.507 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:15.507 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.507 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi184-81307-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.507 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:15.507 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.507 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.507 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:15.507 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.507 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.24880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:15.507 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi184-81638-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.507 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.25279 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.507 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:15 smithi188 ceph-mon[33283]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi184-81638-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: 15.2 deep-scrub starts 2024-02-05T07:20:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: 15.2 deep-scrub ok 2024-02-05T07:20:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: pgmap v78: 820 pgs: 245 creating+peering, 474 active+clean, 101 unknown; 121 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 30 MiB/s wr, 546 op/s 2024-02-05T07:20:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: 15.1 deep-scrub starts 2024-02-05T07:20:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: 15.1 deep-scrub ok 2024-02-05T07:20:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35216 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.25123 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi184-81207-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi184-82326-1"}]': finished 2024-02-05T07:20:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1090727750' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: 15.8 deep-scrub starts 2024-02-05T07:20:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: 15.8 deep-scrub ok 2024-02-05T07:20:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: 15.5 deep-scrub starts 2024-02-05T07:20:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: 15.5 deep-scrub ok 2024-02-05T07:20:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: osdmap e80: 8 total, 8 up, 8 in 2024-02-05T07:20:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi184-81247-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:15.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35246 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-02-05T07:20:15.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3519761101' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-05T07:20:15.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: twoxx 2024-02-05T07:20:15.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: 15.2 deep-scrub starts 2024-02-05T07:20:15.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: 15.2 deep-scrub ok 2024-02-05T07:20:15.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: pgmap v78: 820 pgs: 245 creating+peering, 474 active+clean, 101 unknown; 121 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 30 MiB/s wr, 546 op/s 2024-02-05T07:20:15.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: 15.1 deep-scrub starts 2024-02-05T07:20:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: 15.1 deep-scrub ok 2024-02-05T07:20:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35216 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.25123 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi184-81207-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi184-82326-1"}]': finished 2024-02-05T07:20:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1090727750' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: 15.8 deep-scrub starts 2024-02-05T07:20:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: 15.8 deep-scrub ok 2024-02-05T07:20:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: 15.5 deep-scrub starts 2024-02-05T07:20:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: 15.5 deep-scrub ok 2024-02-05T07:20:15.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:15.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: osdmap e80: 8 total, 8 up, 8 in 2024-02-05T07:20:15.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi184-81247-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:15.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: Health check update: 14 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:15.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:15.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35246 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-02-05T07:20:15.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3519761101' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-05T07:20:15.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: twoxx 2024-02-05T07:20:15.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:15.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:15.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi184-82326-1"}]': finished 2024-02-05T07:20:15.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:15.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: osdmap e81: 8 total, 8 up, 8 in 2024-02-05T07:20:15.527 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.527 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:15.527 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3002287215' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.527 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1688798005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:15.527 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:15.527 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/501606332' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.527 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:15.527 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2150055962' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi184-82326-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.527 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:15.527 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:15.527 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi184-81247-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.527 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.528 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35246 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-05T07:20:15.528 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:15.528 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:15.528 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:15.528 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.24874 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi184-82326-1"}]': finished 2024-02-05T07:20:15.528 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:15.528 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: osdmap e81: 8 total, 8 up, 8 in 2024-02-05T07:20:15.528 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.528 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:15.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3002287215' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1688798005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:15.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:15.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/501606332' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:15.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2150055962' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi184-82326-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:15.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:15.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi184-81247-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35246 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-05T07:20:15.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:15.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35090 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi184-81307-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:15.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:15.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35312 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi184-82326-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:15.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi184-81307-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:15.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:15.531 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.531 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.24880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:15.531 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi184-81638-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.531 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.25279 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.531 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[41609]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi184-81638-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.531 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35090 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.531 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi184-81307-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.531 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:15.531 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:15.531 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35312 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi184-82326-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.531 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:15.532 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.532 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi184-81307-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.532 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:15.532 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.532 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.532 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:15.532 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.532 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.24880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:15.532 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi184-81638-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:15.532 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.25279 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:15.532 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:15 smithi184 ceph-mon[29861]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi184-81638-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:16.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: pgmap v81: 972 pgs: 168 creating+peering, 516 active+clean, 288 unknown; 145 MiB data, 707 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 546 op/s 2024-02-05T07:20:16.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.35246 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-02-05T07:20:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi184-81247-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.35090 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]': finished 2024-02-05T07:20:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.35312 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi184-82326-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.35300 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi184-81307-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.35309 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.24880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi184-82412-1"}]': finished 2024-02-05T07:20:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.25279 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi184-81638-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: osdmap e82: 8 total, 8 up, 8 in 2024-02-05T07:20:16.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi184-81247-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:16.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi184-81272-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:16.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi184-81317-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:16.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2150055962' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi184-82326-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:16.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi184-81647-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:16.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-4", "overlaypool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:16.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi184-81307-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:16.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi184-81638-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:16.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1688798005' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:16.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3002287215' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi184-81228-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-05T07:20:16.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:16.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi184-81247-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:16.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi184-81272-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:16.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi184-81317-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:16.502 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.35312 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi184-82326-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:16.502 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-4", "overlaypool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:16.502 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi184-81307-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:16.502 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.35090 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi184-81228-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-05T07:20:16.502 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi184-81647-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:16.502 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi184-81638-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:16.502 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.24880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:16.502 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:16.502 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:16.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: pgmap v81: 972 pgs: 168 creating+peering, 516 active+clean, 288 unknown; 145 MiB data, 707 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 546 op/s 2024-02-05T07:20:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.35246 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-02-05T07:20:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi184-81247-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.35090 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]': finished 2024-02-05T07:20:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.35312 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi184-82326-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.35300 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi184-81307-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.35309 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.24880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi184-82412-1"}]': finished 2024-02-05T07:20:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.25279 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi184-81638-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: osdmap e82: 8 total, 8 up, 8 in 2024-02-05T07:20:16.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi184-81247-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:16.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi184-81272-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:16.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi184-81317-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:16.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: pgmap v81: 972 pgs: 168 creating+peering, 516 active+clean, 288 unknown; 145 MiB data, 707 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 37 MiB/s wr, 546 op/s 2024-02-05T07:20:16.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.35246 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-02-05T07:20:16.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi184-81247-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.35090 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:16.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]': finished 2024-02-05T07:20:16.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.35312 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi184-82326-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.35300 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi184-81307-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.35309 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.24880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi184-82412-1"}]': finished 2024-02-05T07:20:16.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.25279 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:16.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi184-81638-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:16.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: osdmap e82: 8 total, 8 up, 8 in 2024-02-05T07:20:16.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi184-81247-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:16.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi184-81272-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:16.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi184-81317-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:16.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2150055962' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi184-82326-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:16.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi184-81647-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:16.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-4", "overlaypool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:16.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi184-81307-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:16.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi184-81638-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:16.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1688798005' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:16.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3002287215' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi184-81228-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-05T07:20:16.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:16.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi184-81247-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:16.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi184-81272-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:16.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi184-81317-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:16.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.35312 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi184-82326-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:16.527 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-4", "overlaypool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:16.527 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi184-81307-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:16.527 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2150055962' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi184-82326-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:16.527 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi184-81647-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:16.527 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-4", "overlaypool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:16.527 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi184-81307-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:16.527 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi184-81638-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:16.527 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1688798005' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:16.527 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3002287215' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi184-81228-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-05T07:20:16.528 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:16.528 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi184-81247-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:16.528 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi184-81272-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:16.528 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi184-81317-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:16.528 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.35312 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi184-82326-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:16.528 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-4", "overlaypool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:16.528 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi184-81307-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:16.528 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.35090 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi184-81228-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-05T07:20:16.528 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi184-81647-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:16.528 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi184-81638-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:16.529 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.24880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:16.529 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:16.529 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:16.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.35090 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi184-81228-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-05T07:20:16.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi184-81647-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:16.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi184-81638-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:16.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.24880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:16.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:16.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:17.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:12.351386+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:17.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:12.351985+0000 mon.a [INF] from='client.24874 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi184-82326-1"}]: dispatch 2024-02-05T07:20:17.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:11.883119+0000 client.admin [INF] onexx 2024-02-05T07:20:17.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:12.840106+0000 mon.a [INF] from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:17.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:12.841224+0000 mon.a [INF] from='client.35246 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-05T07:20:17.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:12.841424+0000 mon.a [INF] from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:17.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:12.841779+0000 mon.a [INF] from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:17.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:12.842092+0000 mon.a [INF] from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:17.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:12.842723+0000 mon.a [INF] from='client.35090 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:17.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.092159+0000 mon.a [INF] from='client.35246 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-02-05T07:20:17.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.103611+0000 mon.a [INF] from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi184-81247-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:17.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.103704+0000 mon.a [INF] from='client.35090 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi184-81228-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:17.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.103786+0000 mon.a [INF] from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]': finished 2024-02-05T07:20:17.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.103848+0000 mon.a [INF] from='client.35312 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi184-82326-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:17.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.103914+0000 mon.a [INF] from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:17.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.103992+0000 mon.a [INF] from='client.35300 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi184-81307-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:17.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.104055+0000 mon.a [INF] from='client.35309 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:17.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.104117+0000 mon.a [INF] from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:17.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.104180+0000 mon.a [INF] from='client.24880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi184-82412-1"}]': finished 2024-02-05T07:20:17.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.104228+0000 mon.a [INF] from='client.25279 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:17.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.104282+0000 mon.a [INF] from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi184-81638-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:17.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.109108+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi184-81247-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:17.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.109538+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi184-81272-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:17.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.109712+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi184-81317-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:17.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.109894+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/2150055962' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi184-82326-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:17.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.111790+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi184-81647-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:17.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.112313+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-4", "overlaypool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:17.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.112585+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi184-81307-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:17.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.112812+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi184-81638-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:17.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.113188+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/1688798005' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:17.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:20:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:20:17.833 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.113905+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/3002287215' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "poo cls: Running main() from gmock_main.cc 2024-02-05T07:20:17.833 INFO:tasks.workunit.client.0.smithi184.stdout: cls: [==========] Running 2 tests from 1 test suite. 2024-02-05T07:20:17.833 INFO:tasks.workunit.client.0.smithi184.stdout: cls: [----------] Global test environment set-up. 2024-02-05T07:20:17.833 INFO:tasks.workunit.client.0.smithi184.stdout: cls: [----------] 2 tests from NeoRadosCls 2024-02-05T07:20:17.833 INFO:tasks.workunit.client.0.smithi184.stdout: cls: [ RUN ] NeoRadosCls.DNE 2024-02-05T07:20:17.834 INFO:tasks.workunit.client.0.smithi184.stdout: cls: [ OK ] NeoRadosCls.DNE (12825 ms) 2024-02-05T07:20:17.834 INFO:tasks.workunit.client.0.smithi184.stdout: cls: [ RUN ] NeoRadosCls.RemoteReads 2024-02-05T07:20:17.834 INFO:tasks.workunit.client.0.smithi184.stdout: cls: [ OK ] NeoRadosCls.RemoteReads (6038 ms) 2024-02-05T07:20:17.834 INFO:tasks.workunit.client.0.smithi184.stdout: cls: [----------] 2 tests from NeoRadosCls (18863 ms total) 2024-02-05T07:20:17.834 INFO:tasks.workunit.client.0.smithi184.stdout: cls: 2024-02-05T07:20:17.834 INFO:tasks.workunit.client.0.smithi184.stdout: cls: [----------] Global test environment tear-down 2024-02-05T07:20:17.834 INFO:tasks.workunit.client.0.smithi184.stdout: cls: [==========] 2 tests from 1 test suite ran. (18865 ms total) 2024-02-05T07:20:17.834 INFO:tasks.workunit.client.0.smithi184.stdout: cls: [ PASSED ] 2 tests. 2024-02-05T07:20:17.837 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_1_[82154]: starting. 2024-02-05T07:20:17.837 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_1_[82154]: creating pool ceph_test_rados_open_pools_parallel.smithi184-82065 2024-02-05T07:20:17.837 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_1_[82154]: created object 0... 2024-02-05T07:20:17.837 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_1_[82154]: created object 25... 2024-02-05T07:20:17.837 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_1_[82154]: created object 49... 2024-02-05T07:20:17.837 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_1_[82154]: finishing. 2024-02-05T07:20:17.837 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_1_[82154]: shutting down. 2024-02-05T07:20:17.837 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_2_[82155]: starting. 2024-02-05T07:20:17.837 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_2_[82155]: rados_pool_create. 2024-02-05T07:20:17.837 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_2_[82155]: rados_ioctx_create. 2024-02-05T07:20:17.838 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_2_[82155]: shutting down. 2024-02-05T07:20:17.838 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: ******************************* 2024-02-05T07:20:17.838 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_3_[83602]: starting. 2024-02-05T07:20:17.838 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_3_[83602]: creating pool ceph_test_rados_open_pools_parallel.smithi184-82065 2024-02-05T07:20:17.838 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_3_[83602]: created object 0... 2024-02-05T07:20:17.838 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_3_[83602]: created object 25... 2024-02-05T07:20:17.838 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_3_[83602]: created object 49... 2024-02-05T07:20:17.838 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_3_[83602]: finishing. 2024-02-05T07:20:17.838 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_3_[83602]: shutting down. 2024-02-05T07:20:17.838 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: ******************************* 2024-02-05T07:20:17.838 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_4_[83603]: starting. 2024-02-05T07:20:17.838 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_4_[83603]: rados_pool_create. 2024-02-05T07:20:17.838 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_4_[83603]: rados_ioctx_create. 2024-02-05T07:20:17.838 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: process_4_[83603]: shutting down. 2024-02-05T07:20:17.838 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: ******************************* 2024-02-05T07:20:17.839 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: ******************************* 2024-02-05T07:20:17.839 INFO:tasks.workunit.client.0.smithi184.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-02-05T07:20:17.839 INFO:tasks.workunit.client.0.smithi184.stdout: cmd: Running main() from gmock_main.cc 2024-02-05T07:20:17.839 INFO:tasks.workunit.client.0.smithi184.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2024-02-05T07:20:17.839 INFO:tasks.workunit.client.0.smithi184.stdout: cmd: [----------] Global test environment set-up. 2024-02-05T07:20:17.839 INFO:tasks.workunit.client.0.smithi184.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2024-02-05T07:20:17.839 INFO:tasks.workunit.client.0.smithi184.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2024-02-05T07:20:17.839 INFO:tasks.workunit.client.0.smithi184.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (9424 ms) 2024-02-05T07:20:17.839 INFO:tasks.workunit.client.0.smithi184.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2024-02-05T07:20:17.840 INFO:tasks.workunit.client.0.smithi184.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (3395 ms) 2024-02-05T07:20:17.840 INFO:tasks.workunit.client.0.smithi184.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2024-02-05T07:20:17.840 INFO:tasks.workunit.client.0.smithi184.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (6033 ms) 2024-02-05T07:20:17.840 INFO:tasks.workunit.client.0.smithi184.stdout: cmd: [----------] 3 tests from NeoRadosCmd (18852 ms total) 2024-02-05T07:20:17.840 INFO:tasks.workunit.client.0.smithi184.stdout: cmd: 2024-02-05T07:20:17.840 INFO:tasks.workunit.client.0.smithi184.stdout: cmd: [----------] Global test environment tear-down 2024-02-05T07:20:17.840 INFO:tasks.workunit.client.0.smithi184.stdout: cmd: [==========] 3 tests from 1 test suite ran. (18855 ms total) 2024-02-05T07:20:17.840 INFO:tasks.workunit.client.0.smithi184.stdout: cmd: [ PASSED ] 3 tests. 2024-02-05T07:20:17.840 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_1_[82252]: starting. 2024-02-05T07:20:17.841 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_1_[82252]: creating pool ceph_test_rados_delete_pools_parallel.smithi184-82139 2024-02-05T07:20:17.841 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_1_[82252]: created object 0... 2024-02-05T07:20:17.841 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_1_[82252]: created object 25... 2024-02-05T07:20:17.841 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_1_[82252]: created object 49... 2024-02-05T07:20:17.841 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_1_[82252]: finishing. 2024-02-05T07:20:17.841 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_1_[82252]: shutting down. 2024-02-05T07:20:17.841 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_2_[82254]: starting. 2024-02-05T07:20:17.841 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_2_[82254]: deleting pool ceph_test_rados_delete_pools_parallel.smithi184-82139 2024-02-05T07:20:17.841 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_2_[82254]: shutting down. 2024-02-05T07:20:17.841 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: ******************************* 2024-02-05T07:20:17.841 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_3_[83599]: starting. 2024-02-05T07:20:17.841 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_3_[83599]: creating pool ceph_test_rados_delete_pools_parallel.smithi184-82139 2024-02-05T07:20:17.841 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_3_[83599]: created object 0... 2024-02-05T07:20:17.841 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_3_[83599]: created object 25... 2024-02-05T07:20:17.841 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_3_[83599]: created object 49... 2024-02-05T07:20:17.842 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_3_[83599]: finishing. 2024-02-05T07:20:17.842 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_3_[83599]: shutting down. 2024-02-05T07:20:17.842 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: ******************************* 2024-02-05T07:20:17.842 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_5_[83601]: starting. 2024-02-05T07:20:17.842 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_5_[83601]: listing objects. 2024-02-05T07:20:17.842 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_5_[83601]: listed object 0... 2024-02-05T07:20:17.842 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_5_[83601]: listed object 25... 2024-02-05T07:20:17.842 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_5_[83601]: saw 50 objects 2024-02-05T07:20:17.842 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_5_[83601]: shutting down. 2024-02-05T07:20:17.842 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: ******************************* 2024-02-05T07:20:17.842 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_4_[83600]: starting. 2024-02-05T07:20:17.842 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_4_[83600]: deleting pool ceph_test_rados_delete_pools_parallel.smithi184-82139 2024-02-05T07:20:17.842 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: process_4_[83600]: shutting down. 2024-02-05T07:20:17.842 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: ******************************* 2024-02-05T07:20:17.842 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: ******************************* 2024-02-05T07:20:17.843 INFO:tasks.workunit.client.0.smithi184.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-02-05T07:20:18.842 INFO:tasks.workunit.client.0.smithi184.stdout:l": "PoolQuotaPP_smithi184-81228-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-05T07:20:18.842 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.114918+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:18.842 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.116426+0000 mon.a [INF] from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi184-81247-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:18.842 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.116772+0000 mon.a [INF] from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi184-81272-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:18.842 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.117034+0000 mon.a [INF] from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi184-81317-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:18.842 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.117283+0000 mon.a [INF] from='client.35312 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi184-82326-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:18.842 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.117521+0000 mon.a [INF] from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-4", "overlaypool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:18.842 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.117727+0000 mon.a [INF] from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi184-81307-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:18.842 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.117987+0000 mon.a [INF] from='client.35090 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi184-81228-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-05T07:20:18.842 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.122235+0000 mon.a [INF] from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi184-81647-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:18.842 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.122540+0000 mon.a [INF] from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi184-81638-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:18.843 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.122769+0000 mon.a [INF] from='client.24880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi184-82412-1"}]: dispatch 2024-02-05T07:20:18.843 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:15.123120+0000 mon.a [INF] from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:18.843 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:16.106774+0000 mon.a [INF] from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-4", "overlaypool": "test-rados-api-smithi184-81478-4-cache"}]': finished 2024-02-05T07:20:18.843 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:16.106839+0000 mon.a [INF] from='client.35090 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi184-81228-3", "field": "max_bytes", "val": "4096"}]': finished 2024-02-05T07:20:18.843 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:16.106909+0000 mon.a [INF] from='client.24880 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi184-82412-1"}]': finished 2024-02-05T07:20:18.843 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:16.106965+0000 mon.a [INF] from='client.24766 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]': finished 2024-02-05T07:20:18.843 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:16.110811+0000 mon.b [INF] from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:18.843 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:16.114616+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-4-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:20:18.843 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:16.152912+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/863985167' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi184-82412-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:18.843 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.097097+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/3519761101' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-05T07:20:18.843 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.097255+0000 client.admin [INF] threexx 2024-02-05T07:20:18.843 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.829865+0000 mon.c [INF] from='client.? v1:172.21.15.184:0/1836291541' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi184-81207-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:18.843 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.835577+0000 mon.a [INF] from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:18.843 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.838470+0000 mon.a [INF] from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-4-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:20:18.844 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.840085+0000 mon.a [INF] from='client.35336 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi184-82412-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:18.844 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.841836+0000 mon.a [INF] from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi184-81247-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi184-81247-16"}]': finished 2024-02-05T07:20:18.844 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.841935+0000 mon.a [INF] from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi184-81272-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi184-81272-22"}]': finished 2024-02-05T07:20:18.844 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.842132+0000 mon.a [INF] from='client.35309 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi184-81317-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi184-81317-10"}]': finished 2024-02-05T07:20:18.844 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.842224+0000 mon.a [INF] from='client.35312 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi184-82326-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi184-82326-2"}]': finished 2024-02-05T07:20:18.870 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.842375+0000 mon.a [INF] from='client.35300 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "poo watch_notify: Running main() from gmock_main.cc 2024-02-05T07:20:18.870 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: [==========] Running 2 tests from 1 test suite. 2024-02-05T07:20:18.870 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: [----------] Global test environment set-up. 2024-02-05T07:20:18.871 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2024-02-05T07:20:18.871 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2024-02-05T07:20:18.871 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: handle_notify cookie 94764954439360 notify_id 326417514496 notifier_gid 34919 2024-02-05T07:20:18.871 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (10832 ms) 2024-02-05T07:20:18.871 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-02-05T07:20:18.871 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: Trying... 2024-02-05T07:20:18.871 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: handle_notify cookie 94764966308464 notify_id 347892350978 notifier_gid 25201 2024-02-05T07:20:18.871 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: Waiting for 3.000000000s 2024-02-05T07:20:18.871 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: Timed out. 2024-02-05T07:20:18.872 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: Flushing... 2024-02-05T07:20:18.872 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: Flushed... 2024-02-05T07:20:18.872 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (8936 ms) 2024-02-05T07:20:18.872 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (19768 ms total) 2024-02-05T07:20:18.872 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: 2024-02-05T07:20:18.872 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: [----------] Global test environment tear-down 2024-02-05T07:20:18.872 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: [==========] 2 tests from 1 test suite ran. (19768 ms total) 2024-02-05T07:20:18.872 INFO:tasks.workunit.client.0.smithi184.stdout: watch_notify: [ PASSED ] 2 tests. 2024-02-05T07:20:19.012 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: Running main() from gmock_main.cc 2024-02-05T07:20:19.012 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2024-02-05T07:20:19.012 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [----------] Global test environment set-up. 2024-02-05T07:20:19.012 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2024-02-05T07:20:19.012 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: seed 81272 2024-02-05T07:20:19.012 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-02-05T07:20:19.012 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-02-05T07:20:19.012 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-02-05T07:20:19.012 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (361 ms) 2024-02-05T07:20:19.013 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-02-05T07:20:19.013 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (9 ms) 2024-02-05T07:20:19.013 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-02-05T07:20:19.013 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (5 ms) 2024-02-05T07:20:19.013 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-02-05T07:20:19.013 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (12 ms) 2024-02-05T07:20:19.013 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-02-05T07:20:19.013 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (5 ms) 2024-02-05T07:20:19.013 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-02-05T07:20:19.013 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (4 ms) 2024-02-05T07:20:19.013 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-02-05T07:20:19.013 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (4 ms) 2024-02-05T07:20:19.013 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-02-05T07:20:19.014 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (5 ms) 2024-02-05T07:20:19.014 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-02-05T07:20:19.014 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (4 ms) 2024-02-05T07:20:19.014 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-02-05T07:20:19.014 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (4 ms) 2024-02-05T07:20:19.014 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-02-05T07:20:19.014 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (4 ms) 2024-02-05T07:20:19.014 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-02-05T07:20:19.014 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (5 ms) 2024-02-05T07:20:19.014 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-02-05T07:20:19.014 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (8 ms) 2024-02-05T07:20:19.014 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-02-05T07:20:19.014 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (5 ms) 2024-02-05T07:20:19.014 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-02-05T07:20:19.014 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (13 ms) 2024-02-05T07:20:19.015 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-02-05T07:20:19.015 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (8 ms) 2024-02-05T07:20:19.015 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-02-05T07:20:19.015 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (4 ms) 2024-02-05T07:20:19.015 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-02-05T07:20:19.015 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (3 ms) 2024-02-05T07:20:19.015 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-02-05T07:20:19.015 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (5 ms) 2024-02-05T07:20:19.015 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (468 ms total) 2024-02-05T07:20:19.015 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: 2024-02-05T07:20:19.015 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2024-02-05T07:20:19.015 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-02-05T07:20:19.015 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (1113 ms) 2024-02-05T07:20:19.016 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-02-05T07:20:19.016 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (15 ms) 2024-02-05T07:20:19.016 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-02-05T07:20:19.016 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (5 ms) 2024-02-05T07:20:19.016 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-02-05T07:20:19.016 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (3 ms) 2024-02-05T07:20:19.016 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-02-05T07:20:19.016 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (5 ms) 2024-02-05T07:20:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-4", "overlaypool": "test-rados-api-smithi184-81478-4-cache"}]': finished 2024-02-05T07:20:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.35090 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi184-81228-3", "field": "max_bytes", "val": "4096"}]': finished 2024-02-05T07:20:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.24880 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi184-82412-1"}]': finished 2024-02-05T07:20:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.24766 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]': finished 2024-02-05T07:20:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-4-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:20:19.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/863985167' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi184-82412-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:19.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:19.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: pgmap v84: 772 pgs: 64 creating+peering, 516 active+clean, 192 unknown; 145 MiB data, 707 MiB used, 715 GiB / 715 GiB avail; 6.7 MiB/s wr, 2 op/s 2024-02-05T07:20:19.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: 15.7 deep-scrub starts 2024-02-05T07:20:19.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: 15.7 deep-scrub ok 2024-02-05T07:20:19.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3519761101' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-05T07:20:19.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: threexx 2024-02-05T07:20:19.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:19.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: osdmap e83: 8 total, 8 up, 8 in 2024-02-05T07:20:19.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1836291541' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi184-81207-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:19.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:19.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-4-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:20:19.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.35336 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi184-82412-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:19.253 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi184-81247-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi184-81247-16"}]': finished 2024-02-05T07:20:19.253 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi184-81272-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi184-81272-22"}]': finished 2024-02-05T07:20:19.253 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.35309 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi184-81317-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi184-81317-10"}]': finished 2024-02-05T07:20:19.253 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.35312 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi184-82326-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi184-82326-2"}]': finished 2024-02-05T07:20:19.253 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.35300 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi184-81307-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi184-81307-10"}]': finished 2024-02-05T07:20:19.253 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi184-81647-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi184-81647-7"}]': finished 2024-02-05T07:20:19.253 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi184-81638-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi184-81638-7"}]': finished 2024-02-05T07:20:19.253 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: osdmap e84: 8 total, 8 up, 8 in 2024-02-05T07:20:19.254 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/119374609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:19.254 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.35246 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-05T07:20:19.254 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:18 smithi188 ceph-mon[33283]: from='client.35330 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi184-81207-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-4", "overlaypool": "test-rados-api-smithi184-81478-4-cache"}]': finished 2024-02-05T07:20:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.35090 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi184-81228-3", "field": "max_bytes", "val": "4096"}]': finished 2024-02-05T07:20:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.24880 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi184-82412-1"}]': finished 2024-02-05T07:20:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.24766 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]': finished 2024-02-05T07:20:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:19.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-4-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:20:19.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/863985167' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi184-82412-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:19.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:19.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: pgmap v84: 772 pgs: 64 creating+peering, 516 active+clean, 192 unknown; 145 MiB data, 707 MiB used, 715 GiB / 715 GiB avail; 6.7 MiB/s wr, 2 op/s 2024-02-05T07:20:19.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: 15.7 deep-scrub starts 2024-02-05T07:20:19.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: 15.7 deep-scrub ok 2024-02-05T07:20:19.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3519761101' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-05T07:20:19.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: threexx 2024-02-05T07:20:19.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:19.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: osdmap e83: 8 total, 8 up, 8 in 2024-02-05T07:20:19.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1836291541' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi184-81207-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:19.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:19.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-4-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:20:19.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.35336 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi184-82412-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:19.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi184-81247-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi184-81247-16"}]': finished 2024-02-05T07:20:19.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi184-81272-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi184-81272-22"}]': finished 2024-02-05T07:20:19.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.35309 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi184-81317-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi184-81317-10"}]': finished 2024-02-05T07:20:19.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.35312 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi184-82326-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi184-82326-2"}]': finished 2024-02-05T07:20:19.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.35300 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi184-81307-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi184-81307-10"}]': finished 2024-02-05T07:20:19.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi184-81647-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi184-81647-7"}]': finished 2024-02-05T07:20:19.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi184-81638-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi184-81638-7"}]': finished 2024-02-05T07:20:19.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: osdmap e84: 8 total, 8 up, 8 in 2024-02-05T07:20:19.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/119374609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:19.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.35246 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-05T07:20:19.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[29861]: from='client.35330 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi184-81207-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:19.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-4", "overlaypool": "test-rados-api-smithi184-81478-4-cache"}]': finished 2024-02-05T07:20:19.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.35090 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi184-81228-3", "field": "max_bytes", "val": "4096"}]': finished 2024-02-05T07:20:19.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.24880 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi184-82412-1"}]': finished 2024-02-05T07:20:19.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.24766 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi184-81742-1"}]': finished 2024-02-05T07:20:19.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/850442423' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:19.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-4-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:20:19.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/863985167' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi184-82412-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:19.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:19.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: pgmap v84: 772 pgs: 64 creating+peering, 516 active+clean, 192 unknown; 145 MiB data, 707 MiB used, 715 GiB / 715 GiB avail; 6.7 MiB/s wr, 2 op/s 2024-02-05T07:20:19.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: 15.7 deep-scrub starts 2024-02-05T07:20:19.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: 15.7 deep-scrub ok 2024-02-05T07:20:19.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3519761101' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-05T07:20:19.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: threexx 2024-02-05T07:20:19.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:19.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: osdmap e83: 8 total, 8 up, 8 in 2024-02-05T07:20:19.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1836291541' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi184-81207-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:19.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.24766 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]: dispatch 2024-02-05T07:20:19.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-4-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:20:19.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.35336 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi184-82412-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:19.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi184-81247-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi184-81247-16"}]': finished 2024-02-05T07:20:19.279 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi184-81272-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi184-81272-22"}]': finished 2024-02-05T07:20:19.279 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.35309 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi184-81317-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi184-81317-10"}]': finished 2024-02-05T07:20:19.279 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.35312 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi184-82326-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi184-82326-2"}]': finished 2024-02-05T07:20:19.279 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.35300 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi184-81307-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi184-81307-10"}]': finished 2024-02-05T07:20:19.279 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi184-81647-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi184-81647-7"}]': finished 2024-02-05T07:20:19.279 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi184-81638-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi184-81638-7"}]': finished 2024-02-05T07:20:19.279 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: osdmap e84: 8 total, 8 up, 8 in 2024-02-05T07:20:19.280 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/119374609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:19.280 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.35246 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-05T07:20:19.280 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:18 smithi184 ceph-mon[41609]: from='client.35330 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi184-81207-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: 15.6 deep-scrub starts 2024-02-05T07:20:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: 15.6 deep-scrub ok 2024-02-05T07:20:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: 15.4 deep-scrub starts 2024-02-05T07:20:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: 15.4 deep-scrub ok 2024-02-05T07:20:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: pgmap v86: 828 pgs: 65 creating+peering, 676 active+clean, 87 unknown; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 3 op/s 2024-02-05T07:20:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.35246 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-02-05T07:20:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3519761101' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-05T07:20:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: fourxx 2024-02-05T07:20:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:20:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.35246 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-05T07:20:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.24766 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]': finished 2024-02-05T07:20:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-4-cache", "mode": "writeback"}]': finished 2024-02-05T07:20:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.35336 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi184-82412-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/119374609' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.35330 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi184-81207-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:20.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: osdmap e85: 8 total, 8 up, 8 in 2024-02-05T07:20:20.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/863985167' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi184-82412-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:20.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.35336 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi184-82412-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:20.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2613363087' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:20.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.35354 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:20.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-4"}]: dispatch 2024-02-05T07:20:20.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:20.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-4"}]: dispatch 2024-02-05T07:20:20.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:19 smithi188 ceph-mon[33283]: Health check update: 10 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: 15.6 deep-scrub starts 2024-02-05T07:20:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: 15.6 deep-scrub ok 2024-02-05T07:20:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: 15.4 deep-scrub starts 2024-02-05T07:20:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: 15.4 deep-scrub ok 2024-02-05T07:20:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: pgmap v86: 828 pgs: 65 creating+peering, 676 active+clean, 87 unknown; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 3 op/s 2024-02-05T07:20:20.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.35246 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-02-05T07:20:20.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3519761101' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-05T07:20:20.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: fourxx 2024-02-05T07:20:20.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:20:20.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.35246 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-05T07:20:20.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.24766 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]': finished 2024-02-05T07:20:20.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-4-cache", "mode": "writeback"}]': finished 2024-02-05T07:20:20.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.35336 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi184-82412-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:20.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/119374609' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:20.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.35330 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi184-81207-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:20.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: osdmap e85: 8 total, 8 up, 8 in 2024-02-05T07:20:20.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/863985167' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi184-82412-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:20.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.35336 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi184-82412-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:20.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2613363087' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:20.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.35354 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:20.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-4"}]: dispatch 2024-02-05T07:20:20.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:20.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: 15.6 deep-scrub starts 2024-02-05T07:20:20.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: 15.6 deep-scrub ok 2024-02-05T07:20:20.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: 15.4 deep-scrub starts 2024-02-05T07:20:20.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: 15.4 deep-scrub ok 2024-02-05T07:20:20.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:20.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: pgmap v86: 828 pgs: 65 creating+peering, 676 active+clean, 87 unknown; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 3 op/s 2024-02-05T07:20:20.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.35246 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-02-05T07:20:20.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3519761101' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-05T07:20:20.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: fourxx 2024-02-05T07:20:20.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:20:20.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.35246 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-05T07:20:20.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.24766 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi184-81742-1"}]': finished 2024-02-05T07:20:20.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-4-cache", "mode": "writeback"}]': finished 2024-02-05T07:20:20.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.35336 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi184-82412-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:20.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/119374609' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:20.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.35330 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi184-81207-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:20.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: osdmap e85: 8 total, 8 up, 8 in 2024-02-05T07:20:20.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/863985167' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi184-82412-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:20.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.35336 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi184-82412-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:20.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2613363087' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:20.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.35354 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:20.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-4"}]: dispatch 2024-02-05T07:20:20.277 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:20.277 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-4"}]: dispatch 2024-02-05T07:20:20.277 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[29861]: Health check update: 10 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:20.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:20.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-4"}]: dispatch 2024-02-05T07:20:20.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:19 smithi184 ceph-mon[41609]: Health check update: 10 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:20.946 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] list: Running main() from gmock_main.cc 2024-02-05T07:20:20.946 INFO:tasks.workunit.client.0.smithi184.stdout: list: [==========] Running 3 tests from 1 test suite. 2024-02-05T07:20:20.946 INFO:tasks.workunit.client.0.smithi184.stdout: list: [----------] Global test environment set-up. 2024-02-05T07:20:20.947 INFO:tasks.workunit.client.0.smithi184.stdout: list: [----------] 3 tests from NeoradosList 2024-02-05T07:20:20.947 INFO:tasks.workunit.client.0.smithi184.stdout: list: [ RUN ] NeoradosList.ListObjects 2024-02-05T07:20:20.947 INFO:tasks.workunit.client.0.smithi184.stdout: list: [ OK ] NeoradosList.ListObjects (11702 ms) 2024-02-05T07:20:20.947 INFO:tasks.workunit.client.0.smithi184.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2024-02-05T07:20:20.947 INFO:tasks.workunit.client.0.smithi184.stdout: list: [ OK ] NeoradosList.ListObjectsNS (7071 ms) 2024-02-05T07:20:20.947 INFO:tasks.workunit.client.0.smithi184.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2024-02-05T07:20:20.947 INFO:tasks.workunit.client.0.smithi184.stdout: list: [ OK ] NeoradosList.ListObjectsMany (3111 ms) 2024-02-05T07:20:20.947 INFO:tasks.workunit.client.0.smithi184.stdout: list: [----------] 3 tests from NeoradosList (21884 ms total) 2024-02-05T07:20:20.947 INFO:tasks.workunit.client.0.smithi184.stdout: list: 2024-02-05T07:20:20.947 INFO:tasks.workunit.client.0.smithi184.stdout: list: [----------] Global test environment tear-down 2024-02-05T07:20:20.947 INFO:tasks.workunit.client.0.smithi184.stdout: list: [==========] 3 tests from 1 test suite ran. (21885 ms total) 2024-02-05T07:20:20.947 INFO:tasks.workunit.client.0.smithi184.stdout: list: [ PASSED ] 3 tests. 2024-02-05T07:20:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.35246 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-02-05T07:20:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.35354 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-4"}]': finished 2024-02-05T07:20:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: osdmap e86: 8 total, 8 up, 8 in 2024-02-05T07:20:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2150055962' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.35312 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:21.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:21.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:21.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:21.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:21.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:20 smithi188 ceph-mon[33283]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.35246 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-02-05T07:20:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.35354 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-4"}]': finished 2024-02-05T07:20:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: osdmap e86: 8 total, 8 up, 8 in 2024-02-05T07:20:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2150055962' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:21.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:21.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:21.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:21.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:21.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.35312 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:21.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:21.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:21.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.35246 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-02-05T07:20:21.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.35354 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:21.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-4"}]': finished 2024-02-05T07:20:21.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2021190476' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:21.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:21.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: osdmap e86: 8 total, 8 up, 8 in 2024-02-05T07:20:21.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:21.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:21.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:21.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2150055962' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:21.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:21.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:21.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.35087 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]: dispatch 2024-02-05T07:20:21.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:21.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:21.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:21.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.35312 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:21.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:21.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:21.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:21.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:21.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:21.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:21.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:21.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[29861]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:21.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:21.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:21.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:21.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:21.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:21.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:20 smithi184 ceph-mon[41609]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:21.848 INFO:tasks.workunit.client.0.smithi184.stdout:l": "LibRadosLockEC_smithi184-81307-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi184-81307-10"}]': finished 2024-02-05T07:20:21.848 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.842529+0000 mon.a [INF] from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi184-81647-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi184-81647-7"}]': finished 2024-02-05T07:20:21.848 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.842669+0000 mon.a [INF] from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi184-81638-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi184-81638-7"}]': finished 2024-02-05T07:20:21.849 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.858606+0000 mon.a [INF] from='client.? v1:172.21.15.184:0/119374609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:21.849 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.859628+0000 mon.a [INF] from='client.35246 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-05T07:20:21.849 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: got: 2024-02-05T07:20:17.859897+0000 mon.a [INF] from='client.35330 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi184-81207-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:21.849 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (10053 ms) 2024-02-05T07:20:21.849 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (23011 ms total) 2024-02-05T07:20:21.849 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: 2024-02-05T07:20:21.849 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: [----------] Global test environment tear-down 2024-02-05T07:20:21.849 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (23011 ms total) 2024-02-05T07:20:21.849 INFO:tasks.workunit.client.0.smithi184.stdout: api_cmd: [ PASSED ] 4 tests. 2024-02-05T07:20:21.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-02-05T07:20:21.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-02-05T07:20:21.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-02-05T07:20:21.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-02-05T07:20:21.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: seed 81647 2024-02-05T07:20:21.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-02-05T07:20:21.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (272 ms) 2024-02-05T07:20:21.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-02-05T07:20:21.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (56 ms) 2024-02-05T07:20:21.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-02-05T07:20:21.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (1 ms) 2024-02-05T07:20:21.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-02-05T07:20:21.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (27 ms) 2024-02-05T07:20:21.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-02-05T07:20:21.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (26 ms) 2024-02-05T07:20:21.945 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (382 ms total) 2024-02-05T07:20:21.945 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: 2024-02-05T07:20:21.945 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-02-05T07:20:21.945 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-02-05T07:20:21.945 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (1125 ms) 2024-02-05T07:20:21.945 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-02-05T07:20:21.945 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (2 ms) 2024-02-05T07:20:21.945 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-02-05T07:20:21.945 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (5 ms) 2024-02-05T07:20:21.945 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-02-05T07:20:21.945 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (9 ms) 2024-02-05T07:20:21.945 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (1141 ms total) 2024-02-05T07:20:21.945 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: 2024-02-05T07:20:21.945 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-02-05T07:20:21.946 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (23143 ms total) 2024-02-05T07:20:21.946 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-02-05T07:20:21.946 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: Running main() from gmock_main.cc 2024-02-05T07:20:21.946 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2024-02-05T07:20:21.946 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [----------] Global test environment set-up. 2024-02-05T07:20:21.946 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [----------] 5 tests from LibRadosStat 2024-02-05T07:20:21.946 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-02-05T07:20:21.946 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ OK ] LibRadosStat.Stat (346 ms) 2024-02-05T07:20:21.946 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2024-02-05T07:20:21.946 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (29 ms) 2024-02-05T07:20:21.946 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-02-05T07:20:21.946 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ OK ] LibRadosStat.StatNS (18 ms) 2024-02-05T07:20:21.946 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-02-05T07:20:21.946 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (1 ms) 2024-02-05T07:20:21.947 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-02-05T07:20:21.947 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (3 ms) 2024-02-05T07:20:21.947 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [----------] 5 tests from LibRadosStat (397 ms total) 2024-02-05T07:20:21.947 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: 2024-02-05T07:20:21.947 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-02-05T07:20:21.947 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-02-05T07:20:21.947 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (1128 ms) 2024-02-05T07:20:21.947 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-02-05T07:20:21.947 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (11 ms) 2024-02-05T07:20:21.947 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-02-05T07:20:21.947 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (0 ms) 2024-02-05T07:20:21.947 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-02-05T07:20:21.947 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (2 ms) 2024-02-05T07:20:21.947 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (1141 ms total) 2024-02-05T07:20:21.948 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: 2024-02-05T07:20:21.948 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [----------] Global test environment tear-down 2024-02-05T07:20:21.948 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (23155 ms total) 2024-02-05T07:20:21.948 INFO:tasks.workunit.client.0.smithi184.stdout: api_stat: [ PASSED ] 9 tests. 2024-02-05T07:20:21.948 INFO:tasks.workunit.client.0.smithi184.stdout: ec_io: Running main() from gmock_main.cc 2024-02-05T07:20:21.948 INFO:tasks.workunit.client.0.smithi184.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2024-02-05T07:20:21.948 INFO:tasks.workunit.client.0.smithi184.stdout: ec_io: [----------] Global test environment set-up. 2024-02-05T07:20:21.948 INFO:tasks.workunit.client.0.smithi184.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2024-02-05T07:20:21.948 INFO:tasks.workunit.client.0.smithi184.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2024-02-05T07:20:21.949 INFO:tasks.workunit.client.0.smithi184.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (15082 ms) 2024-02-05T07:20:21.949 INFO:tasks.workunit.client.0.smithi184.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2024-02-05T07:20:21.949 INFO:tasks.workunit.client.0.smithi184.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (7836 ms) 2024-02-05T07:20:21.949 INFO:tasks.workunit.client.0.smithi184.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (22919 ms total) 2024-02-05T07:20:21.949 INFO:tasks.workunit.client.0.smithi184.stdout: ec_io: 2024-02-05T07:20:21.949 INFO:tasks.workunit.client.0.smithi184.stdout: ec_io: [----------] Global test environment tear-down 2024-02-05T07:20:21.949 INFO:tasks.workunit.client.0.smithi184.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (22919 ms total) 2024-02-05T07:20:21.949 INFO:tasks.workunit.client.0.smithi184.stdout: ec_io: [ PASSED ] 2 tests. 2024-02-05T07:20:21.950 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: Running main() from gmock_main.cc 2024-02-05T07:20:21.950 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-02-05T07:20:21.950 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [----------] Global test environment set-up. 2024-02-05T07:20:21.950 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-02-05T07:20:21.950 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-02-05T07:20:21.950 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (311 ms) 2024-02-05T07:20:21.950 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-02-05T07:20:21.950 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-02-05T07:20:21.950 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-02-05T07:20:21.950 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: no timeout :/ 2024-02-05T07:20:21.950 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: no timeout :/ 2024-02-05T07:20:21.950 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: no timeout :/ 2024-02-05T07:20:21.950 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: no timeout :/ 2024-02-05T07:20:21.950 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: no timeout :/ 2024-02-05T07:20:21.951 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (96 ms) 2024-02-05T07:20:21.951 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-02-05T07:20:21.951 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (8 ms) 2024-02-05T07:20:21.951 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-02-05T07:20:21.951 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIo.Checksum (3 ms) 2024-02-05T07:20:21.951 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-02-05T07:20:21.951 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (5 ms) 2024-02-05T07:20:21.951 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-02-05T07:20:21.951 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (6 ms) 2024-02-05T07:20:21.951 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-02-05T07:20:21.951 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (6 ms) 2024-02-05T07:20:21.951 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-02-05T07:20:21.951 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (2 ms) 2024-02-05T07:20:21.951 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-02-05T07:20:21.952 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIo.TruncTest (6 ms) 2024-02-05T07:20:21.952 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-02-05T07:20:21.952 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (4 ms) 2024-02-05T07:20:21.952 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-02-05T07:20:21.952 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (4 ms) 2024-02-05T07:20:21.952 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-02-05T07:20:21.952 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIo.RmXattr (14 ms) 2024-02-05T07:20:21.952 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-02-05T07:20:21.952 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIo.XattrIter (5 ms) 2024-02-05T07:20:21.952 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [----------] 14 tests from LibRadosIo (470 ms total) 2024-02-05T07:20:21.952 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: 2024-02-05T07:20:21.952 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-02-05T07:20:21.952 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-02-05T07:20:21.952 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (1126 ms) 2024-02-05T07:20:21.953 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-02-05T07:20:21.953 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (8 ms) 2024-02-05T07:20:21.953 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-02-05T07:20:21.953 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (7 ms) 2024-02-05T07:20:21.953 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-02-05T07:20:21.953 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (5 ms) 2024-02-05T07:20:21.953 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-02-05T07:20:21.953 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (11 ms) 2024-02-05T07:20:21.953 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-02-05T07:20:21.953 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (3 ms) 2024-02-05T07:20:21.953 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-02-05T07:20:21.953 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (3 ms) 2024-02-05T07:20:21.953 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-02-05T07:20:21.953 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (3 ms) 2024-02-05T07:20:21.954 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-02-05T07:20:21.954 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (8 ms) 2024-02-05T07:20:21.954 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-02-05T07:20:21.954 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (4 ms) 2024-02-05T07:20:21.954 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [----------] 10 tests from LibRadosIoEC (1178 ms total) 2024-02-05T07:20:21.954 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: 2024-02-05T07:20:21.954 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [----------] Global test environment tear-down 2024-02-05T07:20:21.954 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [==========] 24 tests from 2 test suites ran. (23295 ms total) 2024-02-05T07:20:21.954 INFO:tasks.workunit.client.0.smithi184.stdout: api_io: [ PASSED ] 24 tests. 2024-02-05T07:20:21.954 INFO:tasks.workunit.client.0.smithi184.stdout: LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-02-05T07:20:21.955 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (5 ms) 2024-02-05T07:20:21.955 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-02-05T07:20:21.955 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (5 ms) 2024-02-05T07:20:21.955 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-02-05T07:20:21.955 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (3 ms) 2024-02-05T07:20:21.955 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-02-05T07:20:21.955 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (5 ms) 2024-02-05T07:20:21.955 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-02-05T07:20:21.955 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (5 ms) 2024-02-05T07:20:21.955 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-02-05T07:20:21.955 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (2 ms) 2024-02-05T07:20:21.955 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-02-05T07:20:21.955 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (3 ms) 2024-02-05T07:20:21.956 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-02-05T07:20:21.956 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (7 ms) 2024-02-05T07:20:21.956 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-02-05T07:20:21.956 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (4 ms) 2024-02-05T07:20:21.956 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-02-05T07:20:21.956 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (4 ms) 2024-02-05T07:20:21.956 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-02-05T07:20:21.956 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (2 ms) 2024-02-05T07:20:21.956 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-02-05T07:20:21.956 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (5 ms) 2024-02-05T07:20:21.956 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (1191 ms total) 2024-02-05T07:20:21.956 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: 2024-02-05T07:20:21.956 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [----------] Global test environment tear-down 2024-02-05T07:20:21.956 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (23288 ms total) 2024-02-05T07:20:21.957 INFO:tasks.workunit.client.0.smithi184.stdout: api_io_pp: [ PASSED ] 37 tests. 2024-02-05T07:20:22.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: pgmap v89: 756 pgs: 580 active+clean, 176 unknown; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:20:22.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:20:22.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.35336 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi184-82412-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi184-82412-2"}]': finished 2024-02-05T07:20:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]': finished 2024-02-05T07:20:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.35312 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi184-82326-2"}]': finished 2024-02-05T07:20:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]': finished 2024-02-05T07:20:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]': finished 2024-02-05T07:20:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]': finished 2024-02-05T07:20:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]': finished 2024-02-05T07:20:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.35369 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi184-81802-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:22.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2150055962' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:22.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:22.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3197438441' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi184-81207-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:22.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81742-6", "pg_num": 4}]: dispatch 2024-02-05T07:20:22.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: osdmap e87: 8 total, 8 up, 8 in 2024-02-05T07:20:22.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:22.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi184-81802-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:22.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:22.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:22.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.35312 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:22.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:22.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.35384 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi184-81207-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:22.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:22.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:21 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81742-6", "pg_num": 4}]: dispatch 2024-02-05T07:20:22.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:20:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:20:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: pgmap v89: 756 pgs: 580 active+clean, 176 unknown; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:20:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:20:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.35336 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi184-82412-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi184-82412-2"}]': finished 2024-02-05T07:20:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]': finished 2024-02-05T07:20:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.35312 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi184-82326-2"}]': finished 2024-02-05T07:20:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]': finished 2024-02-05T07:20:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]': finished 2024-02-05T07:20:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]': finished 2024-02-05T07:20:22.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]': finished 2024-02-05T07:20:22.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.35369 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:22.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:22.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:22.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi184-81802-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:22.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:22.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2150055962' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:22.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:22.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3197438441' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi184-81207-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: pgmap v89: 756 pgs: 580 active+clean, 176 unknown; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:20:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:20:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.35336 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi184-82412-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi184-82412-2"}]': finished 2024-02-05T07:20:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.35087 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-4", "tierpool": "test-rados-api-smithi184-81478-4-cache"}]': finished 2024-02-05T07:20:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.35312 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi184-82326-2"}]': finished 2024-02-05T07:20:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi184-81247-16"}]': finished 2024-02-05T07:20:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi184-81272-22"}]': finished 2024-02-05T07:20:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi184-81638-7"}]': finished 2024-02-05T07:20:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi184-81647-7"}]': finished 2024-02-05T07:20:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.35369 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3111980336' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3594026639' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi184-81802-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2762753790' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2150055962' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2242213265' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:22.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3197438441' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi184-81207-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:22.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81742-6", "pg_num": 4}]: dispatch 2024-02-05T07:20:22.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: osdmap e87: 8 total, 8 up, 8 in 2024-02-05T07:20:22.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:22.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi184-81802-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:22.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:22.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:22.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.35312 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:22.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:22.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.35384 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi184-81207-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:22.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:22.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81742-6", "pg_num": 4}]: dispatch 2024-02-05T07:20:22.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81742-6", "pg_num": 4}]: dispatch 2024-02-05T07:20:22.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: osdmap e87: 8 total, 8 up, 8 in 2024-02-05T07:20:22.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.25291 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi184-81638-7"}]: dispatch 2024-02-05T07:20:22.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi184-81802-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:22.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi184-81647-7"}]: dispatch 2024-02-05T07:20:22.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.35270 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi184-81272-22"}]: dispatch 2024-02-05T07:20:22.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.35312 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi184-82326-2"}]: dispatch 2024-02-05T07:20:22.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.35228 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]: dispatch 2024-02-05T07:20:22.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.35384 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi184-81207-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:22.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:22.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:21 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81742-6", "pg_num": 4}]: dispatch 2024-02-05T07:20:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi184-81638-7"}]': finished 2024-02-05T07:20:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi184-81647-7"}]': finished 2024-02-05T07:20:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi184-81272-22"}]': finished 2024-02-05T07:20:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.35312 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi184-82326-2"}]': finished 2024-02-05T07:20:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]': finished 2024-02-05T07:20:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.35384 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi184-81207-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81742-6", "pg_num": 4}]': finished 2024-02-05T07:20:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1792674044' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:23.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:23.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: osdmap e88: 8 total, 8 up, 8 in 2024-02-05T07:20:23.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3385877520' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:23.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:23.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:23.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:23.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.25405 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:23.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.35399 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:23.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:23.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:23.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:23.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi184-81638-7"}]': finished 2024-02-05T07:20:23.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi184-81647-7"}]': finished 2024-02-05T07:20:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi184-81272-22"}]': finished 2024-02-05T07:20:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.35312 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi184-82326-2"}]': finished 2024-02-05T07:20:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]': finished 2024-02-05T07:20:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.35384 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi184-81207-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81742-6", "pg_num": 4}]': finished 2024-02-05T07:20:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1792674044' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: osdmap e88: 8 total, 8 up, 8 in 2024-02-05T07:20:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3385877520' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.25405 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:23.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.35399 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:23.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:23.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:23.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:23.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.25291 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi184-81638-7"}]': finished 2024-02-05T07:20:23.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi184-81647-7"}]': finished 2024-02-05T07:20:23.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.35270 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi184-81272-22"}]': finished 2024-02-05T07:20:23.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.35312 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi184-82326-2"}]': finished 2024-02-05T07:20:23.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.35228 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi184-81247-16"}]': finished 2024-02-05T07:20:23.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.35384 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi184-81207-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:23.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81742-6", "pg_num": 4}]': finished 2024-02-05T07:20:23.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1792674044' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:23.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:23.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: osdmap e88: 8 total, 8 up, 8 in 2024-02-05T07:20:23.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3385877520' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:23.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:23.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:23.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:23.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.25405 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:23.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.35399 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:23.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:23.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:23.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:23.968 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-02-05T07:20:23.968 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-02-05T07:20:23.968 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-02-05T07:20:23.968 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-02-05T07:20:23.969 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: seed 81317 2024-02-05T07:20:23.969 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-02-05T07:20:23.969 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (372 ms) 2024-02-05T07:20:23.969 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-02-05T07:20:23.969 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (7 ms) 2024-02-05T07:20:23.969 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-02-05T07:20:23.969 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1042 ms) 2024-02-05T07:20:23.969 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-02-05T07:20:23.969 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1029 ms) 2024-02-05T07:20:23.969 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-02-05T07:20:23.969 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (5 ms) 2024-02-05T07:20:23.969 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-02-05T07:20:23.969 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (4 ms) 2024-02-05T07:20:23.969 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-02-05T07:20:23.970 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (4 ms) 2024-02-05T07:20:23.970 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-02-05T07:20:23.970 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (3 ms) 2024-02-05T07:20:23.970 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (2466 ms total) 2024-02-05T07:20:23.970 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: 2024-02-05T07:20:23.970 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-02-05T07:20:23.970 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-02-05T07:20:23.970 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (1113 ms) 2024-02-05T07:20:23.970 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-02-05T07:20:23.970 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (7 ms) 2024-02-05T07:20:23.970 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-02-05T07:20:23.970 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1087 ms) 2024-02-05T07:20:23.970 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-02-05T07:20:23.970 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1019 ms) 2024-02-05T07:20:23.971 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-02-05T07:20:23.971 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (4 ms) 2024-02-05T07:20:23.971 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-02-05T07:20:23.971 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (4 ms) 2024-02-05T07:20:23.971 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-02-05T07:20:23.971 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (5 ms) 2024-02-05T07:20:23.971 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-02-05T07:20:23.971 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (3 ms) 2024-02-05T07:20:23.971 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (3242 ms total) 2024-02-05T07:20:23.971 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: 2024-02-05T07:20:23.971 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-02-05T07:20:23.971 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (25271 ms total) 2024-02-05T07:20:23.971 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-02-05T07:20:23.992 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: Running main() from gmock_main.cc 2024-02-05T07:20:23.992 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-02-05T07:20:23.992 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [----------] Global test environment set-up. 2024-02-05T07:20:23.992 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-02-05T07:20:23.992 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-02-05T07:20:23.992 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (377 ms) 2024-02-05T07:20:23.992 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-02-05T07:20:23.992 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLock.LockShared (9 ms) 2024-02-05T07:20:23.993 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-02-05T07:20:23.993 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1060 ms) 2024-02-05T07:20:23.993 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-02-05T07:20:23.993 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1009 ms) 2024-02-05T07:20:23.993 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-02-05T07:20:23.993 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (4 ms) 2024-02-05T07:20:23.993 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-02-05T07:20:23.993 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLock.Unlock (5 ms) 2024-02-05T07:20:23.993 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-02-05T07:20:23.993 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (5 ms) 2024-02-05T07:20:23.993 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-02-05T07:20:23.993 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (4 ms) 2024-02-05T07:20:23.993 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [----------] 8 tests from LibRadosLock (2473 ms total) 2024-02-05T07:20:23.993 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: 2024-02-05T07:20:23.994 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-02-05T07:20:23.994 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-02-05T07:20:23.994 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1099 ms) 2024-02-05T07:20:23.994 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-02-05T07:20:23.994 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (20 ms) 2024-02-05T07:20:23.994 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-02-05T07:20:23.994 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1085 ms) 2024-02-05T07:20:23.994 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-02-05T07:20:23.994 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1030 ms) 2024-02-05T07:20:23.994 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-02-05T07:20:23.994 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (4 ms) 2024-02-05T07:20:23.994 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-02-05T07:20:23.994 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (4 ms) 2024-02-05T07:20:23.994 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-02-05T07:20:23.994 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (5 ms) 2024-02-05T07:20:23.995 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-02-05T07:20:23.995 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (2 ms) 2024-02-05T07:20:23.995 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (3249 ms total) 2024-02-05T07:20:23.995 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: 2024-02-05T07:20:23.995 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [----------] Global test environment tear-down 2024-02-05T07:20:23.995 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (25317 ms total) 2024-02-05T07:20:23.995 INFO:tasks.workunit.client.0.smithi184.stdout: api_lock: [ PASSED ] 16 tests. 2024-02-05T07:20:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: pgmap v92: 752 pgs: 71 creating+peering, 620 active+clean, 61 unknown; 145 MiB data, 750 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-02-05T07:20:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: from='client.35369 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi184-81802-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]': finished 2024-02-05T07:20:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:20:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: from='client.25405 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: from='client.35399 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: from='client.35309 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10"}]': finished 2024-02-05T07:20:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: from='client.35300 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi184-81307-10"}]': finished 2024-02-05T07:20:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: osdmap e89: 8 total, 8 up, 8 in 2024-02-05T07:20:24.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:24.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "overlaypool": "test-rados-api-smithi184-81742-6"}]: dispatch 2024-02-05T07:20:24.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/863985167' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:24.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:24.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:24.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "overlaypool": "test-rados-api-smithi184-81742-6"}]: dispatch 2024-02-05T07:20:24.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: from='client.35336 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:24.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:24.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: pgmap v92: 752 pgs: 71 creating+peering, 620 active+clean, 61 unknown; 145 MiB data, 750 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-02-05T07:20:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: from='client.35369 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi184-81802-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]': finished 2024-02-05T07:20:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:20:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: from='client.25405 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: from='client.35399 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: from='client.35309 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10"}]': finished 2024-02-05T07:20:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: from='client.35300 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi184-81307-10"}]': finished 2024-02-05T07:20:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: osdmap e89: 8 total, 8 up, 8 in 2024-02-05T07:20:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "overlaypool": "test-rados-api-smithi184-81742-6"}]: dispatch 2024-02-05T07:20:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/863985167' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:24.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:24.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:24.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "overlaypool": "test-rados-api-smithi184-81742-6"}]: dispatch 2024-02-05T07:20:24.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: from='client.35336 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:24.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:24.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: pgmap v92: 752 pgs: 71 creating+peering, 620 active+clean, 61 unknown; 145 MiB data, 750 MiB used, 714 GiB / 715 GiB avail; 2.5 KiB/s rd, 2.5 KiB/s wr, 2 op/s 2024-02-05T07:20:24.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: from='client.35369 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi184-81802-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]': finished 2024-02-05T07:20:24.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:20:24.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: from='client.25405 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:24.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: from='client.35399 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:24.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: from='client.35309 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi184-81317-10"}]': finished 2024-02-05T07:20:24.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: from='client.35300 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi184-81307-10"}]': finished 2024-02-05T07:20:24.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1822870766' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:24.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: osdmap e89: 8 total, 8 up, 8 in 2024-02-05T07:20:24.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3978757817' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:24.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "overlaypool": "test-rados-api-smithi184-81742-6"}]: dispatch 2024-02-05T07:20:24.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/863985167' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:24.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: from='client.35309 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi184-81317-10"}]: dispatch 2024-02-05T07:20:24.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: from='client.35300 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi184-81307-10"}]: dispatch 2024-02-05T07:20:24.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "overlaypool": "test-rados-api-smithi184-81742-6"}]: dispatch 2024-02-05T07:20:24.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: from='client.35336 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:24.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:25.636 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.35309 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi184-81317-10"}]': finished 2024-02-05T07:20:25.637 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.35300 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi184-81307-10"}]': finished 2024-02-05T07:20:25.637 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "overlaypool": "test-rados-api-smithi184-81742-6"}]': finished 2024-02-05T07:20:25.637 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.35336 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi184-82412-2"}]': finished 2024-02-05T07:20:25.637 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: osdmap e90: 8 total, 8 up, 8 in 2024-02-05T07:20:25.637 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3801847934' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi184-81207-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:25.637 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.25444 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi184-81207-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:25.637 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/863985167' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:25.637 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81742-6", "mode": "writeback"}]: dispatch 2024-02-05T07:20:25.637 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2116789784' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi184-81575-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:25.637 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.25447 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi184-81575-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:25.637 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.35336 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:25.638 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81742-6", "mode": "writeback"}]: dispatch 2024-02-05T07:20:25.638 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:25.638 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:20:25.638 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:25.638 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: pool 'PoolQuotaPP_smithi184-81228-3' is full (reached quota's max_bytes: 4 KiB) 2024-02-05T07:20:25.638 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:20:25.638 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-05T07:20:25.638 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.25444 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi184-81207-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:25.638 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.25447 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi184-81575-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:25.638 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.35336 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi184-82412-2"}]': finished 2024-02-05T07:20:25.638 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81742-6", "mode": "writeback"}]': finished 2024-02-05T07:20:25.638 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[29861]: osdmap e91: 8 total, 8 up, 8 in 2024-02-05T07:20:25.639 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.35309 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi184-81317-10"}]': finished 2024-02-05T07:20:25.639 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.35300 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi184-81307-10"}]': finished 2024-02-05T07:20:25.639 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "overlaypool": "test-rados-api-smithi184-81742-6"}]': finished 2024-02-05T07:20:25.639 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.35336 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi184-82412-2"}]': finished 2024-02-05T07:20:25.639 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: osdmap e90: 8 total, 8 up, 8 in 2024-02-05T07:20:25.639 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3801847934' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi184-81207-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:25.639 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.25444 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi184-81207-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:25.639 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/863985167' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:25.639 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81742-6", "mode": "writeback"}]: dispatch 2024-02-05T07:20:25.639 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2116789784' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi184-81575-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:25.639 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.25447 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi184-81575-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:25.640 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.35336 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:25.640 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81742-6", "mode": "writeback"}]: dispatch 2024-02-05T07:20:25.640 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:25.640 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:20:25.640 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:25.640 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: pool 'PoolQuotaPP_smithi184-81228-3' is full (reached quota's max_bytes: 4 KiB) 2024-02-05T07:20:25.640 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:20:25.640 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-05T07:20:25.640 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.25444 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi184-81207-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:25.640 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.25447 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi184-81575-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:25.640 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.35336 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi184-82412-2"}]': finished 2024-02-05T07:20:25.640 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81742-6", "mode": "writeback"}]': finished 2024-02-05T07:20:25.640 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:25 smithi184 ceph-mon[41609]: osdmap e91: 8 total, 8 up, 8 in 2024-02-05T07:20:25.741 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.35309 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi184-81317-10"}]': finished 2024-02-05T07:20:25.741 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.35300 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi184-81307-10"}]': finished 2024-02-05T07:20:25.742 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "overlaypool": "test-rados-api-smithi184-81742-6"}]': finished 2024-02-05T07:20:25.742 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.35336 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi184-82412-2"}]': finished 2024-02-05T07:20:25.742 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: osdmap e90: 8 total, 8 up, 8 in 2024-02-05T07:20:25.742 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3801847934' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi184-81207-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:25.742 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.25444 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi184-81207-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:25.742 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/863985167' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:25.742 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81742-6", "mode": "writeback"}]: dispatch 2024-02-05T07:20:25.742 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2116789784' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi184-81575-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:25.742 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.25447 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi184-81575-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:25.742 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.35336 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi184-82412-2"}]: dispatch 2024-02-05T07:20:25.742 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81742-6", "mode": "writeback"}]: dispatch 2024-02-05T07:20:25.742 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:25.742 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:20:25.742 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:25.743 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: pool 'PoolQuotaPP_smithi184-81228-3' is full (reached quota's max_bytes: 4 KiB) 2024-02-05T07:20:25.743 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:20:25.743 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-05T07:20:25.743 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.25444 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi184-81207-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:25.743 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.25447 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi184-81575-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:25.743 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.35336 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi184-82412-2"}]': finished 2024-02-05T07:20:25.743 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81742-6", "mode": "writeback"}]': finished 2024-02-05T07:20:25.743 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:25 smithi188 ceph-mon[33283]: osdmap e91: 8 total, 8 up, 8 in 2024-02-05T07:20:25.785 INFO:tasks.workunit.client.0.smithi184.stdout: pool: Running main() from gmock_main.cc 2024-02-05T07:20:25.785 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [==========] Running 6 tests from 1 test suite. 2024-02-05T07:20:25.786 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [----------] Global test environment set-up. 2024-02-05T07:20:25.786 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [----------] 6 tests from NeoRadosPools 2024-02-05T07:20:25.786 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2024-02-05T07:20:25.786 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [ OK ] NeoRadosPools.PoolList (9944 ms) 2024-02-05T07:20:25.786 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2024-02-05T07:20:25.786 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (3833 ms) 2024-02-05T07:20:25.787 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-02-05T07:20:25.787 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (4978 ms) 2024-02-05T07:20:25.787 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2024-02-05T07:20:25.787 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (4368 ms) 2024-02-05T07:20:25.788 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2024-02-05T07:20:25.788 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (1770 ms) 2024-02-05T07:20:25.788 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-02-05T07:20:25.788 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (1807 ms) 2024-02-05T07:20:25.788 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [----------] 6 tests from NeoRadosPools (26700 ms total) 2024-02-05T07:20:25.788 INFO:tasks.workunit.client.0.smithi184.stdout: pool: 2024-02-05T07:20:25.788 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [----------] Global test environment tear-down 2024-02-05T07:20:25.788 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [==========] 6 tests from 1 test suite ran. (26700 ms total) 2024-02-05T07:20:25.788 INFO:tasks.workunit.client.0.smithi184.stdout: pool: [ PASSED ] 6 tests. 2024-02-05T07:20:26.890 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: pgmap v95: 624 pgs: 4 creating+peering, 484 active+clean, 136 unknown; 145 MiB data, 769 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 5.7 KiB/s wr, 2 op/s 2024-02-05T07:20:26.890 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4101555711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:26.891 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:26.891 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: from='client.35438 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:26.891 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2096518269' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi184-82412-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:26.891 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: from='client.35471 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi184-82412-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:26.891 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: from='client.35438 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:26.891 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: from='client.35471 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi184-82412-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:26.891 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: osdmap e92: 8 total, 8 up, 8 in 2024-02-05T07:20:26.891 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2096518269' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi184-82412-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:26.891 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:26.891 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: from='client.35471 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi184-82412-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:26.891 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3100157160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:26.891 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:26.891 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: from='client.35459 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:26.891 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:26.892 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:26 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:27.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: pgmap v95: 624 pgs: 4 creating+peering, 484 active+clean, 136 unknown; 145 MiB data, 769 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 5.7 KiB/s wr, 2 op/s 2024-02-05T07:20:27.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4101555711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:27.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:27.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: from='client.35438 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:27.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2096518269' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi184-82412-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:27.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: from='client.35471 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi184-82412-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:27.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: from='client.35438 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:27.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: from='client.35471 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi184-82412-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:27.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: osdmap e92: 8 total, 8 up, 8 in 2024-02-05T07:20:27.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2096518269' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi184-82412-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:27.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:27.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: from='client.35471 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi184-82412-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:27.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3100157160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:27.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:27.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: from='client.35459 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:27.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:27.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:27.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: pgmap v95: 624 pgs: 4 creating+peering, 484 active+clean, 136 unknown; 145 MiB data, 769 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 5.7 KiB/s wr, 2 op/s 2024-02-05T07:20:27.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4101555711' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:27.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:27.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: from='client.35438 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:27.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2096518269' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi184-82412-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:27.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: from='client.35471 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi184-82412-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:27.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: from='client.35438 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:27.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: from='client.35471 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi184-82412-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:27.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: osdmap e92: 8 total, 8 up, 8 in 2024-02-05T07:20:27.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2096518269' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi184-82412-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:27.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:27.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: from='client.35471 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi184-82412-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:27.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3100157160' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:27.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:27.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: from='client.35459 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:27.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:27.024 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:26 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:27.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:20:27 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:20:27.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: Running main() from gmock_main.cc 2024-02-05T07:20:27.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-02-05T07:20:27.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-02-05T07:20:27.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-02-05T07:20:27.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-02-05T07:20:27.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: watch_notify_test_cb 2024-02-05T07:20:27.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (361 ms) 2024-02-05T07:20:27.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-02-05T07:20:27.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94074125691520 err -107 2024-02-05T07:20:27.805 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-02-05T07:20:27.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (8 ms) 2024-02-05T07:20:27.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-02-05T07:20:27.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-02-05T07:20:27.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94074125693952 err -107 2024-02-05T07:20:27.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (1009 ms) 2024-02-05T07:20:27.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-02-05T07:20:27.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: watch_notify2_test_cb from 24763 notify_id 330712481793 cookie 94074125737376 2024-02-05T07:20:27.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (4 ms) 2024-02-05T07:20:27.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-02-05T07:20:27.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: watch_notify2_test_cb from 24763 notify_id 330712481792 cookie 94074125902448 2024-02-05T07:20:27.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (5 ms) 2024-02-05T07:20:27.806 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-02-05T07:20:27.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: watch_notify2_test_cb from 24763 notify_id 330712481793 cookie 94074125902448 2024-02-05T07:20:27.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (4 ms) 2024-02-05T07:20:27.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-02-05T07:20:27.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: watch_notify2_test_cb from 24763 notify_id 330712481792 cookie 94074125902448 2024-02-05T07:20:27.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: watch_notify2_test_cb from 24763 notify_id 330712481792 cookie 94074125922656 2024-02-05T07:20:27.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (5 ms) 2024-02-05T07:20:27.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-02-05T07:20:27.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: watch_notify2_test_cb from 24763 notify_id 330712481794 cookie 94074125902448 2024-02-05T07:20:27.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: watch_notify2_test_cb from 24763 notify_id 335007449091 cookie 94074125902448 2024-02-05T07:20:27.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3004 ms) 2024-02-05T07:20:27.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-02-05T07:20:27.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-02-05T07:20:27.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94074125923856 err -107 2024-02-05T07:20:27.807 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: watch_notify2_test_cb from 24763 notify_id 356482285570 cookie 94074125923856 2024-02-05T07:20:27.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5007 ms) 2024-02-05T07:20:27.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-02-05T07:20:27.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-02-05T07:20:27.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94074125919856 err -107 2024-02-05T07:20:27.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1005 ms) 2024-02-05T07:20:27.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (10412 ms total) 2024-02-05T07:20:27.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: 2024-02-05T07:20:27.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-02-05T07:20:27.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-02-05T07:20:27.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: watch_notify_test_cb 2024-02-05T07:20:27.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1098 ms) 2024-02-05T07:20:27.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1098 ms total) 2024-02-05T07:20:27.808 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: 2024-02-05T07:20:27.809 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-02-05T07:20:27.809 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (28969 ms total) 2024-02-05T07:20:27.809 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-02-05T07:20:28.044 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:28.044 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:27 smithi188 ceph-mon[33283]: pgmap v98: 648 pgs: 4 creating+peering, 484 active+clean, 160 unknown; 145 MiB data, 769 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:28.044 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:27 smithi188 ceph-mon[33283]: from='client.35369 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]': finished 2024-02-05T07:20:28.044 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:27 smithi188 ceph-mon[33283]: from='client.35459 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:28.044 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:27 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:28.044 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:28.044 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:27 smithi188 ceph-mon[33283]: osdmap e93: 8 total, 8 up, 8 in 2024-02-05T07:20:28.044 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/863344591' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi184-81207-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:28.044 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:27 smithi188 ceph-mon[33283]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:28.045 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:28.045 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:27 smithi188 ceph-mon[33283]: from='client.35483 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi184-81207-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:28.045 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:27 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:28.084 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2024-02-05T07:20:28.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-02-05T07:20:28.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-02-05T07:20:28.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-02-05T07:20:28.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-02-05T07:20:28.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: notify 2024-02-05T07:20:28.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (2221 ms) 2024-02-05T07:20:28.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-02-05T07:20:28.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (3 ms) 2024-02-05T07:20:28.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (2224 ms total) 2024-02-05T07:20:28.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: 2024-02-05T07:20:28.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-02-05T07:20:28.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-02-05T07:20:28.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: notify 2024-02-05T07:20:28.086 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (77 ms) 2024-02-05T07:20:28.086 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-02-05T07:20:28.086 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: notify 2024-02-05T07:20:28.086 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (4026 ms) 2024-02-05T07:20:28.086 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-02-05T07:20:28.086 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (4 ms) 2024-02-05T07:20:28.086 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-02-05T07:20:28.086 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (4 ms) 2024-02-05T07:20:28.086 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-02-05T07:20:28.086 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: handle_notify cookie 94230824447488 notify_id 390842023937 notifier_gid 35363 2024-02-05T07:20:28.086 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (4 ms) 2024-02-05T07:20:28.086 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-02-05T07:20:28.086 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: handle_notify cookie 94230824451920 notify_id 390842023936 notifier_gid 35363 2024-02-05T07:20:28.086 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (5 ms) 2024-02-05T07:20:28.087 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-02-05T07:20:28.087 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: handle_notify cookie 94230824451872 notify_id 390842023937 notifier_gid 35363 2024-02-05T07:20:28.087 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (6 ms) 2024-02-05T07:20:28.087 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-02-05T07:20:28.087 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: handle_notify cookie 94230824451872 notify_id 390842023938 notifier_gid 35363 2024-02-05T07:20:28.087 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (4 ms) 2024-02-05T07:20:28.087 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-02-05T07:20:28.087 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: handle_notify cookie 94230824471440 notify_id 390842023940 notifier_gid 35363 2024-02-05T07:20:28.087 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (5 ms) 2024-02-05T07:20:28.087 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-02-05T07:20:28.087 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: handle_notify cookie 94230824472704 notify_id 390842023938 notifier_gid 35363 2024-02-05T07:20:28.087 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (5 ms) 2024-02-05T07:20:28.087 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-02-05T07:20:28.088 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: trying... 2024-02-05T07:20:28.088 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: handle_notify cookie 94230824472704 notify_id 390842023939 notifier_gid 35363 2024-02-05T07:20:28.088 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: timed out 2024-02-05T07:20:28.088 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: flushing 2024-02-05T07:20:28.170 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch api_service: 2024-02-05T07:20:28.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2024-02-05T07:20:28.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: [ OK ] LibRadosService.StatusFormat (4170 ms) 2024-02-05T07:20:28.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: [ RUN ] LibRadosService.Status 2024-02-05T07:20:28.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: [ OK ] LibRadosService.Status (20030 ms) 2024-02-05T07:20:28.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: [----------] 4 tests from LibRadosService (29301 ms total) 2024-02-05T07:20:28.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: 2024-02-05T07:20:28.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: [----------] Global test environment tear-down 2024-02-05T07:20:28.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: [==========] 4 tests from 1 test suite ran. (29301 ms total) 2024-02-05T07:20:28.171 INFO:tasks.workunit.client.0.smithi184.stdout: api_service: [ PASSED ] 4 tests. 2024-02-05T07:20:28.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[29861]: pgmap v98: 648 pgs: 4 creating+peering, 484 active+clean, 160 unknown; 145 MiB data, 769 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[29861]: from='client.35369 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]': finished 2024-02-05T07:20:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[29861]: from='client.35459 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[29861]: osdmap e93: 8 total, 8 up, 8 in 2024-02-05T07:20:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/863344591' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi184-81207-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[29861]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[29861]: from='client.35483 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi184-81207-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[41609]: pgmap v98: 648 pgs: 4 creating+peering, 484 active+clean, 160 unknown; 145 MiB data, 769 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[41609]: from='client.35369 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi184-81802-12"}]': finished 2024-02-05T07:20:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[41609]: from='client.35459 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/482204784' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[41609]: osdmap e93: 8 total, 8 up, 8 in 2024-02-05T07:20:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/863344591' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi184-81207-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[41609]: from='client.35369 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi184-81802-12"}]: dispatch 2024-02-05T07:20:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[41609]: from='client.35483 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi184-81207-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:27 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:28.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:28 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:28.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:28 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:20:28.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:28 smithi188 ceph-mon[33283]: from='client.35471 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi184-82412-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi184-82412-3"}]': finished 2024-02-05T07:20:28.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:28 smithi188 ceph-mon[33283]: from='client.35369 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi184-81802-12"}]': finished 2024-02-05T07:20:28.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:28 smithi188 ceph-mon[33283]: from='client.35483 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi184-81207-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:28.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:28 smithi188 ceph-mon[33283]: osdmap e94: 8 total, 8 up, 8 in 2024-02-05T07:20:28.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1536736321' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:28.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:29.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:28 smithi188 ceph-mon[33283]: from='client.35495 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:29.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:28 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:29.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:29.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:28 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:29.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:28 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:29.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:20:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[29861]: from='client.35471 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi184-82412-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi184-82412-3"}]': finished 2024-02-05T07:20:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[29861]: from='client.35369 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi184-81802-12"}]': finished 2024-02-05T07:20:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[29861]: from='client.35483 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi184-81207-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[29861]: osdmap e94: 8 total, 8 up, 8 in 2024-02-05T07:20:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1536736321' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[29861]: from='client.35495 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:29.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:29.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:20:29.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[41609]: from='client.35471 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi184-82412-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi184-82412-3"}]': finished 2024-02-05T07:20:29.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[41609]: from='client.35369 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi184-81802-12"}]': finished 2024-02-05T07:20:29.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[41609]: from='client.35483 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi184-81207-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:29.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[41609]: osdmap e94: 8 total, 8 up, 8 in 2024-02-05T07:20:29.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1536736321' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:29.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:29.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[41609]: from='client.35495 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:29.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:29.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:29.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:29.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:28 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:30.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: pgmap v101: 720 pgs: 96 creating+peering, 520 active+clean, 104 unknown; 145 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-02-05T07:20:30.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.35495 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:30.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:30.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: osdmap e95: 8 total, 8 up, 8 in 2024-02-05T07:20:30.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3202177108' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:30.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/932491038' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi184-81609-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:30.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.25513 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:30.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.25516 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi184-81609-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:30.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:30.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:30.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:30.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.25513 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:30.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.25516 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi184-81609-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:30.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:20:30.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: osdmap e96: 8 total, 8 up, 8 in 2024-02-05T07:20:30.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-7"}]: dispatch 2024-02-05T07:20:30.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2096518269' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:30.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-7"}]: dispatch 2024-02-05T07:20:30.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2618270429' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi184-81207-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:30.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:29 smithi188 ceph-mon[33283]: from='client.35471 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: pgmap v101: 720 pgs: 96 creating+peering, 520 active+clean, 104 unknown; 145 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-02-05T07:20:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.35495 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: osdmap e95: 8 total, 8 up, 8 in 2024-02-05T07:20:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3202177108' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/932491038' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi184-81609-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.25513 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:30.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.25516 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi184-81609-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:30.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:30.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:30.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:30.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.25513 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:30.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.25516 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi184-81609-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:30.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:20:30.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: osdmap e96: 8 total, 8 up, 8 in 2024-02-05T07:20:30.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-7"}]: dispatch 2024-02-05T07:20:30.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2096518269' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:30.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-7"}]: dispatch 2024-02-05T07:20:30.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2618270429' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi184-81207-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:30.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[29861]: from='client.35471 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:30.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: pgmap v101: 720 pgs: 96 creating+peering, 520 active+clean, 104 unknown; 145 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-02-05T07:20:30.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.35495 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:30.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:30.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: osdmap e95: 8 total, 8 up, 8 in 2024-02-05T07:20:30.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3202177108' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:30.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/932491038' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi184-81609-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:30.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.25513 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:30.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.25516 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi184-81609-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:30.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:30.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:30.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:30.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.25513 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:30.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.25516 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi184-81609-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:30.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:20:30.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: osdmap e96: 8 total, 8 up, 8 in 2024-02-05T07:20:30.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-7"}]: dispatch 2024-02-05T07:20:30.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2096518269' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:30.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-7"}]: dispatch 2024-02-05T07:20:30.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2618270429' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi184-81207-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:30.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:29 smithi184 ceph-mon[41609]: from='client.35471 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:30.363 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-02-05T07:20:30.363 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: [----------] Global test environment set-up. 2024-02-05T07:20:30.363 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-02-05T07:20:30.363 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-02-05T07:20:30.364 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5058 ms) 2024-02-05T07:20:30.364 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-02-05T07:20:30.364 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (37 ms) 2024-02-05T07:20:30.364 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-02-05T07:20:30.364 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (21027 ms) 2024-02-05T07:20:30.364 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-02-05T07:20:30.364 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: attempt 0 of 20 2024-02-05T07:20:30.364 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (5371 ms) 2024-02-05T07:20:30.364 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (31493 ms total) 2024-02-05T07:20:30.364 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: 2024-02-05T07:20:30.364 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: [----------] Global test environment tear-down 2024-02-05T07:20:30.364 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (31493 ms total) 2024-02-05T07:20:30.364 INFO:tasks.workunit.client.0.smithi184.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-02-05T07:20:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/369605301' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-05T07:20:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-05T07:20:31.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-05T07:20:31.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-7"}]': finished 2024-02-05T07:20:31.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2618270429' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi184-81207-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:31.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='client.35471 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi184-82412-3"}]': finished 2024-02-05T07:20:31.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: osdmap e97: 8 total, 8 up, 8 in 2024-02-05T07:20:31.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2971556458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:31.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2096518269' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:31.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='client.25540 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:31.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:31.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='client.35471 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:31.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:20:31.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:20:31.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:31.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:31.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:31.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:31.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:31.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:31.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/369605301' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-05T07:20:31.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-05T07:20:31.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-05T07:20:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-7"}]': finished 2024-02-05T07:20:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2618270429' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi184-81207-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='client.35471 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi184-82412-3"}]': finished 2024-02-05T07:20:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: osdmap e97: 8 total, 8 up, 8 in 2024-02-05T07:20:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2971556458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2096518269' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='client.25540 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='client.35471 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:20:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:20:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:31.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:31.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:31.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:31.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/369605301' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-05T07:20:31.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-05T07:20:31.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-05T07:20:31.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-7"}]': finished 2024-02-05T07:20:31.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2618270429' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi184-81207-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:31.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='client.35471 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi184-82412-3"}]': finished 2024-02-05T07:20:31.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: osdmap e97: 8 total, 8 up, 8 in 2024-02-05T07:20:31.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2971556458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:31.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2096518269' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:31.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='client.25540 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:31.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:31.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='client.35471 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi184-82412-3"}]: dispatch 2024-02-05T07:20:31.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:20:31.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:20:31.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:31.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:31.775 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:31.806 INFO:tasks.workunit.client.0.smithi184.stdout: ec_list: Running main() from gmock_main.cc 2024-02-05T07:20:31.806 INFO:tasks.workunit.client.0.smithi184.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2024-02-05T07:20:31.806 INFO:tasks.workunit.client.0.smithi184.stdout: ec_list: [----------] Global test environment set-up. 2024-02-05T07:20:31.807 INFO:tasks.workunit.client.0.smithi184.stdout: ec_list: [----------] 3 tests from NeoradosECList 2024-02-05T07:20:31.807 INFO:tasks.workunit.client.0.smithi184.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2024-02-05T07:20:31.807 INFO:tasks.workunit.client.0.smithi184.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (17073 ms) 2024-02-05T07:20:31.807 INFO:tasks.workunit.client.0.smithi184.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2024-02-05T07:20:31.807 INFO:tasks.workunit.client.0.smithi184.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (8656 ms) 2024-02-05T07:20:31.807 INFO:tasks.workunit.client.0.smithi184.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2024-02-05T07:20:31.807 INFO:tasks.workunit.client.0.smithi184.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (7036 ms) 2024-02-05T07:20:31.807 INFO:tasks.workunit.client.0.smithi184.stdout: ec_list: [----------] 3 tests from NeoradosECList (32765 ms total) 2024-02-05T07:20:31.807 INFO:tasks.workunit.client.0.smithi184.stdout: ec_list: 2024-02-05T07:20:31.807 INFO:tasks.workunit.client.0.smithi184.stdout: ec_list: [----------] Global test environment tear-down 2024-02-05T07:20:31.807 INFO:tasks.workunit.client.0.smithi184.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (32766 ms total) 2024-02-05T07:20:31.808 INFO:tasks.workunit.client.0.smithi184.stdout: ec_list: [ PASSED ] 3 tests. 2024-02-05T07:20:32.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:20:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:20:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:20:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:32 smithi188 ceph-mon[33283]: pgmap v104: 712 pgs: 520 active+clean, 192 unknown; 145 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-02-05T07:20:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:32 smithi188 ceph-mon[33283]: pgmap v106: 712 pgs: 488 active+clean, 224 unknown; 145 MiB data, 784 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:32 smithi188 ceph-mon[33283]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-05T07:20:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:32 smithi188 ceph-mon[33283]: Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:32 smithi188 ceph-mon[33283]: from='client.25540 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:32 smithi188 ceph-mon[33283]: from='client.35471 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi184-82412-3"}]': finished 2024-02-05T07:20:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:32 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:20:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:32 smithi188 ceph-mon[33283]: osdmap e98: 8 total, 8 up, 8 in 2024-02-05T07:20:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7"}]: dispatch 2024-02-05T07:20:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:32 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7"}]: dispatch 2024-02-05T07:20:32.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[29861]: pgmap v104: 712 pgs: 520 active+clean, 192 unknown; 145 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-02-05T07:20:32.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[29861]: pgmap v106: 712 pgs: 488 active+clean, 224 unknown; 145 MiB data, 784 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:32.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[29861]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-05T07:20:32.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[29861]: Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:32.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[29861]: from='client.25540 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:32.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[29861]: from='client.35471 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi184-82412-3"}]': finished 2024-02-05T07:20:32.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:20:32.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[29861]: osdmap e98: 8 total, 8 up, 8 in 2024-02-05T07:20:32.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7"}]: dispatch 2024-02-05T07:20:32.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7"}]: dispatch 2024-02-05T07:20:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[41609]: pgmap v104: 712 pgs: 520 active+clean, 192 unknown; 145 MiB data, 784 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-02-05T07:20:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[41609]: pgmap v106: 712 pgs: 488 active+clean, 224 unknown; 145 MiB data, 784 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[41609]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-05T07:20:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[41609]: Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[41609]: from='client.25540 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81893-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:32.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[41609]: from='client.35471 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi184-82412-3"}]': finished 2024-02-05T07:20:32.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:20:32.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[41609]: osdmap e98: 8 total, 8 up, 8 in 2024-02-05T07:20:32.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7"}]: dispatch 2024-02-05T07:20:32.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:32 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7"}]: dispatch 2024-02-05T07:20:32.844 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: Running main() from gmock_main.cc 2024-02-05T07:20:32.844 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [==========] Running 7 tests from 1 test suite. 2024-02-05T07:20:32.844 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [----------] Global test environment set-up. 2024-02-05T07:20:32.844 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps 2024-02-05T07:20:32.844 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2024-02-05T07:20:32.844 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (10826 ms) 2024-02-05T07:20:32.844 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2024-02-05T07:20:32.844 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (5186 ms) 2024-02-05T07:20:32.844 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2024-02-05T07:20:32.844 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (5036 ms) 2024-02-05T07:20:32.845 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2024-02-05T07:20:32.845 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (2801 ms) 2024-02-05T07:20:32.845 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2024-02-05T07:20:32.845 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (2827 ms) 2024-02-05T07:20:32.845 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2024-02-05T07:20:32.845 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (3028 ms) 2024-02-05T07:20:32.845 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2024-02-05T07:20:32.845 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (4026 ms) 2024-02-05T07:20:32.845 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps (33731 ms total) 2024-02-05T07:20:32.845 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: 2024-02-05T07:20:32.845 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [----------] Global test environment tear-down 2024-02-05T07:20:32.845 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [==========] 7 tests from 1 test suite ran. (33731 ms total) 2024-02-05T07:20:32.845 INFO:tasks.workunit.client.0.smithi184.stdout: write_operations: [ PASSED ] 7 tests. 2024-02-05T07:20:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:33 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7"}]': finished 2024-02-05T07:20:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3041472089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:33 smithi188 ceph-mon[33283]: osdmap e99: 8 total, 8 up, 8 in 2024-02-05T07:20:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/569323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi184-81207-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:33 smithi188 ceph-mon[33283]: from='client.35546 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:33 smithi188 ceph-mon[33283]: from='client.25558 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi184-81207-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:33.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:33.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7"}]': finished 2024-02-05T07:20:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3041472089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[29861]: osdmap e99: 8 total, 8 up, 8 in 2024-02-05T07:20:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/569323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi184-81207-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[29861]: from='client.35546 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[29861]: from='client.25558 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi184-81207-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:33.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:33.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-7"}]': finished 2024-02-05T07:20:33.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3041472089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:33.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[41609]: osdmap e99: 8 total, 8 up, 8 in 2024-02-05T07:20:33.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/569323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi184-81207-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:33.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[41609]: from='client.35546 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:33.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[41609]: from='client.25558 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi184-81207-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:33.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:33.827 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-02-05T07:20:33.827 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-02-05T07:20:33.827 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-02-05T07:20:33.827 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-02-05T07:20:33.827 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-02-05T07:20:33.827 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-02-05T07:20:33.828 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-02-05T07:20:33.828 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: 2024-02-05T07:20:33.828 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-02-05T07:20:33.828 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-02-05T07:20:33.828 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (12923 ms) 2024-02-05T07:20:33.828 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-02-05T07:20:33.828 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (6031 ms) 2024-02-05T07:20:33.828 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-02-05T07:20:33.828 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (3114 ms) 2024-02-05T07:20:33.828 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-02-05T07:20:33.828 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (3021 ms) 2024-02-05T07:20:33.828 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-02-05T07:20:33.828 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (3068 ms) 2024-02-05T07:20:33.828 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-02-05T07:20:33.829 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (2767 ms) 2024-02-05T07:20:33.829 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-02-05T07:20:33.829 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (4022 ms) 2024-02-05T07:20:33.829 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (34947 ms total) 2024-02-05T07:20:33.829 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: 2024-02-05T07:20:33.829 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-02-05T07:20:33.829 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (34947 ms total) 2024-02-05T07:20:33.829 INFO:tasks.workunit.client.0.smithi184.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-02-05T07:20:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:34 smithi188 ceph-mon[33283]: pgmap v109: 648 pgs: 552 active+clean, 96 unknown; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-02-05T07:20:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:34 smithi188 ceph-mon[33283]: from='client.35546 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:34 smithi188 ceph-mon[33283]: from='client.25558 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi184-81207-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:34 smithi188 ceph-mon[33283]: osdmap e100: 8 total, 8 up, 8 in 2024-02-05T07:20:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1572736225' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:34 smithi188 ceph-mon[33283]: from='client.35558 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:34.785 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:34 smithi184 ceph-mon[41609]: pgmap v109: 648 pgs: 552 active+clean, 96 unknown; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-02-05T07:20:34.785 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:34 smithi184 ceph-mon[41609]: from='client.35546 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:34.785 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:34 smithi184 ceph-mon[41609]: from='client.25558 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi184-81207-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:34.785 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:34 smithi184 ceph-mon[41609]: osdmap e100: 8 total, 8 up, 8 in 2024-02-05T07:20:34.785 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1572736225' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:34.785 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:34 smithi184 ceph-mon[41609]: from='client.35558 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:34.785 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:34.786 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:34 smithi184 ceph-mon[29861]: pgmap v109: 648 pgs: 552 active+clean, 96 unknown; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 3.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-02-05T07:20:34.786 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:34 smithi184 ceph-mon[29861]: from='client.35546 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:34.786 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:34 smithi184 ceph-mon[29861]: from='client.25558 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi184-81207-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:34.786 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:34 smithi184 ceph-mon[29861]: osdmap e100: 8 total, 8 up, 8 in 2024-02-05T07:20:34.786 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1572736225' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:34.786 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:34 smithi184 ceph-mon[29861]: from='client.35558 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:34.786 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:35 smithi188 ceph-mon[33283]: from='client.35558 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:35 smithi188 ceph-mon[33283]: osdmap e101: 8 total, 8 up, 8 in 2024-02-05T07:20:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:35 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:35 smithi188 ceph-mon[33283]: pgmap v112: 584 pgs: 488 active+clean, 96 unknown; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-05T07:20:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:36.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:35 smithi184 ceph-mon[29861]: from='client.35558 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:36.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:35 smithi184 ceph-mon[29861]: osdmap e101: 8 total, 8 up, 8 in 2024-02-05T07:20:36.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:36.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:35 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:35 smithi184 ceph-mon[29861]: pgmap v112: 584 pgs: 488 active+clean, 96 unknown; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-05T07:20:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:35 smithi184 ceph-mon[41609]: from='client.35558 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:35 smithi184 ceph-mon[41609]: osdmap e101: 8 total, 8 up, 8 in 2024-02-05T07:20:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:35 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:35 smithi184 ceph-mon[41609]: pgmap v112: 584 pgs: 488 active+clean, 96 unknown; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-05T07:20:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:36 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:36 smithi188 ceph-mon[33283]: osdmap e102: 8 total, 8 up, 8 in 2024-02-05T07:20:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1327868405' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi184-81207-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2555848355' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:36 smithi188 ceph-mon[33283]: from='client.35576 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:36 smithi188 ceph-mon[33283]: from='client.25579 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi184-81207-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:36 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:37.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:37.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[41609]: osdmap e102: 8 total, 8 up, 8 in 2024-02-05T07:20:37.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1327868405' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi184-81207-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:37.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2555848355' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:37.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[41609]: from='client.35576 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:37.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[41609]: from='client.25579 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi184-81207-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:37.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:37.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:37.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[29861]: osdmap e102: 8 total, 8 up, 8 in 2024-02-05T07:20:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1327868405' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi184-81207-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2555848355' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[29861]: from='client.35576 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[29861]: from='client.25579 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi184-81207-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:37.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:20:37 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:20:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[29861]: from='client.35576 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[29861]: from='client.25579 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi184-81207-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:20:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[29861]: osdmap e103: 8 total, 8 up, 8 in 2024-02-05T07:20:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-9"}]: dispatch 2024-02-05T07:20:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-9"}]: dispatch 2024-02-05T07:20:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[29861]: pgmap v115: 680 pgs: 488 active+clean, 192 unknown; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4"}]: dispatch 2024-02-05T07:20:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4"}]: dispatch 2024-02-05T07:20:38.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:38.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-9"}]': finished 2024-02-05T07:20:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[41609]: from='client.35576 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[41609]: from='client.25579 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi184-81207-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:20:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[41609]: osdmap e103: 8 total, 8 up, 8 in 2024-02-05T07:20:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-9"}]: dispatch 2024-02-05T07:20:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-9"}]: dispatch 2024-02-05T07:20:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[41609]: pgmap v115: 680 pgs: 488 active+clean, 192 unknown; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4"}]: dispatch 2024-02-05T07:20:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4"}]: dispatch 2024-02-05T07:20:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:38.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:37 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-9"}]': finished 2024-02-05T07:20:38.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:37 smithi188 ceph-mon[33283]: from='client.35576 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi184-81228-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:38.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:37 smithi188 ceph-mon[33283]: from='client.25579 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi184-81207-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:38.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:37 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:20:38.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:37 smithi188 ceph-mon[33283]: osdmap e103: 8 total, 8 up, 8 in 2024-02-05T07:20:38.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-9"}]: dispatch 2024-02-05T07:20:38.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:37 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-9"}]: dispatch 2024-02-05T07:20:38.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:37 smithi188 ceph-mon[33283]: pgmap v115: 680 pgs: 488 active+clean, 192 unknown; 145 MiB data, 760 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:38.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4"}]: dispatch 2024-02-05T07:20:38.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:37 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4"}]: dispatch 2024-02-05T07:20:38.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:38.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:37 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-9"}]': finished 2024-02-05T07:20:39.185 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:39.185 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4"}]': finished 2024-02-05T07:20:39.185 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[29861]: osdmap e104: 8 total, 8 up, 8 in 2024-02-05T07:20:39.185 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-9", "mode": "writeback"}]: dispatch 2024-02-05T07:20:39.185 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-9", "mode": "writeback"}]: dispatch 2024-02-05T07:20:39.186 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6"}]: dispatch 2024-02-05T07:20:39.186 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6"}]: dispatch 2024-02-05T07:20:39.186 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:39.186 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-9", "mode": "writeback"}]': finished 2024-02-05T07:20:39.186 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6"}]': finished 2024-02-05T07:20:39.186 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[29861]: osdmap e105: 8 total, 8 up, 8 in 2024-02-05T07:20:39.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:39.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4"}]': finished 2024-02-05T07:20:39.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[41609]: osdmap e104: 8 total, 8 up, 8 in 2024-02-05T07:20:39.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-9", "mode": "writeback"}]: dispatch 2024-02-05T07:20:39.186 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-9", "mode": "writeback"}]: dispatch 2024-02-05T07:20:39.187 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6"}]: dispatch 2024-02-05T07:20:39.187 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6"}]: dispatch 2024-02-05T07:20:39.187 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:39.187 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-9", "mode": "writeback"}]': finished 2024-02-05T07:20:39.187 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6"}]': finished 2024-02-05T07:20:39.187 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:38 smithi184 ceph-mon[41609]: osdmap e105: 8 total, 8 up, 8 in 2024-02-05T07:20:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:38 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:38 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4"}]': finished 2024-02-05T07:20:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:38 smithi188 ceph-mon[33283]: osdmap e104: 8 total, 8 up, 8 in 2024-02-05T07:20:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-9", "mode": "writeback"}]: dispatch 2024-02-05T07:20:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:38 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-9", "mode": "writeback"}]: dispatch 2024-02-05T07:20:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6"}]: dispatch 2024-02-05T07:20:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:38 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6"}]: dispatch 2024-02-05T07:20:39.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:39.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:38 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-9", "mode": "writeback"}]': finished 2024-02-05T07:20:39.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:38 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi184-81742-4", "tierpool": "test-rados-api-smithi184-81742-6"}]': finished 2024-02-05T07:20:39.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:38 smithi188 ceph-mon[33283]: osdmap e105: 8 total, 8 up, 8 in 2024-02-05T07:20:40.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi184-81742-6", "pool2": "test-rados-api-smithi184-81742-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3751160246' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi184-81207-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/264958094' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi184-81228-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi184-81742-6", "pool2": "test-rados-api-smithi184-81742-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/85720033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.35588 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi184-81207-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.403 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.35597 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi184-81228-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.25609 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:40.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:40.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: pgmap v118: 616 pgs: 128 unknown, 488 active+clean; 145 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-05T07:20:40.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:40.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:40.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:40.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:40.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:40.404 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:40.404 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi184-81742-6", "pool2": "test-rados-api-smithi184-81742-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3751160246' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi184-81207-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/264958094' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi184-81228-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi184-81742-6", "pool2": "test-rados-api-smithi184-81742-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/85720033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.35588 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi184-81207-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.35597 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi184-81228-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.25609 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:40.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:40.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: pgmap v118: 616 pgs: 128 unknown, 488 active+clean; 145 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-05T07:20:40.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:40.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:40.405 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:40.406 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:40.406 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:40.406 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:40.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:40.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:40.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi184-81742-6", "pool2": "test-rados-api-smithi184-81742-6", "yes_i_really_really_mean_it": true}]': finished 2024-02-05T07:20:40.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.35588 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi184-81207-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:40.406 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[29861]: from='client.35597 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi184-81228-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:40.406 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:40.407 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:40.407 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi184-81742-6", "pool2": "test-rados-api-smithi184-81742-6", "yes_i_really_really_mean_it": true}]': finished 2024-02-05T07:20:40.407 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.35588 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi184-81207-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:40.407 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:40 smithi184 ceph-mon[41609]: from='client.35597 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi184-81228-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:40.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3799709820' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi184-81742-6", "pool2": "test-rados-api-smithi184-81742-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3751160246' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi184-81207-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/264958094' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi184-81228-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi184-81742-6", "pool2": "test-rados-api-smithi184-81742-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/85720033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.35588 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi184-81207-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.35597 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi184-81228-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.25609 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:40.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:40.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:40.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: pgmap v118: 616 pgs: 128 unknown, 488 active+clean; 145 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-05T07:20:40.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:40.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:40.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:40.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:40.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:40.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:40.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:40.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:40.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.35363 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi184-81742-6", "pool2": "test-rados-api-smithi184-81742-6", "yes_i_really_really_mean_it": true}]': finished 2024-02-05T07:20:40.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.35588 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi184-81207-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:40.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:40 smithi188 ceph-mon[33283]: from='client.35597 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi184-81228-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:40.820 INFO:tasks.workunit.client.0.smithi184.stdout:_notify_pp: flushed 2024-02-05T07:20:40.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3003 ms) 2024-02-05T07:20:40.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-02-05T07:20:40.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: trying... 2024-02-05T07:20:40.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: handle_notify cookie 94230824472704 notify_id 403726925828 notifier_gid 35363 2024-02-05T07:20:40.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: timed out 2024-02-05T07:20:40.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: flushing 2024-02-05T07:20:40.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: flushed 2024-02-05T07:20:40.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3004 ms) 2024-02-05T07:20:40.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-02-05T07:20:40.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: List watches 2024-02-05T07:20:40.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: notify2 2024-02-05T07:20:40.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: handle_notify cookie 94230824472704 notify_id 416611827717 notifier_gid 35363 2024-02-05T07:20:40.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: notify2 done 2024-02-05T07:20:40.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: watch_check 2024-02-05T07:20:40.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: unwatch2 2024-02-05T07:20:40.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: flushing 2024-02-05T07:20:40.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: done 2024-02-05T07:20:40.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3007 ms) 2024-02-05T07:20:40.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-02-05T07:20:40.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: List watches 2024-02-05T07:20:40.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: notify2 2024-02-05T07:20:40.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: handle_notify cookie 94230824472624 notify_id 429496729603 notifier_gid 35363 2024-02-05T07:20:40.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: notify2 done 2024-02-05T07:20:40.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: watch_check 2024-02-05T07:20:40.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: unwatch2 2024-02-05T07:20:40.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: flushing 2024-02-05T07:20:40.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: done 2024-02-05T07:20:40.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3006 ms) 2024-02-05T07:20:40.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (16160 ms total) 2024-02-05T07:20:40.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: 2024-02-05T07:20:40.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-02-05T07:20:40.823 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (41995 ms total) 2024-02-05T07:20:40.823 INFO:tasks.workunit.client.0.smithi184.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-02-05T07:20:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:41 smithi188 ceph-mon[33283]: from='client.25609 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:41 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:20:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:41 smithi188 ceph-mon[33283]: from='client.35609 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:41 smithi188 ceph-mon[33283]: osdmap e106: 8 total, 8 up, 8 in 2024-02-05T07:20:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9"}]: dispatch 2024-02-05T07:20:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi184-81575-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:41 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9"}]: dispatch 2024-02-05T07:20:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:41 smithi188 ceph-mon[33283]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi184-81575-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:41.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:41.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:41 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:20:41.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:41 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9"}]': finished 2024-02-05T07:20:41.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:41 smithi188 ceph-mon[33283]: osdmap e107: 8 total, 8 up, 8 in 2024-02-05T07:20:41.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[41609]: from='client.25609 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:41.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:20:41.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[41609]: from='client.35609 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:41.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[41609]: osdmap e106: 8 total, 8 up, 8 in 2024-02-05T07:20:41.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9"}]: dispatch 2024-02-05T07:20:41.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi184-81575-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:41.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9"}]: dispatch 2024-02-05T07:20:41.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[41609]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi184-81575-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:41.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:41.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:20:41.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9"}]': finished 2024-02-05T07:20:41.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[41609]: osdmap e107: 8 total, 8 up, 8 in 2024-02-05T07:20:41.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[29861]: from='client.25609 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:41.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:20:41.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[29861]: from='client.35609 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:41.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[29861]: osdmap e106: 8 total, 8 up, 8 in 2024-02-05T07:20:41.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9"}]: dispatch 2024-02-05T07:20:41.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi184-81575-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:41.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9"}]: dispatch 2024-02-05T07:20:41.526 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[29861]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi184-81575-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:41.526 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:41.526 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:20:41.526 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-9"}]': finished 2024-02-05T07:20:41.526 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-mon[29861]: osdmap e107: 8 total, 8 up, 8 in 2024-02-05T07:20:42.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:20:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:20:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:20:42.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: pgmap v121: 548 pgs: 96 unknown, 452 active+clean; 145 MiB data, 742 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:42.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-02-05T07:20:42.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-02-05T07:20:42.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-02-05T07:20:42.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-02-05T07:20:42.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-02-05T07:20:42.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-02-05T07:20:42.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-02-05T07:20:42.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-02-05T07:20:42.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-02-05T07:20:42.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-02-05T07:20:42.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-02-05T07:20:42.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-02-05T07:20:42.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-02-05T07:20:42.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-02-05T07:20:42.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-02-05T07:20:42.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-02-05T07:20:42.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-02-05T07:20:42.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-02-05T07:20:42.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-02-05T07:20:42.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-02-05T07:20:42.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:42.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: 15.9 deep-scrub starts 2024-02-05T07:20:42.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: 15.9 deep-scrub ok 2024-02-05T07:20:42.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='client.35609 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi184-81575-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]': finished 2024-02-05T07:20:42.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: osdmap e108: 8 total, 8 up, 8 in 2024-02-05T07:20:42.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2459970256' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi184-81207-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:42.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:42 smithi188 ceph-mon[33283]: from='client.35621 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi184-81207-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:42.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: pgmap v121: 548 pgs: 96 unknown, 452 active+clean; 145 MiB data, 742 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:42.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-02-05T07:20:42.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-02-05T07:20:42.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-02-05T07:20:42.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-02-05T07:20:42.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-02-05T07:20:42.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-02-05T07:20:42.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-02-05T07:20:42.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-02-05T07:20:42.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-02-05T07:20:42.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-02-05T07:20:42.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-02-05T07:20:42.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-02-05T07:20:42.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-02-05T07:20:42.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-02-05T07:20:42.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-02-05T07:20:42.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-02-05T07:20:42.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-02-05T07:20:42.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-02-05T07:20:42.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-02-05T07:20:42.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-02-05T07:20:42.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:42.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: 15.9 deep-scrub starts 2024-02-05T07:20:42.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: 15.9 deep-scrub ok 2024-02-05T07:20:42.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='client.35609 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi184-81575-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]': finished 2024-02-05T07:20:42.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: osdmap e108: 8 total, 8 up, 8 in 2024-02-05T07:20:42.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2459970256' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi184-81207-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:42.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[29861]: from='client.35621 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi184-81207-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:42.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: pgmap v121: 548 pgs: 96 unknown, 452 active+clean; 145 MiB data, 742 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:42.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-02-05T07:20:42.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.0"}]: dispatch 2024-02-05T07:20:42.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-02-05T07:20:42.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.1"}]: dispatch 2024-02-05T07:20:42.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-02-05T07:20:42.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.2"}]: dispatch 2024-02-05T07:20:42.775 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-02-05T07:20:42.775 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.3"}]: dispatch 2024-02-05T07:20:42.775 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-02-05T07:20:42.775 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.4"}]: dispatch 2024-02-05T07:20:42.775 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-02-05T07:20:42.775 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.5"}]: dispatch 2024-02-05T07:20:42.775 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-02-05T07:20:42.775 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.6"}]: dispatch 2024-02-05T07:20:42.775 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-02-05T07:20:42.775 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.7"}]: dispatch 2024-02-05T07:20:42.775 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-02-05T07:20:42.775 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.8"}]: dispatch 2024-02-05T07:20:42.775 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-02-05T07:20:42.775 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.188:0/2693451593' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "15.9"}]: dispatch 2024-02-05T07:20:42.775 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:42.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: 15.9 deep-scrub starts 2024-02-05T07:20:42.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: 15.9 deep-scrub ok 2024-02-05T07:20:42.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='client.35609 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi184-81575-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]': finished 2024-02-05T07:20:42.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: osdmap e108: 8 total, 8 up, 8 in 2024-02-05T07:20:42.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2459970256' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi184-81207-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:42.776 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:42 smithi184 ceph-mon[41609]: from='client.35621 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi184-81207-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:43.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: 15.0 deep-scrub starts 2024-02-05T07:20:43.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: 15.0 deep-scrub ok 2024-02-05T07:20:43.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: 15.6 deep-scrub starts 2024-02-05T07:20:43.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: 15.6 deep-scrub ok 2024-02-05T07:20:43.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: 15.3 deep-scrub starts 2024-02-05T07:20:43.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: 15.3 deep-scrub ok 2024-02-05T07:20:43.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/152376550' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi184-81228-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:43.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: 15.7 deep-scrub starts 2024-02-05T07:20:43.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: 15.7 deep-scrub ok 2024-02-05T07:20:43.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:43.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:43.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:20:43.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: from='client.35621 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi184-81207-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:43.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/152376550' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi184-81228-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:43.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: osdmap e109: 8 total, 8 up, 8 in 2024-02-05T07:20:43.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:43.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:43 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:43.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: 15.0 deep-scrub starts 2024-02-05T07:20:43.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: 15.0 deep-scrub ok 2024-02-05T07:20:43.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: 15.6 deep-scrub starts 2024-02-05T07:20:43.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: 15.6 deep-scrub ok 2024-02-05T07:20:43.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: 15.3 deep-scrub starts 2024-02-05T07:20:43.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: 15.3 deep-scrub ok 2024-02-05T07:20:43.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/152376550' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi184-81228-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:43.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: 15.7 deep-scrub starts 2024-02-05T07:20:43.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: 15.7 deep-scrub ok 2024-02-05T07:20:43.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:43.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:43.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:20:43.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: from='client.35621 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi184-81207-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:43.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/152376550' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi184-81228-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:43.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: osdmap e109: 8 total, 8 up, 8 in 2024-02-05T07:20:43.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:43.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:43.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: 15.0 deep-scrub starts 2024-02-05T07:20:43.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: 15.0 deep-scrub ok 2024-02-05T07:20:43.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: 15.6 deep-scrub starts 2024-02-05T07:20:43.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: 15.6 deep-scrub ok 2024-02-05T07:20:43.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: 15.3 deep-scrub starts 2024-02-05T07:20:43.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: 15.3 deep-scrub ok 2024-02-05T07:20:43.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/152376550' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi184-81228-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:43.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: 15.7 deep-scrub starts 2024-02-05T07:20:43.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: 15.7 deep-scrub ok 2024-02-05T07:20:43.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:43.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:20:43.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:20:43.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: from='client.35621 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi184-81207-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:43.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/152376550' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi184-81228-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:43.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: osdmap e109: 8 total, 8 up, 8 in 2024-02-05T07:20:43.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:43.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:43 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:44.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:44 smithi188 ceph-mon[33283]: 15.2 deep-scrub starts 2024-02-05T07:20:44.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:44 smithi188 ceph-mon[33283]: 15.2 deep-scrub ok 2024-02-05T07:20:44.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:44 smithi188 ceph-mon[33283]: 15.1 deep-scrub starts 2024-02-05T07:20:44.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:44 smithi188 ceph-mon[33283]: 15.1 deep-scrub ok 2024-02-05T07:20:44.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:44 smithi188 ceph-mon[33283]: pgmap v124: 556 pgs: 72 creating+peering, 64 unknown, 420 active+clean; 217 MiB data, 999 MiB used, 714 GiB / 715 GiB avail; 18 MiB/s wr, 0 op/s 2024-02-05T07:20:44.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:44 smithi188 ceph-mon[33283]: 15.4 deep-scrub starts 2024-02-05T07:20:44.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:44 smithi188 ceph-mon[33283]: 15.4 deep-scrub ok 2024-02-05T07:20:44.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:44 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:44.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:44 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:44.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:44 smithi188 ceph-mon[33283]: osdmap e110: 8 total, 8 up, 8 in 2024-02-05T07:20:44.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:44 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1716296350' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:44.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:44 smithi188 ceph-mon[33283]: from='client.35636 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:44.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[29861]: 15.2 deep-scrub starts 2024-02-05T07:20:44.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[29861]: 15.2 deep-scrub ok 2024-02-05T07:20:44.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[29861]: 15.1 deep-scrub starts 2024-02-05T07:20:44.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[29861]: 15.1 deep-scrub ok 2024-02-05T07:20:44.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[29861]: pgmap v124: 556 pgs: 72 creating+peering, 64 unknown, 420 active+clean; 217 MiB data, 999 MiB used, 714 GiB / 715 GiB avail; 18 MiB/s wr, 0 op/s 2024-02-05T07:20:44.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[29861]: 15.4 deep-scrub starts 2024-02-05T07:20:44.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[29861]: 15.4 deep-scrub ok 2024-02-05T07:20:44.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:44.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:44.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[29861]: osdmap e110: 8 total, 8 up, 8 in 2024-02-05T07:20:44.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1716296350' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:44.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[29861]: from='client.35636 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:44.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[41609]: 15.2 deep-scrub starts 2024-02-05T07:20:44.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[41609]: 15.2 deep-scrub ok 2024-02-05T07:20:44.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[41609]: 15.1 deep-scrub starts 2024-02-05T07:20:44.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[41609]: 15.1 deep-scrub ok 2024-02-05T07:20:44.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[41609]: pgmap v124: 556 pgs: 72 creating+peering, 64 unknown, 420 active+clean; 217 MiB data, 999 MiB used, 714 GiB / 715 GiB avail; 18 MiB/s wr, 0 op/s 2024-02-05T07:20:44.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[41609]: 15.4 deep-scrub starts 2024-02-05T07:20:44.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[41609]: 15.4 deep-scrub ok 2024-02-05T07:20:44.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:44.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:44.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[41609]: osdmap e110: 8 total, 8 up, 8 in 2024-02-05T07:20:44.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1716296350' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:44.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:44 smithi184 ceph-mon[41609]: from='client.35636 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:45.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:45 smithi188 ceph-mon[33283]: 15.8 deep-scrub starts 2024-02-05T07:20:45.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:45 smithi188 ceph-mon[33283]: 15.8 deep-scrub ok 2024-02-05T07:20:45.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:45 smithi188 ceph-mon[33283]: 15.5 deep-scrub starts 2024-02-05T07:20:45.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:45 smithi188 ceph-mon[33283]: 15.5 deep-scrub ok 2024-02-05T07:20:45.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:45.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:45 smithi188 ceph-mon[33283]: Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:45.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:45 smithi188 ceph-mon[33283]: from='client.35636 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:45.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:45 smithi188 ceph-mon[33283]: osdmap e111: 8 total, 8 up, 8 in 2024-02-05T07:20:45.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1518854583' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi184-81228-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:45.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:45.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2388753033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi184-81207-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:45.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:45 smithi188 ceph-mon[33283]: from='client.25654 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi184-81228-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:45.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:45 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:45.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:45 smithi188 ceph-mon[33283]: pgmap v127: 588 pgs: 8 creating+peering, 160 unknown, 420 active+clean; 217 MiB data, 999 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 6 op/s 2024-02-05T07:20:45.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:45.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[29861]: 15.8 deep-scrub starts 2024-02-05T07:20:45.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[29861]: 15.8 deep-scrub ok 2024-02-05T07:20:45.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[29861]: 15.5 deep-scrub starts 2024-02-05T07:20:45.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[29861]: 15.5 deep-scrub ok 2024-02-05T07:20:45.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:45.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[29861]: Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:45.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[29861]: from='client.35636 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:45.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[29861]: osdmap e111: 8 total, 8 up, 8 in 2024-02-05T07:20:45.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1518854583' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi184-81228-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:45.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:45.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2388753033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi184-81207-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:45.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[29861]: from='client.25654 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi184-81228-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:45.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:45.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[29861]: pgmap v127: 588 pgs: 8 creating+peering, 160 unknown, 420 active+clean; 217 MiB data, 999 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 6 op/s 2024-02-05T07:20:45.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:45.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[41609]: 15.8 deep-scrub starts 2024-02-05T07:20:45.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[41609]: 15.8 deep-scrub ok 2024-02-05T07:20:45.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[41609]: 15.5 deep-scrub starts 2024-02-05T07:20:45.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[41609]: 15.5 deep-scrub ok 2024-02-05T07:20:45.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:45.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[41609]: Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:45.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[41609]: from='client.35636 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81543-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:45.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[41609]: osdmap e111: 8 total, 8 up, 8 in 2024-02-05T07:20:45.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1518854583' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi184-81228-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:45.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:45.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2388753033' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi184-81207-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:45.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[41609]: from='client.25654 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi184-81228-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:45.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:45.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[41609]: pgmap v127: 588 pgs: 8 creating+peering, 160 unknown, 420 active+clean; 217 MiB data, 999 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 18 MiB/s wr, 6 op/s 2024-02-05T07:20:45.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:45.779 INFO:tasks.workunit.client.0.smithi184.stdout: misc: Running main() from gmock_main.cc 2024-02-05T07:20:45.779 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [==========] Running 12 tests from 1 test suite. 2024-02-05T07:20:45.779 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [----------] Global test environment set-up. 2024-02-05T07:20:45.779 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [----------] 12 tests from NeoRadosMisc 2024-02-05T07:20:45.779 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ RUN ] NeoRadosMisc.Version 2024-02-05T07:20:45.779 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ OK ] NeoRadosMisc.Version (9965 ms) 2024-02-05T07:20:45.779 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2024-02-05T07:20:45.780 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (3834 ms) 2024-02-05T07:20:45.780 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2024-02-05T07:20:45.780 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ OK ] NeoRadosMisc.LongName (6006 ms) 2024-02-05T07:20:45.780 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2024-02-05T07:20:45.780 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (3340 ms) 2024-02-05T07:20:45.780 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2024-02-05T07:20:45.780 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (3582 ms) 2024-02-05T07:20:45.780 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2024-02-05T07:20:45.780 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (3019 ms) 2024-02-05T07:20:45.780 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2024-02-05T07:20:45.780 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ OK ] NeoRadosMisc.Exec (3005 ms) 2024-02-05T07:20:45.780 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2024-02-05T07:20:45.780 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (2957 ms) 2024-02-05T07:20:45.781 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2024-02-05T07:20:45.781 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (3020 ms) 2024-02-05T07:20:45.781 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2024-02-05T07:20:45.781 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ OK ] NeoRadosMisc.BigObject (3293 ms) 2024-02-05T07:20:45.781 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2024-02-05T07:20:45.781 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (1786 ms) 2024-02-05T07:20:45.781 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2024-02-05T07:20:45.781 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (2906 ms) 2024-02-05T07:20:45.781 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [----------] 12 tests from NeoRadosMisc (46715 ms total) 2024-02-05T07:20:45.781 INFO:tasks.workunit.client.0.smithi184.stdout: misc: 2024-02-05T07:20:45.781 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [----------] Global test environment tear-down 2024-02-05T07:20:45.781 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [==========] 12 tests from 1 test suite ran. (46715 ms total) 2024-02-05T07:20:45.781 INFO:tasks.workunit.client.0.smithi184.stdout: misc: [ PASSED ] 12 tests. 2024-02-05T07:20:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2388753033' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi184-81207-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:46 smithi188 ceph-mon[33283]: from='client.25654 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi184-81228-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:46 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:20:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:46 smithi188 ceph-mon[33283]: osdmap e112: 8 total, 8 up, 8 in 2024-02-05T07:20:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-11"}]: dispatch 2024-02-05T07:20:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:46 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-11"}]: dispatch 2024-02-05T07:20:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1716296350' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache", "force_nonempty":""}]: dispatch 2024-02-05T07:20:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:46 smithi188 ceph-mon[33283]: from='client.35636 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache", "force_nonempty":""}]: dispatch 2024-02-05T07:20:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2388753033' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi184-81207-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[29861]: from='client.25654 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi184-81228-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:20:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[29861]: osdmap e112: 8 total, 8 up, 8 in 2024-02-05T07:20:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-11"}]: dispatch 2024-02-05T07:20:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-11"}]: dispatch 2024-02-05T07:20:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1716296350' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache", "force_nonempty":""}]: dispatch 2024-02-05T07:20:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[29861]: from='client.35636 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache", "force_nonempty":""}]: dispatch 2024-02-05T07:20:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2388753033' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi184-81207-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[41609]: from='client.25654 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi184-81228-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:20:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[41609]: osdmap e112: 8 total, 8 up, 8 in 2024-02-05T07:20:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-11"}]: dispatch 2024-02-05T07:20:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-11"}]: dispatch 2024-02-05T07:20:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1716296350' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache", "force_nonempty":""}]: dispatch 2024-02-05T07:20:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[41609]: from='client.35636 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache", "force_nonempty":""}]: dispatch 2024-02-05T07:20:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:47.800 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:20:48.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-11"}]': finished 2024-02-05T07:20:48.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: from='client.35636 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache", "force_nonempty":""}]': finished 2024-02-05T07:20:48.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: osdmap e113: 8 total, 8 up, 8 in 2024-02-05T07:20:48.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1716296350' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81543-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:48.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-11", "mode": "writeback"}]: dispatch 2024-02-05T07:20:48.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: from='client.35636 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81543-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:48.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-11", "mode": "writeback"}]: dispatch 2024-02-05T07:20:48.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: pgmap v130: 556 pgs: 8 creating+peering, 128 unknown, 420 active+clean; 217 MiB data, 999 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:48.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:48.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:20:48.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: from='client.35636 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81543-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:48.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-11", "mode": "writeback"}]': finished 2024-02-05T07:20:48.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: osdmap e114: 8 total, 8 up, 8 in 2024-02-05T07:20:48.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1716296350' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache"}]: dispatch 2024-02-05T07:20:48.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/280639265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi184-81207-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:48.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: from='client.35636 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache"}]: dispatch 2024-02-05T07:20:48.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3390752899' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi184-81228-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:48.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:47 smithi188 ceph-mon[33283]: from='client.35660 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi184-81207-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:48.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-11"}]': finished 2024-02-05T07:20:48.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: from='client.35636 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache", "force_nonempty":""}]': finished 2024-02-05T07:20:48.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: osdmap e113: 8 total, 8 up, 8 in 2024-02-05T07:20:48.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1716296350' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81543-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:48.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-11", "mode": "writeback"}]: dispatch 2024-02-05T07:20:48.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: from='client.35636 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81543-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:48.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-11", "mode": "writeback"}]: dispatch 2024-02-05T07:20:48.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: pgmap v130: 556 pgs: 8 creating+peering, 128 unknown, 420 active+clean; 217 MiB data, 999 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:48.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:48.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:20:48.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: from='client.35636 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81543-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:48.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-11", "mode": "writeback"}]': finished 2024-02-05T07:20:48.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: osdmap e114: 8 total, 8 up, 8 in 2024-02-05T07:20:48.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1716296350' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache"}]: dispatch 2024-02-05T07:20:48.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/280639265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi184-81207-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:48.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: from='client.35636 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache"}]: dispatch 2024-02-05T07:20:48.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3390752899' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi184-81228-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:48.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[29861]: from='client.35660 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi184-81207-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:48.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-11"}]': finished 2024-02-05T07:20:48.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: from='client.35636 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache", "force_nonempty":""}]': finished 2024-02-05T07:20:48.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: osdmap e113: 8 total, 8 up, 8 in 2024-02-05T07:20:48.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1716296350' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81543-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:48.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-11", "mode": "writeback"}]: dispatch 2024-02-05T07:20:48.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: from='client.35636 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81543-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:48.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-11", "mode": "writeback"}]: dispatch 2024-02-05T07:20:48.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: pgmap v130: 556 pgs: 8 creating+peering, 128 unknown, 420 active+clean; 217 MiB data, 999 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:48.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:48.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:20:48.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: from='client.35636 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81543-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:48.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-11", "mode": "writeback"}]': finished 2024-02-05T07:20:48.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: osdmap e114: 8 total, 8 up, 8 in 2024-02-05T07:20:48.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1716296350' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache"}]: dispatch 2024-02-05T07:20:48.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/280639265' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi184-81207-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:48.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: from='client.35636 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache"}]: dispatch 2024-02-05T07:20:48.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3390752899' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi184-81228-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:48.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:47 smithi184 ceph-mon[41609]: from='client.35660 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi184-81207-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:48 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:48 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:48 smithi188 ceph-mon[33283]: from='client.35636 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache"}]': finished 2024-02-05T07:20:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:48 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3390752899' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi184-81228-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:48 smithi188 ceph-mon[33283]: from='client.35660 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi184-81207-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:48 smithi188 ceph-mon[33283]: osdmap e115: 8 total, 8 up, 8 in 2024-02-05T07:20:49.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:48 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:49.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:48 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:49.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:48 smithi184 ceph-mon[29861]: from='client.35636 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache"}]': finished 2024-02-05T07:20:49.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:48 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3390752899' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi184-81228-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:49.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:48 smithi184 ceph-mon[29861]: from='client.35660 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi184-81207-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:49.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:48 smithi184 ceph-mon[29861]: osdmap e115: 8 total, 8 up, 8 in 2024-02-05T07:20:49.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:48 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:49.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:48 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:49.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:48 smithi184 ceph-mon[41609]: from='client.35636 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81543-10", "tierpool":"test-rados-api-smithi184-81543-10-cache"}]': finished 2024-02-05T07:20:49.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:48 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3390752899' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi184-81228-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:49.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:48 smithi184 ceph-mon[41609]: from='client.35660 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi184-81207-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:49.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:48 smithi184 ceph-mon[41609]: osdmap e115: 8 total, 8 up, 8 in 2024-02-05T07:20:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:49 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:49 smithi188 ceph-mon[33283]: pgmap v133: 620 pgs: 96 unknown, 524 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2024-02-05T07:20:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:49 smithi188 ceph-mon[33283]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:49 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:20:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:49 smithi188 ceph-mon[33283]: osdmap e116: 8 total, 8 up, 8 in 2024-02-05T07:20:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11"}]: dispatch 2024-02-05T07:20:50.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:49 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11"}]: dispatch 2024-02-05T07:20:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[29861]: pgmap v133: 620 pgs: 96 unknown, 524 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2024-02-05T07:20:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[29861]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:20:50.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[29861]: osdmap e116: 8 total, 8 up, 8 in 2024-02-05T07:20:50.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11"}]: dispatch 2024-02-05T07:20:50.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11"}]: dispatch 2024-02-05T07:20:50.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:50.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:20:50.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[41609]: pgmap v133: 620 pgs: 96 unknown, 524 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2024-02-05T07:20:50.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:50.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[41609]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:50.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:20:50.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[41609]: osdmap e116: 8 total, 8 up, 8 in 2024-02-05T07:20:50.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11"}]: dispatch 2024-02-05T07:20:50.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:49 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11"}]: dispatch 2024-02-05T07:20:50.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: Running main() from gmock_main.cc 2024-02-05T07:20:50.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-02-05T07:20:50.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [----------] Global test environment set-up. 2024-02-05T07:20:50.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-02-05T07:20:50.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-02-05T07:20:50.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ OK ] LibRadosPools.PoolList (11180 ms) 2024-02-05T07:20:50.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-02-05T07:20:50.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (5186 ms) 2024-02-05T07:20:50.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-02-05T07:20:50.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (5040 ms) 2024-02-05T07:20:50.796 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-02-05T07:20:50.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (3804 ms) 2024-02-05T07:20:50.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-02-05T07:20:50.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (3847 ms) 2024-02-05T07:20:50.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-02-05T07:20:50.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (5009 ms) 2024-02-05T07:20:50.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-02-05T07:20:50.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (4979 ms) 2024-02-05T07:20:50.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-02-05T07:20:50.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (5068 ms) 2024-02-05T07:20:50.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-02-05T07:20:50.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (7929 ms) 2024-02-05T07:20:50.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [----------] 9 tests from LibRadosPools (52042 ms total) 2024-02-05T07:20:50.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: 2024-02-05T07:20:50.797 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [----------] Global test environment tear-down 2024-02-05T07:20:50.798 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (52042 ms total) 2024-02-05T07:20:50.798 INFO:tasks.workunit.client.0.smithi184.stdout: api_pool: [ PASSED ] 9 tests. 2024-02-05T07:20:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:50 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:20:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:50 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11"}]': finished 2024-02-05T07:20:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:50 smithi188 ceph-mon[33283]: osdmap e117: 8 total, 8 up, 8 in 2024-02-05T07:20:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1840930103' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi184-81228-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/108844604' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi184-81207-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:50 smithi188 ceph-mon[33283]: from='client.35666 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi184-81207-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:50 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:20:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:50 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11"}]': finished 2024-02-05T07:20:51.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:50 smithi184 ceph-mon[29861]: osdmap e117: 8 total, 8 up, 8 in 2024-02-05T07:20:51.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1840930103' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi184-81228-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:51.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/108844604' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi184-81207-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:51.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:50 smithi184 ceph-mon[29861]: from='client.35666 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi184-81207-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:50 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:20:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:50 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-11"}]': finished 2024-02-05T07:20:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:50 smithi184 ceph-mon[41609]: osdmap e117: 8 total, 8 up, 8 in 2024-02-05T07:20:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1840930103' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi184-81228-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/108844604' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi184-81207-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:50 smithi184 ceph-mon[41609]: from='client.35666 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi184-81207-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:52.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:52 smithi184 ceph-mon[29861]: pgmap v136: 524 pgs: 64 unknown, 460 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2024-02-05T07:20:52.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:52.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1840930103' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi184-81228-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:52.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:52 smithi184 ceph-mon[29861]: from='client.35666 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi184-81207-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:52.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:52 smithi184 ceph-mon[29861]: osdmap e118: 8 total, 8 up, 8 in 2024-02-05T07:20:52.273 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:20:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:20:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:20:52.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:52 smithi184 ceph-mon[41609]: pgmap v136: 524 pgs: 64 unknown, 460 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2024-02-05T07:20:52.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:52.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1840930103' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi184-81228-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:52.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:52 smithi184 ceph-mon[41609]: from='client.35666 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi184-81207-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:52.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:52 smithi184 ceph-mon[41609]: osdmap e118: 8 total, 8 up, 8 in 2024-02-05T07:20:52.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:52 smithi188 ceph-mon[33283]: pgmap v136: 524 pgs: 64 unknown, 460 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 4 op/s 2024-02-05T07:20:52.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:52.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1840930103' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi184-81228-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:52.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:52 smithi188 ceph-mon[33283]: from='client.35666 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi184-81207-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:52.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:52 smithi188 ceph-mon[33283]: osdmap e118: 8 total, 8 up, 8 in 2024-02-05T07:20:53.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:53 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:53.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:53 smithi188 ceph-mon[33283]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:53.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:53 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:53.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:53 smithi188 ceph-mon[33283]: from='client.35609 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]': finished 2024-02-05T07:20:53.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:53 smithi188 ceph-mon[33283]: osdmap e119: 8 total, 8 up, 8 in 2024-02-05T07:20:53.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:53 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:53.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:53 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:53.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:53 smithi188 ceph-mon[33283]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:53.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:53 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:53.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:53.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[29861]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:53.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:53.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[29861]: from='client.35609 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]': finished 2024-02-05T07:20:53.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[29861]: osdmap e119: 8 total, 8 up, 8 in 2024-02-05T07:20:53.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:53.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:53.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[29861]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:53.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:53.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:53.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[41609]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:53.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:53.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[41609]: from='client.35609 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi184-81575-10"}]': finished 2024-02-05T07:20:53.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[41609]: osdmap e119: 8 total, 8 up, 8 in 2024-02-05T07:20:53.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1970097526' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:53.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:53.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[41609]: from='client.35609 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi184-81575-10"}]: dispatch 2024-02-05T07:20:53.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:53 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:53.803 INFO:tasks.workunit.client.0.smithi184.stdout: io: Running main() from gmock_main.cc 2024-02-05T07:20:53.803 INFO:tasks.workunit.client.0.smithi184.stdout: io: [==========] Running 14 tests from 1 test suite. 2024-02-05T07:20:53.804 INFO:tasks.workunit.client.0.smithi184.stdout: io: [----------] Global test environment set-up. 2024-02-05T07:20:53.804 INFO:tasks.workunit.client.0.smithi184.stdout: io: [----------] 14 tests from NeoRadosIo 2024-02-05T07:20:53.804 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ RUN ] NeoRadosIo.Limits 2024-02-05T07:20:53.804 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ OK ] NeoRadosIo.Limits (12760 ms) 2024-02-05T07:20:53.804 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2024-02-05T07:20:53.804 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (6022 ms) 2024-02-05T07:20:53.804 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2024-02-05T07:20:53.804 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ OK ] NeoRadosIo.ReadOp (3366 ms) 2024-02-05T07:20:53.804 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2024-02-05T07:20:53.804 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ OK ] NeoRadosIo.SparseRead (2760 ms) 2024-02-05T07:20:53.804 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2024-02-05T07:20:53.804 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ OK ] NeoRadosIo.RoundTrip (3077 ms) 2024-02-05T07:20:53.804 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-02-05T07:20:53.804 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (2765 ms) 2024-02-05T07:20:53.805 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-02-05T07:20:53.805 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (3036 ms) 2024-02-05T07:20:53.805 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-02-05T07:20:53.805 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (2936 ms) 2024-02-05T07:20:53.805 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2024-02-05T07:20:53.805 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (3050 ms) 2024-02-05T07:20:53.805 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ RUN ] NeoRadosIo.Trunc 2024-02-05T07:20:53.805 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ OK ] NeoRadosIo.Trunc (3050 ms) 2024-02-05T07:20:53.805 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ RUN ] NeoRadosIo.Remove 2024-02-05T07:20:53.805 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ OK ] NeoRadosIo.Remove (2902 ms) 2024-02-05T07:20:53.805 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2024-02-05T07:20:53.805 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (3010 ms) 2024-02-05T07:20:53.805 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2024-02-05T07:20:53.805 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ OK ] NeoRadosIo.RmXattr (3002 ms) 2024-02-05T07:20:53.805 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2024-02-05T07:20:53.806 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ OK ] NeoRadosIo.GetXattrs (3013 ms) 2024-02-05T07:20:53.806 INFO:tasks.workunit.client.0.smithi184.stdout: io: [----------] 14 tests from NeoRadosIo (54749 ms total) 2024-02-05T07:20:53.806 INFO:tasks.workunit.client.0.smithi184.stdout: io: 2024-02-05T07:20:53.806 INFO:tasks.workunit.client.0.smithi184.stdout: io: [----------] Global test environment tear-down 2024-02-05T07:20:53.806 INFO:tasks.workunit.client.0.smithi184.stdout: io: [==========] 14 tests from 1 test suite ran. (54750 ms total) 2024-02-05T07:20:53.806 INFO:tasks.workunit.client.0.smithi184.stdout: io: [ PASSED ] 14 tests. 2024-02-05T07:20:54.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: pgmap v139: 484 pgs: 32 creating+peering, 32 unknown, 420 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:20:54.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:54.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: from='client.35609 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi184-81575-10"}]': finished 2024-02-05T07:20:54.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:54.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: osdmap e120: 8 total, 8 up, 8 in 2024-02-05T07:20:54.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/803886783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi184-81228-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:54.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2585389923' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi184-81207-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:54.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: from='client.25693 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi184-81228-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:54.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: from='client.25690 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi184-81207-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:54.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:54.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:54.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:54.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:54.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:54.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:54.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: pgmap v139: 484 pgs: 32 creating+peering, 32 unknown, 420 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:20:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: from='client.35609 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi184-81575-10"}]': finished 2024-02-05T07:20:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: osdmap e120: 8 total, 8 up, 8 in 2024-02-05T07:20:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/803886783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi184-81228-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2585389923' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi184-81207-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: from='client.25693 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi184-81228-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: from='client.25690 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi184-81207-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:54.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:54.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:54.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:54.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:54.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:54.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: pgmap v139: 484 pgs: 32 creating+peering, 32 unknown, 420 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:20:54.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:54.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: from='client.35609 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi184-81575-10"}]': finished 2024-02-05T07:20:54.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:54.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: osdmap e120: 8 total, 8 up, 8 in 2024-02-05T07:20:54.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/803886783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi184-81228-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:54.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2585389923' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi184-81207-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:54.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: from='client.25693 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi184-81228-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:54.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: from='client.25690 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi184-81207-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:54.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:54.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:54.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:54.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:54.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:54.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:20:54.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:56.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[29861]: from='client.25693 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi184-81228-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:56.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[29861]: from='client.25690 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi184-81207-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:56.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[29861]: from='client.35690 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:56.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[29861]: osdmap e121: 8 total, 8 up, 8 in 2024-02-05T07:20:56.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:56.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[29861]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:56.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[29861]: pgmap v142: 516 pgs: 96 unknown, 420 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:20:56.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:56.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[41609]: from='client.25693 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi184-81228-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:56.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[41609]: from='client.25690 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi184-81207-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:56.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[41609]: from='client.35690 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:56.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[41609]: osdmap e121: 8 total, 8 up, 8 in 2024-02-05T07:20:56.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:56.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[41609]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:56.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[41609]: pgmap v142: 516 pgs: 96 unknown, 420 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:20:56.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:55 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:56.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:55 smithi188 ceph-mon[33283]: from='client.25693 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi184-81228-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:56.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:55 smithi188 ceph-mon[33283]: from='client.25690 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi184-81207-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:56.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:55 smithi188 ceph-mon[33283]: from='client.35690 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:20:56.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:55 smithi188 ceph-mon[33283]: osdmap e121: 8 total, 8 up, 8 in 2024-02-05T07:20:56.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:55 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:56.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:55 smithi188 ceph-mon[33283]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:20:56.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:55 smithi188 ceph-mon[33283]: pgmap v142: 516 pgs: 96 unknown, 420 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:20:56.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:55 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:57.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:56 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:57.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:56 smithi184 ceph-mon[41609]: osdmap e122: 8 total, 8 up, 8 in 2024-02-05T07:20:57.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:56 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:57.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:56 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:57.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:56 smithi184 ceph-mon[29861]: osdmap e122: 8 total, 8 up, 8 in 2024-02-05T07:20:57.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:56 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:57.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:56 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:20:57.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:56 smithi188 ceph-mon[33283]: osdmap e122: 8 total, 8 up, 8 in 2024-02-05T07:20:57.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:56 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:57.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:20:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:20:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:57 smithi188 ceph-mon[33283]: from='client.35690 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]': finished 2024-02-05T07:20:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:57 smithi188 ceph-mon[33283]: osdmap e123: 8 total, 8 up, 8 in 2024-02-05T07:20:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2274435822' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi184-81228-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1014413541' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi184-81207-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:57 smithi188 ceph-mon[33283]: from='client.25711 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi184-81207-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:57 smithi188 ceph-mon[33283]: pgmap v145: 524 pgs: 104 unknown, 420 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:58.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:57 smithi184 ceph-mon[29861]: from='client.35690 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]': finished 2024-02-05T07:20:58.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:57 smithi184 ceph-mon[29861]: osdmap e123: 8 total, 8 up, 8 in 2024-02-05T07:20:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2274435822' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi184-81228-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1014413541' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi184-81207-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:57 smithi184 ceph-mon[29861]: from='client.25711 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi184-81207-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:57 smithi184 ceph-mon[29861]: pgmap v145: 524 pgs: 104 unknown, 420 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:58.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:57 smithi184 ceph-mon[41609]: from='client.35690 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi184-81575-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]': finished 2024-02-05T07:20:58.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:57 smithi184 ceph-mon[41609]: osdmap e123: 8 total, 8 up, 8 in 2024-02-05T07:20:58.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2274435822' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi184-81228-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:58.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1014413541' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi184-81207-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:58.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:57 smithi184 ceph-mon[41609]: from='client.25711 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi184-81207-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:20:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:57 smithi184 ceph-mon[41609]: pgmap v145: 524 pgs: 104 unknown, 420 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-02-05T07:20:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:58 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2274435822' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi184-81228-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:58 smithi188 ceph-mon[33283]: from='client.25711 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi184-81207-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:58 smithi188 ceph-mon[33283]: osdmap e124: 8 total, 8 up, 8 in 2024-02-05T07:20:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:20:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:58 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:59.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:59.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2274435822' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi184-81228-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:59.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[29861]: from='client.25711 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi184-81207-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:59.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[29861]: osdmap e124: 8 total, 8 up, 8 in 2024-02-05T07:20:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:20:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:20:59.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:20:59.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2274435822' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi184-81228-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:59.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[41609]: from='client.25711 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi184-81207-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:20:59.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[41609]: osdmap e124: 8 total, 8 up, 8 in 2024-02-05T07:20:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:20:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:20:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:00.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:21:00.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:59 smithi188 ceph-mon[33283]: osdmap e125: 8 total, 8 up, 8 in 2024-02-05T07:21:00.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-13"}]: dispatch 2024-02-05T07:21:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-13"}]: dispatch 2024-02-05T07:21:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:59 smithi188 ceph-mon[33283]: pgmap v148: 460 pgs: 8 creating+peering, 452 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 100 KiB/s wr, 101 op/s 2024-02-05T07:21:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:20:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:00.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:21:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:59 smithi184 ceph-mon[29861]: osdmap e125: 8 total, 8 up, 8 in 2024-02-05T07:21:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-13"}]: dispatch 2024-02-05T07:21:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-13"}]: dispatch 2024-02-05T07:21:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:59 smithi184 ceph-mon[29861]: pgmap v148: 460 pgs: 8 creating+peering, 452 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 100 KiB/s wr, 101 op/s 2024-02-05T07:21:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:20:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:00.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:21:00.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:59 smithi184 ceph-mon[41609]: osdmap e125: 8 total, 8 up, 8 in 2024-02-05T07:21:00.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-13"}]: dispatch 2024-02-05T07:21:00.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-13"}]: dispatch 2024-02-05T07:21:00.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:59 smithi184 ceph-mon[41609]: pgmap v148: 460 pgs: 8 creating+peering, 452 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 100 KiB/s wr, 101 op/s 2024-02-05T07:21:00.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:20:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:01.034 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2024-02-05T07:21:01.034 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [----------] Global test environment set-up. 2024-02-05T07:21:01.035 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-02-05T07:21:01.035 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-02-05T07:21:01.035 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-02-05T07:21:01.035 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-02-05T07:21:01.035 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: 2024-02-05T07:21:01.035 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-02-05T07:21:01.035 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-02-05T07:21:01.035 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-02-05T07:21:01.035 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: 2024-02-05T07:19:58.783+0000 7fb668851780 -1 failed for service _ceph-mon._tcp 2024-02-05T07:21:01.035 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: 2024-02-05T07:19:58.783+0000 7fb668851780 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-02-05T07:21:01.035 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (67 ms) 2024-02-05T07:21:01.035 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-02-05T07:21:01.035 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2014 ms) 2024-02-05T07:21:01.035 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2082 ms total) 2024-02-05T07:21:01.036 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: 2024-02-05T07:21:01.036 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-02-05T07:21:01.036 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-02-05T07:21:01.036 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x5602548dc720 2024-02-05T07:21:01.036 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c1f190 2024-02-05T07:21:01.036 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c21db0 2024-02-05T07:21:01.036 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c22380 2024-02-05T07:21:01.036 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c22270 2024-02-05T07:21:01.036 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c228c0 2024-02-05T07:21:01.036 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c23310 2024-02-05T07:21:01.036 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c23120 2024-02-05T07:21:01.036 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c237e0 2024-02-05T07:21:01.036 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c238f0 2024-02-05T07:21:01.037 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c23dc0 2024-02-05T07:21:01.037 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c23ed0 2024-02-05T07:21:01.037 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c24480 2024-02-05T07:21:01.037 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c23aa0 2024-02-05T07:21:01.037 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c23bb0 2024-02-05T07:21:01.037 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c23fe0 2024-02-05T07:21:01.037 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c240f0 2024-02-05T07:21:01.037 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c24220 2024-02-05T07:21:01.037 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c245b0 2024-02-05T07:21:01.037 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c246e0 2024-02-05T07:21:01.037 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c24c90 2024-02-05T07:21:01.037 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c24830 2024-02-05T07:21:01.037 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c24940 2024-02-05T07:21:01.038 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c24a50 2024-02-05T07:21:01.038 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c24da0 2024-02-05T07:21:01.038 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c24eb0 2024-02-05T07:21:01.038 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c254a0 2024-02-05T07:21:01.038 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c25000 2024-02-05T07:21:01.038 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c25130 2024-02-05T07:21:01.038 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c25240 2024-02-05T07:21:01.038 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c25350 2024-02-05T07:21:01.038 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c25a50 2024-02-05T07:21:01.038 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c255b0 2024-02-05T07:21:01.038 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c256c0 2024-02-05T07:21:01.039 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c257d0 2024-02-05T07:21:01.039 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c258e0 2024-02-05T07:21:01.039 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c26080 2024-02-05T07:21:01.039 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c25be0 2024-02-05T07:21:01.039 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c25cf0 2024-02-05T07:21:01.039 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c25e00 2024-02-05T07:21:01.039 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c25f30 2024-02-05T07:21:01.039 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c26630 2024-02-05T07:21:01.039 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c26190 2024-02-05T07:21:01.039 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c262a0 2024-02-05T07:21:01.040 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c263d0 2024-02-05T07:21:01.040 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c264e0 2024-02-05T07:21:01.040 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c26c20 2024-02-05T07:21:01.040 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c26780 2024-02-05T07:21:01.040 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c26890 2024-02-05T07:21:01.040 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c269a0 2024-02-05T07:21:01.041 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c26ab0 2024-02-05T07:21:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:00 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-13"}]': finished 2024-02-05T07:21:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-13", "mode": "writeback"}]: dispatch 2024-02-05T07:21:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:00 smithi188 ceph-mon[33283]: osdmap e126: 8 total, 8 up, 8 in 2024-02-05T07:21:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1705634223' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi184-81207-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2714427875' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi184-81228-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:00 smithi188 ceph-mon[33283]: from='client.25717 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi184-81228-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:00 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-13", "mode": "writeback"}]: dispatch 2024-02-05T07:21:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:01.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-13"}]': finished 2024-02-05T07:21:01.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-13", "mode": "writeback"}]: dispatch 2024-02-05T07:21:01.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[29861]: osdmap e126: 8 total, 8 up, 8 in 2024-02-05T07:21:01.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1705634223' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi184-81207-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:01.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2714427875' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi184-81228-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:01.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[29861]: from='client.25717 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi184-81228-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:01.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-13", "mode": "writeback"}]: dispatch 2024-02-05T07:21:01.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:01.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-13"}]': finished 2024-02-05T07:21:01.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-13", "mode": "writeback"}]: dispatch 2024-02-05T07:21:01.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[41609]: osdmap e126: 8 total, 8 up, 8 in 2024-02-05T07:21:01.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1705634223' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi184-81207-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:01.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2714427875' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi184-81228-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:01.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[41609]: from='client.25717 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi184-81228-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:01.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-13", "mode": "writeback"}]: dispatch 2024-02-05T07:21:01.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:02.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:21:02.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1705634223' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi184-81207-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:02.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: from='client.25717 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi184-81228-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:02.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-13", "mode": "writeback"}]': finished 2024-02-05T07:21:02.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: osdmap e127: 8 total, 8 up, 8 in 2024-02-05T07:21:02.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: pgmap v151: 524 pgs: 64 unknown, 8 creating+peering, 452 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 100 KiB/s wr, 101 op/s 2024-02-05T07:21:02.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:02.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.0"}]: dispatch 2024-02-05T07:21:02.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.1"}]: dispatch 2024-02-05T07:21:02.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.2"}]: dispatch 2024-02-05T07:21:02.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.3"}]: dispatch 2024-02-05T07:21:02.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.4"}]: dispatch 2024-02-05T07:21:02.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.5"}]: dispatch 2024-02-05T07:21:02.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.6"}]: dispatch 2024-02-05T07:21:02.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.7"}]: dispatch 2024-02-05T07:21:02.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.8"}]: dispatch 2024-02-05T07:21:02.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.9"}]: dispatch 2024-02-05T07:21:02.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:21:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:21:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:21:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1705634223' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi184-81207-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: from='client.25717 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi184-81228-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-13", "mode": "writeback"}]': finished 2024-02-05T07:21:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: osdmap e127: 8 total, 8 up, 8 in 2024-02-05T07:21:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: pgmap v151: 524 pgs: 64 unknown, 8 creating+peering, 452 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 100 KiB/s wr, 101 op/s 2024-02-05T07:21:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.0"}]: dispatch 2024-02-05T07:21:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.1"}]: dispatch 2024-02-05T07:21:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.2"}]: dispatch 2024-02-05T07:21:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.3"}]: dispatch 2024-02-05T07:21:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.4"}]: dispatch 2024-02-05T07:21:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.5"}]: dispatch 2024-02-05T07:21:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.6"}]: dispatch 2024-02-05T07:21:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.7"}]: dispatch 2024-02-05T07:21:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.8"}]: dispatch 2024-02-05T07:21:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.9"}]: dispatch 2024-02-05T07:21:02.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:21:02.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1705634223' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi184-81207-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:02.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: from='client.25717 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi184-81228-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:02.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-13", "mode": "writeback"}]': finished 2024-02-05T07:21:02.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: osdmap e127: 8 total, 8 up, 8 in 2024-02-05T07:21:02.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: pgmap v151: 524 pgs: 64 unknown, 8 creating+peering, 452 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 100 KiB/s wr, 101 op/s 2024-02-05T07:21:02.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.0"}]: dispatch 2024-02-05T07:21:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.1"}]: dispatch 2024-02-05T07:21:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.2"}]: dispatch 2024-02-05T07:21:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.3"}]: dispatch 2024-02-05T07:21:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.4"}]: dispatch 2024-02-05T07:21:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.5"}]: dispatch 2024-02-05T07:21:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.6"}]: dispatch 2024-02-05T07:21:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.7"}]: dispatch 2024-02-05T07:21:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.8"}]: dispatch 2024-02-05T07:21:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "152.9"}]: dispatch 2024-02-05T07:21:03.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.0"}]: dispatch 2024-02-05T07:21:03.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.1"}]: dispatch 2024-02-05T07:21:03.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.2"}]: dispatch 2024-02-05T07:21:03.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.3"}]: dispatch 2024-02-05T07:21:03.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.4"}]: dispatch 2024-02-05T07:21:03.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.5"}]: dispatch 2024-02-05T07:21:03.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.6"}]: dispatch 2024-02-05T07:21:03.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.7"}]: dispatch 2024-02-05T07:21:03.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.8"}]: dispatch 2024-02-05T07:21:03.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.9"}]: dispatch 2024-02-05T07:21:03.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: 152.3 scrub starts 2024-02-05T07:21:03.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: 152.3 scrub ok 2024-02-05T07:21:03.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: osdmap e128: 8 total, 8 up, 8 in 2024-02-05T07:21:03.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: 152.6 scrub starts 2024-02-05T07:21:03.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: 152.6 scrub ok 2024-02-05T07:21:03.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:03.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: 152.0 scrub starts 2024-02-05T07:21:03.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:02 smithi188 ceph-mon[33283]: 152.0 scrub ok 2024-02-05T07:21:03.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.0"}]: dispatch 2024-02-05T07:21:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.1"}]: dispatch 2024-02-05T07:21:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.2"}]: dispatch 2024-02-05T07:21:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.3"}]: dispatch 2024-02-05T07:21:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.4"}]: dispatch 2024-02-05T07:21:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.5"}]: dispatch 2024-02-05T07:21:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.6"}]: dispatch 2024-02-05T07:21:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.7"}]: dispatch 2024-02-05T07:21:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.8"}]: dispatch 2024-02-05T07:21:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.9"}]: dispatch 2024-02-05T07:21:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: 152.3 scrub starts 2024-02-05T07:21:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: 152.3 scrub ok 2024-02-05T07:21:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: osdmap e128: 8 total, 8 up, 8 in 2024-02-05T07:21:03.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: 152.6 scrub starts 2024-02-05T07:21:03.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: 152.6 scrub ok 2024-02-05T07:21:03.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:03.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: 152.0 scrub starts 2024-02-05T07:21:03.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[29861]: 152.0 scrub ok 2024-02-05T07:21:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.0"}]: dispatch 2024-02-05T07:21:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.1"}]: dispatch 2024-02-05T07:21:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.2"}]: dispatch 2024-02-05T07:21:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.3"}]: dispatch 2024-02-05T07:21:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.4"}]: dispatch 2024-02-05T07:21:03.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.5"}]: dispatch 2024-02-05T07:21:03.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.6"}]: dispatch 2024-02-05T07:21:03.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.7"}]: dispatch 2024-02-05T07:21:03.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.8"}]: dispatch 2024-02-05T07:21:03.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "152.9"}]: dispatch 2024-02-05T07:21:03.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: 152.3 scrub starts 2024-02-05T07:21:03.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: 152.3 scrub ok 2024-02-05T07:21:03.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: osdmap e128: 8 total, 8 up, 8 in 2024-02-05T07:21:03.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: 152.6 scrub starts 2024-02-05T07:21:03.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: 152.6 scrub ok 2024-02-05T07:21:03.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:03.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: 152.0 scrub starts 2024-02-05T07:21:03.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:02 smithi184 ceph-mon[41609]: 152.0 scrub ok 2024-02-05T07:21:04.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: 152.7 scrub starts 2024-02-05T07:21:04.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: 152.7 scrub ok 2024-02-05T07:21:04.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: 152.1 deep-scrub starts 2024-02-05T07:21:04.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: 152.1 deep-scrub ok 2024-02-05T07:21:04.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: 152.8 scrub starts 2024-02-05T07:21:04.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: 152.8 scrub ok 2024-02-05T07:21:04.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: 152.4 deep-scrub starts 2024-02-05T07:21:04.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: 152.4 deep-scrub ok 2024-02-05T07:21:04.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: osdmap e129: 8 total, 8 up, 8 in 2024-02-05T07:21:04.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1236941992' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi184-81207-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:04.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: from='client.25726 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi184-81207-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:04.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/898440511' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi184-81228-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:04.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: 152.2 scrub starts 2024-02-05T07:21:04.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: 152.2 scrub ok 2024-02-05T07:21:04.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: pgmap v154: 524 pgs: 64 unknown, 460 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 59 KiB/s rd, 31 KiB/s wr, 102 op/s 2024-02-05T07:21:04.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:04.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: 152.5 scrub starts 2024-02-05T07:21:04.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:03 smithi188 ceph-mon[33283]: 152.5 scrub ok 2024-02-05T07:21:04.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: 152.7 scrub starts 2024-02-05T07:21:04.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: 152.7 scrub ok 2024-02-05T07:21:04.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: 152.1 deep-scrub starts 2024-02-05T07:21:04.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: 152.1 deep-scrub ok 2024-02-05T07:21:04.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: 152.8 scrub starts 2024-02-05T07:21:04.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: 152.8 scrub ok 2024-02-05T07:21:04.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: 152.4 deep-scrub starts 2024-02-05T07:21:04.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: 152.4 deep-scrub ok 2024-02-05T07:21:04.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: osdmap e129: 8 total, 8 up, 8 in 2024-02-05T07:21:04.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1236941992' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi184-81207-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:04.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: from='client.25726 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi184-81207-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:04.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/898440511' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi184-81228-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:04.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: 152.2 scrub starts 2024-02-05T07:21:04.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: 152.2 scrub ok 2024-02-05T07:21:04.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: pgmap v154: 524 pgs: 64 unknown, 460 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 59 KiB/s rd, 31 KiB/s wr, 102 op/s 2024-02-05T07:21:04.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:04.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: 152.5 scrub starts 2024-02-05T07:21:04.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[29861]: 152.5 scrub ok 2024-02-05T07:21:04.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: 152.7 scrub starts 2024-02-05T07:21:04.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: 152.7 scrub ok 2024-02-05T07:21:04.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: 152.1 deep-scrub starts 2024-02-05T07:21:04.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: 152.1 deep-scrub ok 2024-02-05T07:21:04.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: 152.8 scrub starts 2024-02-05T07:21:04.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: 152.8 scrub ok 2024-02-05T07:21:04.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: 152.4 deep-scrub starts 2024-02-05T07:21:04.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: 152.4 deep-scrub ok 2024-02-05T07:21:04.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: osdmap e129: 8 total, 8 up, 8 in 2024-02-05T07:21:04.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1236941992' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi184-81207-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:04.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: from='client.25726 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi184-81207-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:04.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/898440511' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi184-81228-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:04.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: 152.2 scrub starts 2024-02-05T07:21:04.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: 152.2 scrub ok 2024-02-05T07:21:04.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: pgmap v154: 524 pgs: 64 unknown, 460 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 59 KiB/s rd, 31 KiB/s wr, 102 op/s 2024-02-05T07:21:04.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:04.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: 152.5 scrub starts 2024-02-05T07:21:04.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:03 smithi184 ceph-mon[41609]: 152.5 scrub ok 2024-02-05T07:21:05.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:05 smithi188 ceph-mon[33283]: 152.9 scrub starts 2024-02-05T07:21:05.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:05 smithi188 ceph-mon[33283]: 152.9 scrub ok 2024-02-05T07:21:05.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:05 smithi188 ceph-mon[33283]: Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:05.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:05 smithi188 ceph-mon[33283]: from='client.25726 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi184-81207-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:05.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/898440511' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi184-81228-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:05.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:05 smithi188 ceph-mon[33283]: osdmap e130: 8 total, 8 up, 8 in 2024-02-05T07:21:05.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:05.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:05 smithi188 ceph-mon[33283]: osdmap e131: 8 total, 8 up, 8 in 2024-02-05T07:21:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[41609]: 152.9 scrub starts 2024-02-05T07:21:05.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[41609]: 152.9 scrub ok 2024-02-05T07:21:05.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[41609]: Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:05.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[41609]: from='client.25726 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi184-81207-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:05.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/898440511' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi184-81228-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:05.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[41609]: osdmap e130: 8 total, 8 up, 8 in 2024-02-05T07:21:05.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:05.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[41609]: osdmap e131: 8 total, 8 up, 8 in 2024-02-05T07:21:05.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[29861]: 152.9 scrub starts 2024-02-05T07:21:05.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[29861]: 152.9 scrub ok 2024-02-05T07:21:05.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[29861]: Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:05.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[29861]: from='client.25726 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi184-81207-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:05.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/898440511' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi184-81228-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:05.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[29861]: osdmap e130: 8 total, 8 up, 8 in 2024-02-05T07:21:05.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:05.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:05 smithi184 ceph-mon[29861]: osdmap e131: 8 total, 8 up, 8 in 2024-02-05T07:21:06.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:06 smithi188 ceph-mon[33283]: pgmap v157: 460 pgs: 460 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 59 KiB/s rd, 31 KiB/s wr, 102 op/s 2024-02-05T07:21:06.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:06.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:06 smithi188 ceph-mon[33283]: osdmap e132: 8 total, 8 up, 8 in 2024-02-05T07:21:06.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:21:06.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2991374458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi184-81207-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:06.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:06 smithi188 ceph-mon[33283]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:21:06.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/72573181' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi184-81228-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:06.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:06 smithi188 ceph-mon[33283]: from='client.35729 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi184-81207-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:06.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:06 smithi188 ceph-mon[33283]: from='client.35735 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi184-81228-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:06.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[29861]: pgmap v157: 460 pgs: 460 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 59 KiB/s rd, 31 KiB/s wr, 102 op/s 2024-02-05T07:21:06.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:06.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[29861]: osdmap e132: 8 total, 8 up, 8 in 2024-02-05T07:21:06.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:21:06.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2991374458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi184-81207-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:06.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[29861]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:21:06.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/72573181' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi184-81228-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:06.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[29861]: from='client.35729 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi184-81207-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:06.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[29861]: from='client.35735 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi184-81228-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:06.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[41609]: pgmap v157: 460 pgs: 460 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 59 KiB/s rd, 31 KiB/s wr, 102 op/s 2024-02-05T07:21:06.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:06.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[41609]: osdmap e132: 8 total, 8 up, 8 in 2024-02-05T07:21:06.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:21:06.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2991374458' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi184-81207-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:06.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[41609]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:21:06.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/72573181' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi184-81228-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:06.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[41609]: from='client.35729 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi184-81207-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:06.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:06 smithi184 ceph-mon[41609]: from='client.35735 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi184-81228-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:07.749 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:21:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:21:07.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:07.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]: dispatch 2024-02-05T07:21:07.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:07 smithi188 ceph-mon[33283]: from='client.34706 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]: dispatch 2024-02-05T07:21:07.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:07 smithi188 ceph-mon[33283]: from='client.35690 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]': finished 2024-02-05T07:21:07.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:07 smithi188 ceph-mon[33283]: from='client.35729 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi184-81207-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:07 smithi188 ceph-mon[33283]: from='client.35735 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi184-81228-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:07 smithi188 ceph-mon[33283]: from='client.34706 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]': finished 2024-02-05T07:21:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:07 smithi188 ceph-mon[33283]: osdmap e133: 8 total, 8 up, 8 in 2024-02-05T07:21:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:21:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:07 smithi188 ceph-mon[33283]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:21:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-05T07:21:07.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:07 smithi188 ceph-mon[33283]: from='client.34706 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-05T07:21:07.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]: dispatch 2024-02-05T07:21:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[29861]: from='client.34706 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]: dispatch 2024-02-05T07:21:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[29861]: from='client.35690 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]': finished 2024-02-05T07:21:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[29861]: from='client.35729 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi184-81207-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[29861]: from='client.35735 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi184-81228-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[29861]: from='client.34706 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]': finished 2024-02-05T07:21:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[29861]: osdmap e133: 8 total, 8 up, 8 in 2024-02-05T07:21:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:21:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[29861]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:21:07.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-05T07:21:07.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[29861]: from='client.34706 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-05T07:21:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]: dispatch 2024-02-05T07:21:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[41609]: from='client.34706 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]: dispatch 2024-02-05T07:21:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[41609]: from='client.35690 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]': finished 2024-02-05T07:21:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[41609]: from='client.35729 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi184-81207-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[41609]: from='client.35735 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi184-81228-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[41609]: from='client.34706 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]': finished 2024-02-05T07:21:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[41609]: osdmap e133: 8 total, 8 up, 8 in 2024-02-05T07:21:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1809054200' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:21:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:07.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:07.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[41609]: from='client.35690 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]: dispatch 2024-02-05T07:21:07.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-05T07:21:07.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:07 smithi184 ceph-mon[41609]: from='client.34706 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-05T07:21:07.809 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started api_snapshots: Running main() from gmock_main.cc 2024-02-05T07:21:07.809 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2024-02-05T07:21:07.809 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [----------] Global test environment set-up. 2024-02-05T07:21:07.809 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-02-05T07:21:07.809 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-02-05T07:21:07.809 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (4456 ms) 2024-02-05T07:21:07.809 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-02-05T07:21:07.809 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (4969 ms) 2024-02-05T07:21:07.810 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-02-05T07:21:07.810 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (2322 ms) 2024-02-05T07:21:07.810 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-02-05T07:21:07.810 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (2052 ms) 2024-02-05T07:21:07.810 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (13799 ms total) 2024-02-05T07:21:07.810 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: 2024-02-05T07:21:07.810 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-02-05T07:21:07.810 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-02-05T07:21:07.810 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (3869 ms) 2024-02-05T07:21:07.810 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-02-05T07:21:07.810 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (3951 ms) 2024-02-05T07:21:07.810 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-02-05T07:21:07.810 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (5000 ms) 2024-02-05T07:21:07.811 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (12820 ms total) 2024-02-05T07:21:07.811 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: 2024-02-05T07:21:07.811 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-02-05T07:21:07.811 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-02-05T07:21:07.811 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (2911 ms) 2024-02-05T07:21:07.811 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-02-05T07:21:07.811 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (2005 ms) 2024-02-05T07:21:07.811 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-02-05T07:21:07.811 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (2003 ms) 2024-02-05T07:21:07.811 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-02-05T07:21:07.811 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2009 ms) 2024-02-05T07:21:07.811 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (8928 ms total) 2024-02-05T07:21:07.811 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: 2024-02-05T07:21:07.811 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-02-05T07:21:07.812 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-02-05T07:21:07.812 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4080 ms) 2024-02-05T07:21:07.812 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-02-05T07:21:07.812 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (3927 ms) 2024-02-05T07:21:07.812 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8007 ms total) 2024-02-05T07:21:07.812 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: 2024-02-05T07:21:07.812 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [----------] Global test environment tear-down 2024-02-05T07:21:07.812 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (69044 ms total) 2024-02-05T07:21:07.812 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots: [ PASSED ] 13 tests. 2024-02-05T07:21:08.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:08 smithi184 ceph-mon[29861]: pgmap v160: 516 pgs: 64 unknown, 452 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-02-05T07:21:08.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:08 smithi184 ceph-mon[29861]: from='client.35690 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]': finished 2024-02-05T07:21:08.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:08 smithi184 ceph-mon[29861]: from='client.34706 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]': finished 2024-02-05T07:21:08.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:08 smithi184 ceph-mon[29861]: osdmap e134: 8 total, 8 up, 8 in 2024-02-05T07:21:08.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:08.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:08 smithi184 ceph-mon[41609]: pgmap v160: 516 pgs: 64 unknown, 452 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-02-05T07:21:08.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:08 smithi184 ceph-mon[41609]: from='client.35690 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]': finished 2024-02-05T07:21:08.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:08 smithi184 ceph-mon[41609]: from='client.34706 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]': finished 2024-02-05T07:21:08.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:08 smithi184 ceph-mon[41609]: osdmap e134: 8 total, 8 up, 8 in 2024-02-05T07:21:08.674 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:08.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:08 smithi188 ceph-mon[33283]: pgmap v160: 516 pgs: 64 unknown, 452 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-02-05T07:21:08.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:08 smithi188 ceph-mon[33283]: from='client.35690 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi184-81575-15"}]': finished 2024-02-05T07:21:08.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:08 smithi188 ceph-mon[33283]: from='client.34706 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]': finished 2024-02-05T07:21:08.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:08 smithi188 ceph-mon[33283]: osdmap e134: 8 total, 8 up, 8 in 2024-02-05T07:21:08.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:09 smithi188 ceph-mon[33283]: osdmap e135: 8 total, 8 up, 8 in 2024-02-05T07:21:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2168484278' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi184-81207-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:09 smithi188 ceph-mon[33283]: from='client.25750 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi184-81207-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1318702782' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi184-81228-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:09.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:09 smithi184 ceph-mon[29861]: osdmap e135: 8 total, 8 up, 8 in 2024-02-05T07:21:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2168484278' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi184-81207-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:09 smithi184 ceph-mon[29861]: from='client.25750 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi184-81207-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1318702782' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi184-81228-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:09.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:09.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:09.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:09 smithi184 ceph-mon[41609]: osdmap e135: 8 total, 8 up, 8 in 2024-02-05T07:21:09.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2168484278' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi184-81207-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:09 smithi184 ceph-mon[41609]: from='client.25750 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi184-81207-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1318702782' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi184-81228-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:10 smithi188 ceph-mon[33283]: pgmap v163: 484 pgs: 64 unknown, 420 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-02-05T07:21:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:10 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:10 smithi188 ceph-mon[33283]: from='client.25750 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi184-81207-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1318702782' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi184-81228-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:10 smithi188 ceph-mon[33283]: osdmap e136: 8 total, 8 up, 8 in 2024-02-05T07:21:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1075455540' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81609-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:10 smithi188 ceph-mon[33283]: from='client.35753 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81609-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[41609]: pgmap v163: 484 pgs: 64 unknown, 420 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-02-05T07:21:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[41609]: from='client.25750 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi184-81207-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1318702782' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi184-81228-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[41609]: osdmap e136: 8 total, 8 up, 8 in 2024-02-05T07:21:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1075455540' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81609-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[41609]: from='client.35753 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81609-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[29861]: pgmap v163: 484 pgs: 64 unknown, 420 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-02-05T07:21:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:10.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[29861]: from='client.25750 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi184-81207-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:10.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1318702782' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi184-81228-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:10.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[29861]: osdmap e136: 8 total, 8 up, 8 in 2024-02-05T07:21:10.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1075455540' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81609-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:10.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:10 smithi184 ceph-mon[29861]: from='client.35753 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81609-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:11.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:11.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:11 smithi188 ceph-mon[33283]: from='client.35753 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81609-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:11.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:11 smithi188 ceph-mon[33283]: osdmap e137: 8 total, 8 up, 8 in 2024-02-05T07:21:11.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:11.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:11 smithi184 ceph-mon[41609]: from='client.35753 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81609-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:11.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:11 smithi184 ceph-mon[41609]: osdmap e137: 8 total, 8 up, 8 in 2024-02-05T07:21:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:11 smithi184 ceph-mon[29861]: from='client.35753 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81609-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:11 smithi184 ceph-mon[29861]: osdmap e137: 8 total, 8 up, 8 in 2024-02-05T07:21:12.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:21:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:21:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:21:12.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:12 smithi188 ceph-mon[33283]: pgmap v166: 452 pgs: 32 unknown, 420 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-02-05T07:21:12.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-05T07:21:12.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:12 smithi188 ceph-mon[33283]: from='client.24709 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:12.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:12 smithi188 ceph-mon[33283]: from='client.24709 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:12.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:12 smithi188 ceph-mon[33283]: osdmap e138: 8 total, 8 up, 8 in 2024-02-05T07:21:12.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2073862003' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi184-81228-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2170478616' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi184-81207-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app2"}]: dispatch 2024-02-05T07:21:12.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:12 smithi188 ceph-mon[33283]: from='client.25771 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi184-81207-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:12 smithi188 ceph-mon[33283]: from='client.24709 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[41609]: pgmap v166: 452 pgs: 32 unknown, 420 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-02-05T07:21:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-05T07:21:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[41609]: from='client.24709 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[41609]: from='client.24709 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[41609]: osdmap e138: 8 total, 8 up, 8 in 2024-02-05T07:21:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2073862003' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi184-81228-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2170478616' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi184-81207-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app2"}]: dispatch 2024-02-05T07:21:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[41609]: from='client.25771 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi184-81207-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[41609]: from='client.24709 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[29861]: pgmap v166: 452 pgs: 32 unknown, 420 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-02-05T07:21:12.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-05T07:21:12.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[29861]: from='client.24709 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:12.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[29861]: from='client.24709 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:12.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[29861]: osdmap e138: 8 total, 8 up, 8 in 2024-02-05T07:21:12.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2073862003' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi184-81228-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2170478616' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi184-81207-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app2"}]: dispatch 2024-02-05T07:21:12.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[29861]: from='client.25771 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi184-81207-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:12.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:12 smithi184 ceph-mon[29861]: from='client.24709 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2073862003' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi184-81228-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:13 smithi188 ceph-mon[33283]: from='client.25771 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi184-81207-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:13 smithi188 ceph-mon[33283]: from='client.24709 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:13 smithi188 ceph-mon[33283]: osdmap e139: 8 total, 8 up, 8 in 2024-02-05T07:21:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-02-05T07:21:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-05T07:21:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:13 smithi188 ceph-mon[33283]: from='client.24709 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-05T07:21:13.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:13 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:21:13.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:13 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:21:13.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:13.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2073862003' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi184-81228-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:13.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[29861]: from='client.25771 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi184-81207-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:13.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[29861]: from='client.24709 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:13.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[29861]: osdmap e139: 8 total, 8 up, 8 in 2024-02-05T07:21:13.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-02-05T07:21:13.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-05T07:21:13.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[29861]: from='client.24709 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-05T07:21:13.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:21:13.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:21:13.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:13.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2073862003' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi184-81228-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:13.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[41609]: from='client.25771 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi184-81207-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:13.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[41609]: from='client.24709 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi184-81396-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:13.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[41609]: osdmap e139: 8 total, 8 up, 8 in 2024-02-05T07:21:13.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-02-05T07:21:13.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-05T07:21:13.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[41609]: from='client.24709 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-05T07:21:13.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:21:13.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:13 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:21:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:14 smithi188 ceph-mon[33283]: pgmap v169: 516 pgs: 64 creating+peering, 452 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:21:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:14 smithi188 ceph-mon[33283]: from='client.24709 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-05T07:21:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:14 smithi188 ceph-mon[33283]: osdmap e140: 8 total, 8 up, 8 in 2024-02-05T07:21:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-05T07:21:14.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:14 smithi188 ceph-mon[33283]: from='client.24709 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-05T07:21:14.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:14.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:14 smithi188 ceph-mon[33283]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:14.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:14.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:14 smithi188 ceph-mon[33283]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:14.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:14.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:14 smithi188 ceph-mon[33283]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[29861]: pgmap v169: 516 pgs: 64 creating+peering, 452 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:21:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[29861]: from='client.24709 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-05T07:21:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[29861]: osdmap e140: 8 total, 8 up, 8 in 2024-02-05T07:21:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-05T07:21:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[29861]: from='client.24709 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-05T07:21:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[29861]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[29861]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[29861]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:14.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[41609]: pgmap v169: 516 pgs: 64 creating+peering, 452 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:21:14.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:14.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[41609]: from='client.24709 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-05T07:21:14.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[41609]: osdmap e140: 8 total, 8 up, 8 in 2024-02-05T07:21:14.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-05T07:21:14.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[41609]: from='client.24709 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-05T07:21:14.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:14.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[41609]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:14.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:14.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[41609]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:14.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:14.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:14 smithi184 ceph-mon[41609]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:15 smithi188 ceph-mon[33283]: from='client.24709 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-05T07:21:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:15 smithi188 ceph-mon[33283]: from='client.35801 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:15 smithi188 ceph-mon[33283]: osdmap e141: 8 total, 8 up, 8 in 2024-02-05T07:21:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi184-81609-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2777402052' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi184-81207-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:16.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1"}]: dispatch 2024-02-05T07:21:16.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2118393395' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi184-81228-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:16.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:15 smithi188 ceph-mon[33283]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi184-81609-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:16.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:15 smithi188 ceph-mon[33283]: from='client.24709 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1"}]: dispatch 2024-02-05T07:21:16.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:15 smithi188 ceph-mon[33283]: from='client.35795 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi184-81207-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:16.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:15 smithi188 ceph-mon[33283]: pgmap v172: 484 pgs: 64 unknown, 420 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:21:16.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:16.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[29861]: from='client.24709 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-05T07:21:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[29861]: from='client.35801 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[29861]: osdmap e141: 8 total, 8 up, 8 in 2024-02-05T07:21:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi184-81609-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2777402052' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi184-81207-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1"}]: dispatch 2024-02-05T07:21:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2118393395' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi184-81228-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[29861]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi184-81609-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[29861]: from='client.24709 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1"}]: dispatch 2024-02-05T07:21:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[29861]: from='client.35795 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi184-81207-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[29861]: pgmap v172: 484 pgs: 64 unknown, 420 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:21:16.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[41609]: from='client.24709 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-05T07:21:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[41609]: from='client.35801 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[41609]: osdmap e141: 8 total, 8 up, 8 in 2024-02-05T07:21:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi184-81609-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2777402052' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi184-81207-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/735282579' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1"}]: dispatch 2024-02-05T07:21:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2118393395' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi184-81228-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[41609]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi184-81609-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[41609]: from='client.24709 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1"}]: dispatch 2024-02-05T07:21:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[41609]: from='client.35795 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi184-81207-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:15 smithi184 ceph-mon[41609]: pgmap v172: 484 pgs: 64 unknown, 420 active+clean; 217 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:21:16.867 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-02-05T07:21:16.867 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-02-05T07:21:16.867 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-02-05T07:21:16.867 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-02-05T07:21:16.867 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-02-05T07:21:16.867 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (1 ms total) 2024-02-05T07:21:16.867 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: 2024-02-05T07:21:16.867 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-02-05T07:21:16.867 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: seed 81396 2024-02-05T07:21:16.867 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-02-05T07:21:16.867 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (1 ms) 2024-02-05T07:21:16.867 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-02-05T07:21:16.867 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (373 ms) 2024-02-05T07:21:16.868 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-02-05T07:21:16.868 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (13 ms) 2024-02-05T07:21:16.868 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-02-05T07:21:16.868 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (12 ms) 2024-02-05T07:21:16.868 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-02-05T07:21:16.868 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (13 ms) 2024-02-05T07:21:16.868 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-02-05T07:21:16.868 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (5 ms) 2024-02-05T07:21:16.868 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-02-05T07:21:16.868 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (3 ms) 2024-02-05T07:21:16.868 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-02-05T07:21:16.868 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (6 ms) 2024-02-05T07:21:16.868 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-02-05T07:21:16.869 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (4 ms) 2024-02-05T07:21:16.869 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-02-05T07:21:16.869 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (14 ms) 2024-02-05T07:21:16.869 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-02-05T07:21:16.869 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (2 ms) 2024-02-05T07:21:16.869 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-02-05T07:21:16.869 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (6 ms) 2024-02-05T07:21:16.869 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-02-05T07:21:16.869 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (9 ms) 2024-02-05T07:21:16.869 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-02-05T07:21:16.869 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: osd_max_attr_size = 0 2024-02-05T07:21:16.869 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-02-05T07:21:16.869 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (1451 ms) 2024-02-05T07:21:16.870 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-02-05T07:21:16.870 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (335 ms) 2024-02-05T07:21:16.870 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-02-05T07:21:16.870 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-02-05T07:21:16.870 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: done waiting, doing copies 2024-02-05T07:21:16.870 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: waiting for final deep scrubs... 2024-02-05T07:21:16.870 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: done waiting 2024-02-05T07:21:16.870 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (60635 ms) 2024-02-05T07:21:16.870 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-02-05T07:21:16.870 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (4 ms) 2024-02-05T07:21:16.870 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-02-05T07:21:16.870 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (5 ms) 2024-02-05T07:21:16.870 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-02-05T07:21:16.870 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4559 ms) 2024-02-05T07:21:16.871 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-02-05T07:21:16.871 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-02-05T07:21:16.871 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-02-05T07:21:16.871 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-02-05T07:21:16.871 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-02-05T07:21:16.871 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (1 ms) 2024-02-05T07:21:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:16 smithi188 ceph-mon[33283]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2118393395' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi184-81228-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:16 smithi188 ceph-mon[33283]: from='client.24709 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1"}]': finished 2024-02-05T07:21:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:16 smithi188 ceph-mon[33283]: from='client.35795 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi184-81207-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:16 smithi188 ceph-mon[33283]: osdmap e142: 8 total, 8 up, 8 in 2024-02-05T07:21:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:16 smithi184 ceph-mon[29861]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2118393395' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi184-81228-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:16 smithi184 ceph-mon[29861]: from='client.24709 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1"}]': finished 2024-02-05T07:21:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:16 smithi184 ceph-mon[29861]: from='client.35795 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi184-81207-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:16 smithi184 ceph-mon[29861]: osdmap e142: 8 total, 8 up, 8 in 2024-02-05T07:21:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:16 smithi184 ceph-mon[41609]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2118393395' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi184-81228-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:16 smithi184 ceph-mon[41609]: from='client.24709 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi184-81396-1","app":"app1","key":"key1"}]': finished 2024-02-05T07:21:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:16 smithi184 ceph-mon[41609]: from='client.35795 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi184-81207-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:16 smithi184 ceph-mon[41609]: osdmap e142: 8 total, 8 up, 8 in 2024-02-05T07:21:17.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:21:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:21:17.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:17.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:17 smithi188 ceph-mon[33283]: from='client.35801 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi184-81609-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]': finished 2024-02-05T07:21:17.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:17 smithi188 ceph-mon[33283]: osdmap e143: 8 total, 8 up, 8 in 2024-02-05T07:21:17.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:17.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:17 smithi188 ceph-mon[33283]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:17.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:18.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:17 smithi188 ceph-mon[33283]: pgmap v175: 396 pgs: 8 unknown, 388 active+clean; 592 KiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-02-05T07:21:18.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:17 smithi188 ceph-mon[33283]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:18.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81396-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:18.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:17 smithi188 ceph-mon[33283]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81396-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[29861]: from='client.35801 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi184-81609-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]': finished 2024-02-05T07:21:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[29861]: osdmap e143: 8 total, 8 up, 8 in 2024-02-05T07:21:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[29861]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[29861]: pgmap v175: 396 pgs: 8 unknown, 388 active+clean; 592 KiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-02-05T07:21:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[29861]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81396-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[29861]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81396-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[41609]: from='client.35801 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi184-81609-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]': finished 2024-02-05T07:21:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[41609]: osdmap e143: 8 total, 8 up, 8 in 2024-02-05T07:21:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[41609]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[41609]: pgmap v175: 396 pgs: 8 unknown, 388 active+clean; 592 KiB data, 1.1 GiB used, 714 GiB / 715 GiB avail 2024-02-05T07:21:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[41609]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81396-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:17 smithi184 ceph-mon[41609]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81396-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:18 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:18 smithi188 ceph-mon[33283]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81396-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:18 smithi188 ceph-mon[33283]: osdmap e144: 8 total, 8 up, 8 in 2024-02-05T07:21:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81396-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3565284549' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi184-81207-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1937908646' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi184-81228-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:18 smithi188 ceph-mon[33283]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81396-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:18 smithi188 ceph-mon[33283]: from='client.25825 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi184-81207-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:19.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:19.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[29861]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81396-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[29861]: osdmap e144: 8 total, 8 up, 8 in 2024-02-05T07:21:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81396-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3565284549' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi184-81207-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1937908646' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi184-81228-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[29861]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81396-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[29861]: from='client.25825 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi184-81207-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:19.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:19.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:19.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[41609]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81396-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[41609]: osdmap e144: 8 total, 8 up, 8 in 2024-02-05T07:21:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81396-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3565284549' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi184-81207-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1937908646' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi184-81228-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[41609]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81396-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:18 smithi184 ceph-mon[41609]: from='client.25825 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi184-81207-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1937908646' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi184-81228-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:19 smithi188 ceph-mon[33283]: from='client.25825 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi184-81207-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:19 smithi188 ceph-mon[33283]: osdmap e145: 8 total, 8 up, 8 in 2024-02-05T07:21:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:19 smithi188 ceph-mon[33283]: pgmap v178: 460 pgs: 64 unknown, 8 creating+peering, 388 active+clean; 592 KiB data, 540 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:20.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:20.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1937908646' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi184-81228-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:20.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:19 smithi184 ceph-mon[29861]: from='client.25825 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi184-81207-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:20.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:19 smithi184 ceph-mon[29861]: osdmap e145: 8 total, 8 up, 8 in 2024-02-05T07:21:20.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:19 smithi184 ceph-mon[29861]: pgmap v178: 460 pgs: 64 unknown, 8 creating+peering, 388 active+clean; 592 KiB data, 540 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1937908646' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi184-81228-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:19 smithi184 ceph-mon[41609]: from='client.25825 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi184-81207-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:19 smithi184 ceph-mon[41609]: osdmap e145: 8 total, 8 up, 8 in 2024-02-05T07:21:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:19 smithi184 ceph-mon[41609]: pgmap v178: 460 pgs: 64 unknown, 8 creating+peering, 388 active+clean; 592 KiB data, 540 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:20 smithi188 ceph-mon[33283]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81396-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81396-24"}]': finished 2024-02-05T07:21:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:20 smithi188 ceph-mon[33283]: osdmap e146: 8 total, 8 up, 8 in 2024-02-05T07:21:21.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:21.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:20 smithi184 ceph-mon[29861]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81396-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81396-24"}]': finished 2024-02-05T07:21:21.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:20 smithi184 ceph-mon[29861]: osdmap e146: 8 total, 8 up, 8 in 2024-02-05T07:21:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:20 smithi184 ceph-mon[41609]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81396-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81396-24"}]': finished 2024-02-05T07:21:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:20 smithi184 ceph-mon[41609]: osdmap e146: 8 total, 8 up, 8 in 2024-02-05T07:21:21.879 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP api_snapshots_pp: Running main() from gmock_main.cc 2024-02-05T07:21:21.879 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2024-02-05T07:21:21.879 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-02-05T07:21:21.879 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-02-05T07:21:21.879 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: seed 81609 2024-02-05T07:21:21.880 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-02-05T07:21:21.880 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (4455 ms) 2024-02-05T07:21:21.880 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-02-05T07:21:21.880 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (4972 ms) 2024-02-05T07:21:21.880 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-02-05T07:21:21.880 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (2321 ms) 2024-02-05T07:21:21.880 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-02-05T07:21:21.880 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (2052 ms) 2024-02-05T07:21:21.880 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-02-05T07:21:21.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (4831 ms) 2024-02-05T07:21:21.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (18631 ms total) 2024-02-05T07:21:21.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: 2024-02-05T07:21:21.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-02-05T07:21:21.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-02-05T07:21:21.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (4092 ms) 2024-02-05T07:21:21.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-02-05T07:21:21.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (3887 ms) 2024-02-05T07:21:21.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-02-05T07:21:21.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (6080 ms) 2024-02-05T07:21:21.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-02-05T07:21:21.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (3917 ms) 2024-02-05T07:21:21.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-02-05T07:21:21.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (2061 ms) 2024-02-05T07:21:21.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-02-05T07:21:21.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-1241-g164d3be4/rpm/el9/BUILD/ceph-19.0.0-1241-g164d3be4/src/test/librados/snapshots_cxx.cc:463: Skipped 2024-02-05T07:21:21.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: 2024-02-05T07:21:21.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-02-05T07:21:21.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-02-05T07:21:21.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi184-81609-7 2024-02-05T07:21:21.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: waiting for snaps to purge 2024-02-05T07:21:21.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17949 ms) 2024-02-05T07:21:21.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (37986 ms total) 2024-02-05T07:21:21.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: 2024-02-05T07:21:21.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-02-05T07:21:21.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-02-05T07:21:21.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (9 ms) 2024-02-05T07:21:21.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-02-05T07:21:21.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5057 ms) 2024-02-05T07:21:21.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5066 ms total) 2024-02-05T07:21:21.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: 2024-02-05T07:21:21.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-02-05T07:21:21.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-02-05T07:21:21.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3008 ms) 2024-02-05T07:21:21.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-02-05T07:21:22.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:21 smithi188 ceph-mon[33283]: osdmap e147: 8 total, 8 up, 8 in 2024-02-05T07:21:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3542174898' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi184-81228-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:21 smithi188 ceph-mon[33283]: from='client.35828 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi184-81228-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3101750952' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi184-81207-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:21 smithi188 ceph-mon[33283]: from='client.25837 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi184-81207-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:21 smithi188 ceph-mon[33283]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:21 smithi188 ceph-mon[33283]: pgmap v181: 500 pgs: 104 unknown, 8 creating+peering, 388 active+clean; 592 KiB data, 540 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:21:22.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:21:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:21:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[29861]: osdmap e147: 8 total, 8 up, 8 in 2024-02-05T07:21:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3542174898' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi184-81228-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[29861]: from='client.35828 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi184-81228-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3101750952' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi184-81207-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[29861]: from='client.25837 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi184-81207-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[29861]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[29861]: pgmap v181: 500 pgs: 104 unknown, 8 creating+peering, 388 active+clean; 592 KiB data, 540 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:21:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[41609]: osdmap e147: 8 total, 8 up, 8 in 2024-02-05T07:21:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3542174898' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi184-81228-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[41609]: from='client.35828 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi184-81228-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3101750952' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi184-81207-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[41609]: from='client.25837 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi184-81207-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[41609]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:21 smithi184 ceph-mon[41609]: pgmap v181: 500 pgs: 104 unknown, 8 creating+peering, 388 active+clean; 592 KiB data, 540 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:21:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:22 smithi188 ceph-mon[33283]: Health check update: 10 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:22 smithi188 ceph-mon[33283]: from='client.35828 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi184-81228-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:22 smithi188 ceph-mon[33283]: from='client.25837 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi184-81207-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:22 smithi188 ceph-mon[33283]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:22 smithi188 ceph-mon[33283]: osdmap e148: 8 total, 8 up, 8 in 2024-02-05T07:21:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:22 smithi188 ceph-mon[33283]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:23.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:23.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[41609]: Health check update: 10 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[41609]: from='client.35828 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi184-81228-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[41609]: from='client.25837 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi184-81207-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[41609]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[41609]: osdmap e148: 8 total, 8 up, 8 in 2024-02-05T07:21:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[41609]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[29861]: Health check update: 10 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[29861]: from='client.35828 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi184-81228-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[29861]: from='client.25837 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi184-81207-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:23.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[29861]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:23.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[29861]: osdmap e148: 8 total, 8 up, 8 in 2024-02-05T07:21:23.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:23.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:22 smithi184 ceph-mon[29861]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:23 smithi188 ceph-mon[33283]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:23 smithi188 ceph-mon[33283]: osdmap e149: 8 total, 8 up, 8 in 2024-02-05T07:21:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:23 smithi188 ceph-mon[33283]: pgmap v184: 436 pgs: 436 active+clean; 592 KiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-05T07:21:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:23 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-02-05T07:21:24.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:23 smithi184 ceph-mon[29861]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:23 smithi184 ceph-mon[29861]: osdmap e149: 8 total, 8 up, 8 in 2024-02-05T07:21:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:23 smithi184 ceph-mon[29861]: pgmap v184: 436 pgs: 436 active+clean; 592 KiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-05T07:21:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:23 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-02-05T07:21:24.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:24.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:23 smithi184 ceph-mon[41609]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81396-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:24.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:23 smithi184 ceph-mon[41609]: osdmap e149: 8 total, 8 up, 8 in 2024-02-05T07:21:24.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:23 smithi184 ceph-mon[41609]: pgmap v184: 436 pgs: 436 active+clean; 592 KiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-05T07:21:24.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:23 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-02-05T07:21:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:24 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-02-05T07:21:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:24 smithi188 ceph-mon[33283]: osdmap e150: 8 total, 8 up, 8 in 2024-02-05T07:21:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/235332685' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi184-81207-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3861001287' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi184-81228-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:24 smithi188 ceph-mon[33283]: from='client.35837 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi184-81228-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/235332685' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi184-81207-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:24 smithi188 ceph-mon[33283]: from='client.35837 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi184-81228-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:24 smithi188 ceph-mon[33283]: osdmap e151: 8 total, 8 up, 8 in 2024-02-05T07:21:25.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-02-05T07:21:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[29861]: osdmap e150: 8 total, 8 up, 8 in 2024-02-05T07:21:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/235332685' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi184-81207-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3861001287' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi184-81228-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[29861]: from='client.35837 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi184-81228-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/235332685' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi184-81207-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[29861]: from='client.35837 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi184-81228-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[29861]: osdmap e151: 8 total, 8 up, 8 in 2024-02-05T07:21:25.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:25.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-02-05T07:21:25.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[41609]: osdmap e150: 8 total, 8 up, 8 in 2024-02-05T07:21:25.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/235332685' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi184-81207-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:25.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3861001287' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi184-81228-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:25.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[41609]: from='client.35837 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi184-81228-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:25.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/235332685' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi184-81207-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:25.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[41609]: from='client.35837 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi184-81228-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:25.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:24 smithi184 ceph-mon[41609]: osdmap e151: 8 total, 8 up, 8 in 2024-02-05T07:21:26.150 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:26.150 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:25 smithi188 ceph-mon[33283]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:26.151 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:26.151 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:26.151 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]: dispatch 2024-02-05T07:21:26.151 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:25 smithi188 ceph-mon[33283]: from='client.34706 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]: dispatch 2024-02-05T07:21:26.151 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:25 smithi188 ceph-mon[33283]: pgmap v187: 460 pgs: 64 unknown, 396 active+clean; 592 KiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-05T07:21:26.151 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:25 smithi188 ceph-mon[33283]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81396-24"}]': finished 2024-02-05T07:21:26.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:26.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[41609]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:26.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:26.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:26.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]: dispatch 2024-02-05T07:21:26.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[41609]: from='client.34706 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]: dispatch 2024-02-05T07:21:26.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[41609]: pgmap v187: 460 pgs: 64 unknown, 396 active+clean; 592 KiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-05T07:21:26.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[41609]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81396-24"}]': finished 2024-02-05T07:21:26.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:26.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[29861]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:26.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:26.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:26.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]: dispatch 2024-02-05T07:21:26.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[29861]: from='client.34706 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]: dispatch 2024-02-05T07:21:26.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[29861]: pgmap v187: 460 pgs: 64 unknown, 396 active+clean; 592 KiB data, 514 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-05T07:21:26.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:25 smithi184 ceph-mon[29861]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81396-24"}]': finished 2024-02-05T07:21:27.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: from='client.34706 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]': finished 2024-02-05T07:21:27.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: osdmap e152: 8 total, 8 up, 8 in 2024-02-05T07:21:27.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:27.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:27.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:27.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:27.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-05T07:21:27.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: from='client.34706 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-05T07:21:27.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81396-24"}]': finished 2024-02-05T07:21:27.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: from='client.34706 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]': finished 2024-02-05T07:21:27.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: osdmap e153: 8 total, 8 up, 8 in 2024-02-05T07:21:27.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4070921786' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi184-81228-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:27.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:27.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:27.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:27.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1954746297' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi184-81207-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:27.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:26 smithi188 ceph-mon[33283]: from='client.35852 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi184-81207-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:27.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: from='client.34706 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]': finished 2024-02-05T07:21:27.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: osdmap e152: 8 total, 8 up, 8 in 2024-02-05T07:21:27.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:27.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:27.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:27.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:27.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-05T07:21:27.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: from='client.34706 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-05T07:21:27.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81396-24"}]': finished 2024-02-05T07:21:27.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: from='client.34706 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]': finished 2024-02-05T07:21:27.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: osdmap e153: 8 total, 8 up, 8 in 2024-02-05T07:21:27.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4070921786' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi184-81228-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:27.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:27.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:27.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:27.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1954746297' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi184-81207-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:27.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[29861]: from='client.35852 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi184-81207-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:27.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: from='client.34706 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pg_num","val":"11"}]': finished 2024-02-05T07:21:27.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: osdmap e152: 8 total, 8 up, 8 in 2024-02-05T07:21:27.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/216104' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:27.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:27.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: from='client.25828 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81396-24"}]: dispatch 2024-02-05T07:21:27.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:27.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-05T07:21:27.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: from='client.34706 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-05T07:21:27.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: from='client.25828 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81396-24"}]': finished 2024-02-05T07:21:27.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: from='client.34706 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi184-81303-1","var":"pgp_num","val":"11"}]': finished 2024-02-05T07:21:27.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: osdmap e153: 8 total, 8 up, 8 in 2024-02-05T07:21:27.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4070921786' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi184-81228-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:27.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:27.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:27.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:27.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1954746297' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi184-81207-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:27.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:26 smithi184 ceph-mon[41609]: from='client.35852 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi184-81207-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:27.830 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:21:27 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:21:28.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:27 smithi188 ceph-mon[33283]: pgmap v190: 452 pgs: 64 unknown, 388 active+clean; 592 KiB data, 514 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:28.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4070921786' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi184-81228-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:28.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:27 smithi188 ceph-mon[33283]: from='client.35801 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]': finished 2024-02-05T07:21:28.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:27 smithi188 ceph-mon[33283]: from='client.35852 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi184-81207-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:28.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:27 smithi188 ceph-mon[33283]: osdmap e154: 8 total, 8 up, 8 in 2024-02-05T07:21:28.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:28.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:27 smithi188 ceph-mon[33283]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:28.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:28.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1192997592' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi184-81396-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:28.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:27 smithi188 ceph-mon[33283]: from='client.25864 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi184-81396-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[29861]: pgmap v190: 452 pgs: 64 unknown, 388 active+clean; 592 KiB data, 514 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4070921786' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi184-81228-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[29861]: from='client.35801 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]': finished 2024-02-05T07:21:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[29861]: from='client.35852 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi184-81207-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[29861]: osdmap e154: 8 total, 8 up, 8 in 2024-02-05T07:21:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:28.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[29861]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:28.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:28.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1192997592' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi184-81396-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:28.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[29861]: from='client.25864 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi184-81396-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[41609]: pgmap v190: 452 pgs: 64 unknown, 388 active+clean; 592 KiB data, 514 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4070921786' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi184-81228-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[41609]: from='client.35801 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi184-81609-16"}]': finished 2024-02-05T07:21:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[41609]: from='client.35852 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi184-81207-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[41609]: osdmap e154: 8 total, 8 up, 8 in 2024-02-05T07:21:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3620880958' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:28.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[41609]: from='client.35801 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi184-81609-16"}]: dispatch 2024-02-05T07:21:28.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:28.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1192997592' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi184-81396-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:28.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:27 smithi184 ceph-mon[41609]: from='client.25864 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi184-81396-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:29.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:28 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:29.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:28 smithi188 ceph-mon[33283]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:29.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:28 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:21:29.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:28 smithi188 ceph-mon[33283]: from='client.35801 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi184-81609-16"}]': finished 2024-02-05T07:21:29.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:28 smithi188 ceph-mon[33283]: from='client.25864 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi184-81396-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:29.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:28 smithi188 ceph-mon[33283]: osdmap e155: 8 total, 8 up, 8 in 2024-02-05T07:21:29.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:29.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:28 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:29.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:28 smithi184 ceph-mon[29861]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:28 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:21:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:28 smithi184 ceph-mon[29861]: from='client.35801 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi184-81609-16"}]': finished 2024-02-05T07:21:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:28 smithi184 ceph-mon[29861]: from='client.25864 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi184-81396-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:28 smithi184 ceph-mon[29861]: osdmap e155: 8 total, 8 up, 8 in 2024-02-05T07:21:29.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:29.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:28 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:29.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:28 smithi184 ceph-mon[41609]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:29.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:28 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:21:29.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:28 smithi184 ceph-mon[41609]: from='client.35801 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi184-81609-16"}]': finished 2024-02-05T07:21:29.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:28 smithi184 ceph-mon[41609]: from='client.25864 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi184-81396-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:29.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:28 smithi184 ceph-mon[41609]: osdmap e155: 8 total, 8 up, 8 in 2024-02-05T07:21:29.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi184-81207-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi184-81207-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: pgmap v193: 420 pgs: 32 unknown, 388 active+clean; 592 KiB data, 550 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 8 op/s; 31 B/s, 0 objects/s recovering 2024-02-05T07:21:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-02-05T07:21:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.25870 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi184-81207-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.35867 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:30.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-02-05T07:21:30.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi184-81207-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: osdmap e156: 8 total, 8 up, 8 in 2024-02-05T07:21:30.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2930261548' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi184-81228-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:30.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:30.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi184-81207-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:30 smithi188 ceph-mon[33283]: from='client.35864 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi184-81228-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi184-81207-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi184-81207-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:30.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: pgmap v193: 420 pgs: 32 unknown, 388 active+clean; 592 KiB data, 550 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 8 op/s; 31 B/s, 0 objects/s recovering 2024-02-05T07:21:30.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-02-05T07:21:30.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.25870 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi184-81207-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:30.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.35867 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:30.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-02-05T07:21:30.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi184-81207-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:30.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi184-81207-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:30.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:30.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:30.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: pgmap v193: 420 pgs: 32 unknown, 388 active+clean; 592 KiB data, 550 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.2 KiB/s wr, 8 op/s; 31 B/s, 0 objects/s recovering 2024-02-05T07:21:30.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-02-05T07:21:30.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.25870 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi184-81207-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:30.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.35867 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:30.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-02-05T07:21:30.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi184-81207-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: osdmap e156: 8 total, 8 up, 8 in 2024-02-05T07:21:30.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2930261548' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi184-81228-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:30.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:30.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi184-81207-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.525 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[29861]: from='client.35864 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi184-81228-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:30.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi184-81207-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: osdmap e156: 8 total, 8 up, 8 in 2024-02-05T07:21:30.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2930261548' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi184-81228-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:30.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:30.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi184-81207-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:30.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:30.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:30 smithi184 ceph-mon[41609]: from='client.35864 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi184-81228-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:32.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:31 smithi188 ceph-mon[33283]: from='client.35864 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi184-81228-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:32.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:32.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:31 smithi188 ceph-mon[33283]: pgmap v196: 452 pgs: 64 unknown, 388 active+clean; 592 KiB data, 550 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-02-05T07:21:32.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:31 smithi188 ceph-mon[33283]: osdmap e157: 8 total, 8 up, 8 in 2024-02-05T07:21:32.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3697829394' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi184-81396-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:32.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:31 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:21:32.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:31 smithi188 ceph-mon[33283]: from='client.25876 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi184-81396-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:32.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:21:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:21:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:21:32.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:31 smithi184 ceph-mon[29861]: from='client.35864 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi184-81228-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:32.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:32.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:31 smithi184 ceph-mon[29861]: pgmap v196: 452 pgs: 64 unknown, 388 active+clean; 592 KiB data, 550 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-02-05T07:21:32.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:31 smithi184 ceph-mon[29861]: osdmap e157: 8 total, 8 up, 8 in 2024-02-05T07:21:32.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3697829394' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi184-81396-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:32.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:31 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:21:32.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:31 smithi184 ceph-mon[29861]: from='client.25876 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi184-81396-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:32.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:31 smithi184 ceph-mon[41609]: from='client.35864 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi184-81228-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:32.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:32.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:31 smithi184 ceph-mon[41609]: pgmap v196: 452 pgs: 64 unknown, 388 active+clean; 592 KiB data, 550 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s; 31 B/s, 0 objects/s recovering 2024-02-05T07:21:32.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:31 smithi184 ceph-mon[41609]: osdmap e157: 8 total, 8 up, 8 in 2024-02-05T07:21:32.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3697829394' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi184-81396-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:32.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:31 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:21:32.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:31 smithi184 ceph-mon[41609]: from='client.25876 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi184-81396-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:33.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:32 smithi188 ceph-mon[33283]: from='client.25870 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi184-81207-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi184-81207-27"}]': finished 2024-02-05T07:21:33.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:32 smithi188 ceph-mon[33283]: from='client.35867 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]': finished 2024-02-05T07:21:33.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:32 smithi188 ceph-mon[33283]: from='client.25876 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi184-81396-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:33.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:32 smithi188 ceph-mon[33283]: osdmap e158: 8 total, 8 up, 8 in 2024-02-05T07:21:33.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:33.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:32 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:21:33.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:32 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:21:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:32 smithi188 ceph-mon[33283]: pgmap v198: 435 pgs: 48 unknown, 387 active+clean; 592 KiB data, 550 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:32 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:21:33.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[29861]: from='client.25870 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi184-81207-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi184-81207-27"}]': finished 2024-02-05T07:21:33.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[29861]: from='client.35867 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]': finished 2024-02-05T07:21:33.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[29861]: from='client.25876 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi184-81396-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:33.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[29861]: osdmap e158: 8 total, 8 up, 8 in 2024-02-05T07:21:33.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:33.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:21:33.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:21:33.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[29861]: pgmap v198: 435 pgs: 48 unknown, 387 active+clean; 592 KiB data, 550 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:33.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:21:33.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[41609]: from='client.25870 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi184-81207-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi184-81207-27"}]': finished 2024-02-05T07:21:33.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[41609]: from='client.35867 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]': finished 2024-02-05T07:21:33.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[41609]: from='client.25876 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi184-81396-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:33.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[41609]: osdmap e158: 8 total, 8 up, 8 in 2024-02-05T07:21:33.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:33.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:21:33.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:21:33.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[41609]: pgmap v198: 435 pgs: 48 unknown, 387 active+clean; 592 KiB data, 550 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:33.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:32 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:21:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:33 smithi188 ceph-mon[33283]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-02-05T07:21:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:33 smithi188 ceph-mon[33283]: osdmap e159: 8 total, 8 up, 8 in 2024-02-05T07:21:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3749197556' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi184-81228-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:34.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:33 smithi184 ceph-mon[29861]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-02-05T07:21:34.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:33 smithi184 ceph-mon[29861]: osdmap e159: 8 total, 8 up, 8 in 2024-02-05T07:21:34.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:34.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3749197556' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi184-81228-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:34.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:33 smithi184 ceph-mon[41609]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-02-05T07:21:34.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:33 smithi184 ceph-mon[41609]: osdmap e159: 8 total, 8 up, 8 in 2024-02-05T07:21:34.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:34.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3749197556' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi184-81228-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3749197556' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi184-81228-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:34 smithi188 ceph-mon[33283]: osdmap e160: 8 total, 8 up, 8 in 2024-02-05T07:21:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2160256085' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi184-81396-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:34 smithi188 ceph-mon[33283]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:34 smithi188 ceph-mon[33283]: from='client.35885 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi184-81396-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:34 smithi188 ceph-mon[33283]: pgmap v201: 459 pgs: 8 creating+peering, 1 peering, 64 unknown, 386 active+clean; 591 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-05T07:21:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3749197556' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi184-81228-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[29861]: osdmap e160: 8 total, 8 up, 8 in 2024-02-05T07:21:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2160256085' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi184-81396-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[29861]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[29861]: from='client.35885 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi184-81396-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[29861]: pgmap v201: 459 pgs: 8 creating+peering, 1 peering, 64 unknown, 386 active+clean; 591 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-05T07:21:35.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3749197556' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi184-81228-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[41609]: osdmap e160: 8 total, 8 up, 8 in 2024-02-05T07:21:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2160256085' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi184-81396-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[41609]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[41609]: from='client.35885 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi184-81396-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:34 smithi184 ceph-mon[41609]: pgmap v201: 459 pgs: 8 creating+peering, 1 peering, 64 unknown, 386 active+clean; 591 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-05T07:21:35.857 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosS api_aio: Running main() from gmock_main.cc 2024-02-05T07:21:35.858 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2024-02-05T07:21:35.858 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [----------] Global test environment set-up. 2024-02-05T07:21:35.858 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [----------] 26 tests from LibRadosAio 2024-02-05T07:21:35.858 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-02-05T07:21:35.858 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.TooBig (10391 ms) 2024-02-05T07:21:35.858 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-02-05T07:21:35.858 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (6080 ms) 2024-02-05T07:21:35.858 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-02-05T07:21:35.858 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (5036 ms) 2024-02-05T07:21:35.858 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-02-05T07:21:35.858 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (2805 ms) 2024-02-05T07:21:35.858 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-02-05T07:21:35.858 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (2824 ms) 2024-02-05T07:21:35.858 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-02-05T07:21:35.859 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (3035 ms) 2024-02-05T07:21:35.859 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-02-05T07:21:35.859 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (2988 ms) 2024-02-05T07:21:35.859 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-02-05T07:21:35.859 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (2963 ms) 2024-02-05T07:21:35.859 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-02-05T07:21:35.859 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (3020 ms) 2024-02-05T07:21:35.859 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-02-05T07:21:35.859 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (3288 ms) 2024-02-05T07:21:35.859 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-02-05T07:21:35.859 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (2799 ms) 2024-02-05T07:21:35.859 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-02-05T07:21:35.859 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (2905 ms) 2024-02-05T07:21:35.859 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-02-05T07:21:35.860 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (3012 ms) 2024-02-05T07:21:35.860 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-02-05T07:21:35.860 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3000 ms) 2024-02-05T07:21:35.860 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-02-05T07:21:35.860 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.Flush (3242 ms) 2024-02-05T07:21:35.860 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-02-05T07:21:35.860 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (2767 ms) 2024-02-05T07:21:35.860 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-02-05T07:21:35.860 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3041 ms) 2024-02-05T07:21:35.860 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-02-05T07:21:35.860 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (2936 ms) 2024-02-05T07:21:35.860 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-02-05T07:21:35.860 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3031 ms) 2024-02-05T07:21:35.861 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-02-05T07:21:35.861 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3014 ms) 2024-02-05T07:21:35.861 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2024-02-05T07:21:35.861 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3017 ms) 2024-02-05T07:21:35.861 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-02-05T07:21:35.861 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (3016 ms) 2024-02-05T07:21:35.861 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-02-05T07:21:35.861 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (3008 ms) 2024-02-05T07:21:35.861 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-02-05T07:21:35.861 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3017 ms) 2024-02-05T07:21:35.861 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-02-05T07:21:35.861 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (2917 ms) 2024-02-05T07:21:35.861 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-02-05T07:21:35.861 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3011 ms) 2024-02-05T07:21:35.861 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [----------] 26 tests from LibRadosAio (90164 ms total) 2024-02-05T07:21:35.862 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: 2024-02-05T07:21:35.862 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-02-05T07:21:35.862 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWrite 2024-02-05T07:21:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:35 smithi188 ceph-mon[33283]: from='client.25870 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi184-81207-27"}]': finished 2024-02-05T07:21:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:35 smithi188 ceph-mon[33283]: from='client.35885 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi184-81396-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:35 smithi188 ceph-mon[33283]: osdmap e161: 8 total, 8 up, 8 in 2024-02-05T07:21:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:35 smithi188 ceph-mon[33283]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:36.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:35 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[29861]: from='client.25870 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi184-81207-27"}]': finished 2024-02-05T07:21:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[29861]: from='client.35885 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi184-81396-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[29861]: osdmap e161: 8 total, 8 up, 8 in 2024-02-05T07:21:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[29861]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:36.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[41609]: from='client.25870 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi184-81207-27"}]': finished 2024-02-05T07:21:36.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[41609]: from='client.35885 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi184-81396-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:36.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[41609]: osdmap e161: 8 total, 8 up, 8 in 2024-02-05T07:21:36.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2910296727' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:36.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[41609]: from='client.25870 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi184-81207-27"}]: dispatch 2024-02-05T07:21:36.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:36.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:35 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.25870 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi184-81207-27"}]': finished 2024-02-05T07:21:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:21:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13"}]: dispatch 2024-02-05T07:21:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: osdmap e162: 8 total, 8 up, 8 in 2024-02-05T07:21:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3943797673' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi184-81228-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13"}]: dispatch 2024-02-05T07:21:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.35888 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi184-81228-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi184-81396-36"}]: dispatch 2024-02-05T07:21:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi184-81207-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi184-81396-36"}]: dispatch 2024-02-05T07:21:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi184-81207-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi184-81396-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: pgmap v204: 427 pgs: 8 creating+peering, 1 peering, 32 unknown, 386 active+clean; 591 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s; 31 B/s, 0 objects/s recovering 2024-02-05T07:21:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.25870 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi184-81207-27"}]': finished 2024-02-05T07:21:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:21:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13"}]: dispatch 2024-02-05T07:21:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: osdmap e162: 8 total, 8 up, 8 in 2024-02-05T07:21:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3943797673' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi184-81228-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13"}]: dispatch 2024-02-05T07:21:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.35888 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi184-81228-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi184-81396-36"}]: dispatch 2024-02-05T07:21:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi184-81207-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi184-81396-36"}]: dispatch 2024-02-05T07:21:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi184-81207-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi184-81396-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: pgmap v204: 427 pgs: 8 creating+peering, 1 peering, 32 unknown, 386 active+clean; 591 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s; 31 B/s, 0 objects/s recovering 2024-02-05T07:21:37.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:37.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:37.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.25870 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi184-81207-27"}]': finished 2024-02-05T07:21:37.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:21:37.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13"}]: dispatch 2024-02-05T07:21:37.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: osdmap e162: 8 total, 8 up, 8 in 2024-02-05T07:21:37.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3943797673' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi184-81228-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:37.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13"}]: dispatch 2024-02-05T07:21:37.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.35888 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi184-81228-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:37.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:37.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:37.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi184-81396-36"}]: dispatch 2024-02-05T07:21:37.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:37.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:37.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi184-81207-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:37.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi184-81396-36"}]: dispatch 2024-02-05T07:21:37.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi184-81207-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:37.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi184-81396-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:37.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: pgmap v204: 427 pgs: 8 creating+peering, 1 peering, 32 unknown, 386 active+clean; 591 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s; 31 B/s, 0 objects/s recovering 2024-02-05T07:21:37.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:37.838 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:21:37 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:21:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:21:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13"}]': finished 2024-02-05T07:21:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[29861]: from='client.35888 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi184-81228-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[29861]: from='client.25903 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi184-81207-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi184-81396-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi184-81207-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[29861]: osdmap e163: 8 total, 8 up, 8 in 2024-02-05T07:21:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi184-81396-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi184-81396-36"}]: dispatch 2024-02-05T07:21:38.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[29861]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi184-81207-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:38.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:21:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13"}]': finished 2024-02-05T07:21:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[41609]: from='client.35888 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi184-81228-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[41609]: from='client.25903 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi184-81207-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi184-81396-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi184-81207-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[41609]: osdmap e163: 8 total, 8 up, 8 in 2024-02-05T07:21:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi184-81396-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi184-81396-36"}]: dispatch 2024-02-05T07:21:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[41609]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi184-81207-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:38.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:38.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:37 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:21:38.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:37 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-13"}]': finished 2024-02-05T07:21:38.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:37 smithi188 ceph-mon[33283]: from='client.35888 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi184-81228-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:38.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:37 smithi188 ceph-mon[33283]: from='client.25903 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi184-81207-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:38.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi184-81396-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:38.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi184-81207-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:38.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:37 smithi188 ceph-mon[33283]: osdmap e163: 8 total, 8 up, 8 in 2024-02-05T07:21:38.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi184-81396-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi184-81396-36"}]: dispatch 2024-02-05T07:21:38.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:37 smithi188 ceph-mon[33283]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi184-81207-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:38.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:38 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:38 smithi188 ceph-mon[33283]: pgmap v207: 363 pgs: 363 active+clean; 609 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-02-05T07:21:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:38 smithi188 ceph-mon[33283]: osdmap e164: 8 total, 8 up, 8 in 2024-02-05T07:21:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-02-05T07:21:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:39.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:38 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:39.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:38 smithi184 ceph-mon[41609]: pgmap v207: 363 pgs: 363 active+clean; 609 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-02-05T07:21:39.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:38 smithi184 ceph-mon[41609]: osdmap e164: 8 total, 8 up, 8 in 2024-02-05T07:21:39.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-02-05T07:21:39.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:38 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:39.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:38 smithi184 ceph-mon[29861]: pgmap v207: 363 pgs: 363 active+clean; 609 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-02-05T07:21:39.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:38 smithi184 ceph-mon[29861]: osdmap e164: 8 total, 8 up, 8 in 2024-02-05T07:21:39.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-02-05T07:21:39.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:40.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:39 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:40.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi184-81396-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi184-81396-36"}]': finished 2024-02-05T07:21:40.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:39 smithi188 ceph-mon[33283]: from='client.25903 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi184-81207-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi184-81207-28"}]': finished 2024-02-05T07:21:40.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:39 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-02-05T07:21:40.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:39 smithi188 ceph-mon[33283]: osdmap e165: 8 total, 8 up, 8 in 2024-02-05T07:21:40.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:40.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:39 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:40.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4273453446' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi184-81228-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:40.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:39 smithi188 ceph-mon[33283]: from='client.35903 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi184-81228-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:40.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:39 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:40.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:39 smithi188 ceph-mon[33283]: from='client.35903 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi184-81228-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:40.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:39 smithi188 ceph-mon[33283]: osdmap e166: 8 total, 8 up, 8 in 2024-02-05T07:21:40.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi184-81396-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi184-81396-36"}]': finished 2024-02-05T07:21:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[29861]: from='client.25903 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi184-81207-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi184-81207-28"}]': finished 2024-02-05T07:21:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-02-05T07:21:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[29861]: osdmap e165: 8 total, 8 up, 8 in 2024-02-05T07:21:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4273453446' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi184-81228-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[29861]: from='client.35903 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi184-81228-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[29861]: from='client.35903 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi184-81228-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:40.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[29861]: osdmap e166: 8 total, 8 up, 8 in 2024-02-05T07:21:40.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:40.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:40.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi184-81396-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi184-81396-36"}]': finished 2024-02-05T07:21:40.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[41609]: from='client.25903 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi184-81207-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi184-81207-28"}]': finished 2024-02-05T07:21:40.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi184-81303-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-02-05T07:21:40.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[41609]: osdmap e165: 8 total, 8 up, 8 in 2024-02-05T07:21:40.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:40.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:40.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4273453446' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi184-81228-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:40.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[41609]: from='client.35903 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi184-81228-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:40.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:40.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[41609]: from='client.35903 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi184-81228-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:40.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[41609]: osdmap e166: 8 total, 8 up, 8 in 2024-02-05T07:21:40.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3711060025' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-05T07:21:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:41 smithi188 ceph-mon[33283]: pgmap v210: 443 pgs: 80 unknown, 363 active+clean; 609 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-02-05T07:21:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:41 smithi188 ceph-mon[33283]: osdmap e167: 8 total, 8 up, 8 in 2024-02-05T07:21:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:41 smithi188 ceph-mon[33283]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi184-81396-36"}]: dispatch 2024-02-05T07:21:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi184-81303-2"}]: dispatch 2024-02-05T07:21:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:41 smithi184 ceph-mon[29861]: pgmap v210: 443 pgs: 80 unknown, 363 active+clean; 609 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-02-05T07:21:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:41 smithi184 ceph-mon[29861]: osdmap e167: 8 total, 8 up, 8 in 2024-02-05T07:21:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:41 smithi184 ceph-mon[29861]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi184-81396-36"}]: dispatch 2024-02-05T07:21:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi184-81303-2"}]: dispatch 2024-02-05T07:21:41.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:41 smithi184 ceph-mon[41609]: pgmap v210: 443 pgs: 80 unknown, 363 active+clean; 609 KiB data, 606 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s wr, 1 op/s 2024-02-05T07:21:41.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:41 smithi184 ceph-mon[41609]: osdmap e167: 8 total, 8 up, 8 in 2024-02-05T07:21:41.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:41.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:41 smithi184 ceph-mon[41609]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:41.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi184-81396-36"}]: dispatch 2024-02-05T07:21:41.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi184-81303-2"}]: dispatch 2024-02-05T07:21:42.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:21:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:21:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:21:42.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:42.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi184-81303-2"}]: dispatch 2024-02-05T07:21:42.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:42.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi184-81303-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:42.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.25903 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi184-81207-28"}]': finished 2024-02-05T07:21:42.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi184-81396-36"}]': finished 2024-02-05T07:21:42.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:21:42.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi184-81303-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:42.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: osdmap e168: 8 total, 8 up, 8 in 2024-02-05T07:21:42.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:42.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-15"}]: dispatch 2024-02-05T07:21:42.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi184-81396-36"}]: dispatch 2024-02-05T07:21:42.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi184-81303-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi184-81303-2"}]: dispatch 2024-02-05T07:21:42.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-15"}]: dispatch 2024-02-05T07:21:42.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:42.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3880280657' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi184-81228-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:42.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[29861]: from='client.35912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi184-81228-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:42.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:42.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi184-81303-2"}]: dispatch 2024-02-05T07:21:42.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:42.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi184-81303-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:42.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.25903 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi184-81207-28"}]': finished 2024-02-05T07:21:42.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi184-81396-36"}]': finished 2024-02-05T07:21:42.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:21:42.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi184-81303-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:42.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: osdmap e168: 8 total, 8 up, 8 in 2024-02-05T07:21:42.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:42.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-15"}]: dispatch 2024-02-05T07:21:42.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi184-81396-36"}]: dispatch 2024-02-05T07:21:42.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi184-81303-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi184-81303-2"}]: dispatch 2024-02-05T07:21:42.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-15"}]: dispatch 2024-02-05T07:21:42.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:42.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3880280657' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi184-81228-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:42.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:42 smithi184 ceph-mon[41609]: from='client.35912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi184-81228-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi184-81303-2"}]: dispatch 2024-02-05T07:21:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi184-81303-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.25903 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi184-81207-28"}]': finished 2024-02-05T07:21:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi184-81396-36"}]': finished 2024-02-05T07:21:42.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:21:42.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi184-81303-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:42.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: osdmap e168: 8 total, 8 up, 8 in 2024-02-05T07:21:42.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3920440392' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:42.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-15"}]: dispatch 2024-02-05T07:21:42.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi184-81396-36"}]: dispatch 2024-02-05T07:21:42.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi184-81303-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi184-81303-2"}]: dispatch 2024-02-05T07:21:42.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-15"}]: dispatch 2024-02-05T07:21:42.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.25903 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi184-81207-28"}]: dispatch 2024-02-05T07:21:42.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3880280657' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi184-81228-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:42.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:42 smithi188 ceph-mon[33283]: from='client.35912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi184-81228-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:43.058 INFO:tasks.workunit.client.0.smithi184.stdout: (67451 ms total) 2024-02-05T07:21:43.059 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: 2024-02-05T07:21:43.059 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-02-05T07:21:43.059 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-02-05T07:21:43.059 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (107 ms) 2024-02-05T07:21:43.059 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (107 ms total) 2024-02-05T07:21:43.059 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: 2024-02-05T07:21:43.059 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-02-05T07:21:43.059 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-02-05T07:21:43.059 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (65 ms) 2024-02-05T07:21:43.059 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-02-05T07:21:43.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (6 ms) 2024-02-05T07:21:43.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (71 ms total) 2024-02-05T07:21:43.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: 2024-02-05T07:21:43.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-02-05T07:21:43.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-02-05T07:21:43.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (49 ms) 2024-02-05T07:21:43.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-02-05T07:21:43.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (6 ms) 2024-02-05T07:21:43.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (55 ms total) 2024-02-05T07:21:43.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: 2024-02-05T07:21:43.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-02-05T07:21:43.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-02-05T07:21:43.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (49 ms) 2024-02-05T07:21:43.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-02-05T07:21:43.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (8 ms) 2024-02-05T07:21:43.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (57 ms total) 2024-02-05T07:21:43.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: 2024-02-05T07:21:43.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-02-05T07:21:43.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-02-05T07:21:43.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (965 ms) 2024-02-05T07:21:43.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (965 ms total) 2024-02-05T07:21:43.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: 2024-02-05T07:21:43.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-02-05T07:21:43.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (104329 ms total) 2024-02-05T07:21:43.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-02-05T07:21:43.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: pgmap v213: 396 pgs: 64 unknown, 332 active+clean; 607 KiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:43.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi184-81396-36"}]': finished 2024-02-05T07:21:43.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-15"}]': finished 2024-02-05T07:21:43.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: from='client.25903 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi184-81207-28"}]': finished 2024-02-05T07:21:43.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: from='client.35912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi184-81228-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:43.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-15", "mode": "writeback"}]: dispatch 2024-02-05T07:21:43.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:43.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: osdmap e169: 8 total, 8 up, 8 in 2024-02-05T07:21:43.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-15", "mode": "writeback"}]: dispatch 2024-02-05T07:21:43.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:43.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:43.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:43.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi184-81207-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:43.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:21:43.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi184-81207-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:43.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:43 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:21:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: pgmap v213: 396 pgs: 64 unknown, 332 active+clean; 607 KiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi184-81396-36"}]': finished 2024-02-05T07:21:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-15"}]': finished 2024-02-05T07:21:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: from='client.25903 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi184-81207-28"}]': finished 2024-02-05T07:21:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: from='client.35912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi184-81228-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-15", "mode": "writeback"}]: dispatch 2024-02-05T07:21:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: osdmap e169: 8 total, 8 up, 8 in 2024-02-05T07:21:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-15", "mode": "writeback"}]: dispatch 2024-02-05T07:21:43.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:43.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:43.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:43.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi184-81207-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:43.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:21:43.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi184-81207-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:43.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:21:43.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: pgmap v213: 396 pgs: 64 unknown, 332 active+clean; 607 KiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:43.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1216500909' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi184-81396-36"}]': finished 2024-02-05T07:21:43.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-15"}]': finished 2024-02-05T07:21:43.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: from='client.25903 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi184-81207-28"}]': finished 2024-02-05T07:21:43.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: from='client.35912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi184-81228-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:43.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-15", "mode": "writeback"}]: dispatch 2024-02-05T07:21:43.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:43.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: osdmap e169: 8 total, 8 up, 8 in 2024-02-05T07:21:43.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-15", "mode": "writeback"}]: dispatch 2024-02-05T07:21:43.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:43.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:43.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:43.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi184-81207-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:43.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:21:43.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi184-81207-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:43.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:43 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:21:44.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:44 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:21:44.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:44 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi184-81303-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi184-81303-2"}]': finished 2024-02-05T07:21:44.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:44 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-15", "mode": "writeback"}]': finished 2024-02-05T07:21:44.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:44 smithi188 ceph-mon[33283]: from='client.35921 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi184-81207-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:44.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:44 smithi188 ceph-mon[33283]: osdmap e170: 8 total, 8 up, 8 in 2024-02-05T07:21:44.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:44 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi184-81207-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:44.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:44 smithi188 ceph-mon[33283]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi184-81207-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:44.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:44 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:21:44.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:44 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi184-81303-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi184-81303-2"}]': finished 2024-02-05T07:21:44.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:44 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-15", "mode": "writeback"}]': finished 2024-02-05T07:21:44.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:44 smithi184 ceph-mon[29861]: from='client.35921 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi184-81207-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:44.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:44 smithi184 ceph-mon[29861]: osdmap e170: 8 total, 8 up, 8 in 2024-02-05T07:21:44.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:44 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi184-81207-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:44.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:44 smithi184 ceph-mon[29861]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi184-81207-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:44.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:44 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:21:44.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:44 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi184-81303-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi184-81303-2"}]': finished 2024-02-05T07:21:44.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:44 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-15", "mode": "writeback"}]': finished 2024-02-05T07:21:44.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:44 smithi184 ceph-mon[41609]: from='client.35921 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi184-81207-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:44.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:44 smithi184 ceph-mon[41609]: osdmap e170: 8 total, 8 up, 8 in 2024-02-05T07:21:44.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:44 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi184-81207-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:44.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:44 smithi184 ceph-mon[41609]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi184-81207-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:44.880 INFO:tasks.workunit.client.0.smithi184.stdout:: : entry=13 expected=13 2024-02-05T07:21:44.880 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:52ea6a34:::10:head 2024-02-05T07:21:44.880 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:52ea6a34:::10:head expected=14:52ea6a34:::10:head 2024-02-05T07:21:44.880 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:52ea6a34:::10:head -> 10 2024-02-05T07:21:44.880 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : entry=10 expected=10 2024-02-05T07:21:44.880 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:6cac518f:::0:head 2024-02-05T07:21:44.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:6cac518f:::0:head expected=14:6cac518f:::0:head 2024-02-05T07:21:44.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:6cac518f:::0:head -> 0 2024-02-05T07:21:44.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : entry=0 expected=0 2024-02-05T07:21:44.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:62a1935d:::14:head 2024-02-05T07:21:44.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:62a1935d:::14:head expected=14:62a1935d:::14:head 2024-02-05T07:21:44.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:62a1935d:::14:head -> 14 2024-02-05T07:21:44.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : entry=14 expected=14 2024-02-05T07:21:44.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:5c6b0b28:::7:head 2024-02-05T07:21:44.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:5c6b0b28:::7:head expected=14:5c6b0b28:::7:head 2024-02-05T07:21:44.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:5c6b0b28:::7:head -> 7 2024-02-05T07:21:44.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : entry=7 expected=7 2024-02-05T07:21:44.881 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:c4fdafeb:::6:head 2024-02-05T07:21:44.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:c4fdafeb:::6:head expected=14:c4fdafeb:::6:head 2024-02-05T07:21:44.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:c4fdafeb:::6:head -> 6 2024-02-05T07:21:44.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : entry=6 expected=6 2024-02-05T07:21:44.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:bd63b0f1:::8:head 2024-02-05T07:21:44.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:bd63b0f1:::8:head expected=14:bd63b0f1:::8:head 2024-02-05T07:21:44.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:bd63b0f1:::8:head -> 8 2024-02-05T07:21:44.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : entry=8 expected=8 2024-02-05T07:21:44.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:b29083e3:::5:head 2024-02-05T07:21:44.882 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:b29083e3:::5:head expected=14:b29083e3:::5:head 2024-02-05T07:21:44.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:b29083e3:::5:head -> 5 2024-02-05T07:21:44.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : entry=5 expected=5 2024-02-05T07:21:44.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : seek to 14:02547ec2:::1:head 2024-02-05T07:21:44.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : cursor()=14:02547ec2:::1:head expected=14:02547ec2:::1:head 2024-02-05T07:21:44.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: > 14:02547ec2:::1:head -> 1 2024-02-05T07:21:44.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: : entry=1 expected=1 2024-02-05T07:21:44.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (244 ms) 2024-02-05T07:21:44.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-02-05T07:21:44.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (75609 ms) 2024-02-05T07:21:44.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-02-05T07:21:44.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: split 0/5 -> MIN 14:33333333::::head 2024-02-05T07:21:44.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: split 1/5 -> 14:33333333::::head 14:66666666::::head 2024-02-05T07:21:44.883 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: split 2/5 -> 14:66666666::::head 14:99999999::::head 2024-02-05T07:21:44.884 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: split 3/5 -> 14:99999999::::head 14:cccccccc::::head 2024-02-05T07:21:44.884 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: split 4/5 -> 14:cccccccc::::head MAX 2024-02-05T07:21:44.884 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (15014 ms) 2024-02-05T07:21:44.884 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [----------] 7 tests from LibRadosList (91474 ms total) 2024-02-05T07:21:44.884 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 2024-02-05T07:21:44.884 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-02-05T07:21:44.884 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-02-05T07:21:44.884 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1039 ms) 2024-02-05T07:21:44.884 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-02-05T07:21:44.884 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: myset foo1,foo2,foo3 2024-02-05T07:21:44.885 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo1 2024-02-05T07:21:44.885 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo2 2024-02-05T07:21:44.885 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo3 2024-02-05T07:21:44.885 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: myset foo1,foo4,foo5 2024-02-05T07:21:44.885 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo4 2024-02-05T07:21:44.885 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo5 2024-02-05T07:21:44.885 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo1 2024-02-05T07:21:44.885 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: myset foo6,foo7 2024-02-05T07:21:44.885 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo7 2024-02-05T07:21:44.885 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: foo6 2024-02-05T07:21:44.885 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-02-05T07:21:44.886 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: ns1:foo4 2024-02-05T07:21:44.886 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: ns1:foo5 2024-02-05T07:21:44.886 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: ns2:foo7 2024-02-05T07:21:44.886 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: ns2:foo6 2024-02-05T07:21:44.886 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: ns1:foo1 2024-02-05T07:21:44.886 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: :foo1 2024-02-05T07:21:44.887 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: :foo2 2024-02-05T07:21:44.887 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: :foo3 2024-02-05T07:21:44.887 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (32 ms) 2024-02-05T07:21:45.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:45 smithi188 ceph-mon[33283]: pgmap v216: 372 pgs: 8 unknown, 364 active+clean; 615 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 2 op/s 2024-02-05T07:21:45.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:45 smithi188 ceph-mon[33283]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:45.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:45 smithi188 ceph-mon[33283]: osdmap e171: 8 total, 8 up, 8 in 2024-02-05T07:21:45.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:45.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2825915030' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi184-81228-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:45.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:45 smithi188 ceph-mon[33283]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:45.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:45 smithi188 ceph-mon[33283]: from='client.35927 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi184-81228-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:45.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:45.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:45 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[41609]: pgmap v216: 372 pgs: 8 unknown, 364 active+clean; 615 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 2 op/s 2024-02-05T07:21:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[41609]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[41609]: osdmap e171: 8 total, 8 up, 8 in 2024-02-05T07:21:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2825915030' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi184-81228-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[41609]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[41609]: from='client.35927 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi184-81228-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:45.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[29861]: pgmap v216: 372 pgs: 8 unknown, 364 active+clean; 615 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 2 op/s 2024-02-05T07:21:45.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[29861]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:45.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[29861]: osdmap e171: 8 total, 8 up, 8 in 2024-02-05T07:21:45.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:45.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2825915030' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi184-81228-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:45.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[29861]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:45.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[29861]: from='client.35927 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi184-81228-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:45.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:45.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:45 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:46.830 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ RUN ] LibRadosListEC.LisnapshotsECPP.SnapRemovePP (2016 ms) 2024-02-05T07:21:46.830 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-02-05T07:21:46.830 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2016 ms) 2024-02-05T07:21:46.830 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-02-05T07:21:46.830 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (1902 ms) 2024-02-05T07:21:46.830 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8942 ms total) 2024-02-05T07:21:46.830 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: 2024-02-05T07:21:46.830 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-02-05T07:21:46.830 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-02-05T07:21:46.831 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4063 ms) 2024-02-05T07:21:46.831 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-02-05T07:21:46.831 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3908 ms) 2024-02-05T07:21:46.831 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-02-05T07:21:46.831 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (4021 ms) 2024-02-05T07:21:46.831 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (11992 ms total) 2024-02-05T07:21:46.831 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: 2024-02-05T07:21:46.831 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-02-05T07:21:46.831 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (108047 ms total) 2024-02-05T07:21:46.831 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-02-05T07:21:46.831 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2024-02-05T07:21:46.831 INFO:tasks.workunit.client.0.smithi184.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-02-05T07:21:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:46 smithi188 ceph-mon[33283]: from='client.35921 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi184-81207-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi184-81207-29"}]': finished 2024-02-05T07:21:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:46 smithi188 ceph-mon[33283]: from='client.35867 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]': finished 2024-02-05T07:21:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:46 smithi188 ceph-mon[33283]: from='client.35927 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi184-81228-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:46 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:21:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:46 smithi188 ceph-mon[33283]: osdmap e172: 8 total, 8 up, 8 in 2024-02-05T07:21:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15"}]: dispatch 2024-02-05T07:21:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:46 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15"}]: dispatch 2024-02-05T07:21:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:46 smithi188 ceph-mon[33283]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi184-81303-2"}]: dispatch 2024-02-05T07:21:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:46 smithi188 ceph-mon[33283]: pgmap v219: 396 pgs: 40 unknown, 356 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-02-05T07:21:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[41609]: from='client.35921 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi184-81207-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi184-81207-29"}]': finished 2024-02-05T07:21:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[41609]: from='client.35867 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]': finished 2024-02-05T07:21:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[41609]: from='client.35927 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi184-81228-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:21:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[41609]: osdmap e172: 8 total, 8 up, 8 in 2024-02-05T07:21:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15"}]: dispatch 2024-02-05T07:21:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15"}]: dispatch 2024-02-05T07:21:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[41609]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi184-81303-2"}]: dispatch 2024-02-05T07:21:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[41609]: pgmap v219: 396 pgs: 40 unknown, 356 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-02-05T07:21:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[29861]: from='client.35921 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi184-81207-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi184-81207-29"}]': finished 2024-02-05T07:21:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[29861]: from='client.35867 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]': finished 2024-02-05T07:21:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[29861]: from='client.35927 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi184-81228-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:21:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[29861]: osdmap e172: 8 total, 8 up, 8 in 2024-02-05T07:21:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15"}]: dispatch 2024-02-05T07:21:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2777489173' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15"}]: dispatch 2024-02-05T07:21:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[29861]: from='client.35867 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]: dispatch 2024-02-05T07:21:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi184-81303-2"}]: dispatch 2024-02-05T07:21:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:46 smithi184 ceph-mon[29861]: pgmap v219: 396 pgs: 40 unknown, 356 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-02-05T07:21:47.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:21:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:21:48.079 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:48 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:21:48.079 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:48 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15"}]': finished 2024-02-05T07:21:48.079 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:48 smithi188 ceph-mon[33283]: from='client.35867 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]': finished 2024-02-05T07:21:48.079 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:48 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi184-81303-2"}]': finished 2024-02-05T07:21:48.079 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:48 smithi188 ceph-mon[33283]: osdmap e173: 8 total, 8 up, 8 in 2024-02-05T07:21:48.079 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:48 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi184-81303-2"}]: dispatch 2024-02-05T07:21:48.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:48 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:21:48.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:48 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15"}]': finished 2024-02-05T07:21:48.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:48 smithi184 ceph-mon[29861]: from='client.35867 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]': finished 2024-02-05T07:21:48.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:48 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi184-81303-2"}]': finished 2024-02-05T07:21:48.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:48 smithi184 ceph-mon[29861]: osdmap e173: 8 total, 8 up, 8 in 2024-02-05T07:21:48.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:48 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi184-81303-2"}]: dispatch 2024-02-05T07:21:48.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:48 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:21:48.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:48 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-15"}]': finished 2024-02-05T07:21:48.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:48 smithi184 ceph-mon[41609]: from='client.35867 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi184-81609-21"}]': finished 2024-02-05T07:21:48.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:48 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi184-81303-2"}]': finished 2024-02-05T07:21:48.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:48 smithi184 ceph-mon[41609]: osdmap e173: 8 total, 8 up, 8 in 2024-02-05T07:21:48.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:48 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi184-81303-2"}]: dispatch 2024-02-05T07:21:49.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:49.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi184-81303-2"}]': finished 2024-02-05T07:21:49.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: osdmap e174: 8 total, 8 up, 8 in 2024-02-05T07:21:49.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:49.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:49.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2561024526' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi184-81228-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:49.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: pgmap v222: 356 pgs: 32 unknown, 324 active+clean; 583 KiB data, 611 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:49.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: from='client.35921 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi184-81207-29"}]': finished 2024-02-05T07:21:49.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2561024526' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi184-81228-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:49.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: osdmap e175: 8 total, 8 up, 8 in 2024-02-05T07:21:49.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:49.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:49.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2192188281' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81303-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:49.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:49.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:49.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:49 smithi188 ceph-mon[33283]: from='client.35939 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81303-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi184-81303-2"}]': finished 2024-02-05T07:21:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: osdmap e174: 8 total, 8 up, 8 in 2024-02-05T07:21:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2561024526' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi184-81228-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: pgmap v222: 356 pgs: 32 unknown, 324 active+clean; 583 KiB data, 611 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: from='client.35921 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi184-81207-29"}]': finished 2024-02-05T07:21:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2561024526' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi184-81228-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:49.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: osdmap e175: 8 total, 8 up, 8 in 2024-02-05T07:21:49.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:49.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:49.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2192188281' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81303-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:49.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:49.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:49.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[29861]: from='client.35939 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81303-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2161624928' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi184-81303-2"}]': finished 2024-02-05T07:21:49.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: osdmap e174: 8 total, 8 up, 8 in 2024-02-05T07:21:49.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:49.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:49.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2561024526' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi184-81228-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:49.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: pgmap v222: 356 pgs: 32 unknown, 324 active+clean; 583 KiB data, 611 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:49.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: from='client.35921 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi184-81207-29"}]': finished 2024-02-05T07:21:49.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2561024526' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi184-81228-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:49.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: osdmap e175: 8 total, 8 up, 8 in 2024-02-05T07:21:49.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1871636194' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:49.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:49.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2192188281' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81303-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:49.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: from='client.35921 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi184-81207-29"}]: dispatch 2024-02-05T07:21:49.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:49.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:49 smithi184 ceph-mon[41609]: from='client.35939 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81303-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:49.816 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: Running main() from gmock_main.cc 2024-02-05T07:21:49.816 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-02-05T07:21:49.816 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-02-05T07:21:49.816 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-02-05T07:21:49.816 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-02-05T07:21:49.817 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (10081 ms) 2024-02-05T07:21:49.817 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-02-05T07:21:49.817 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (23083 ms) 2024-02-05T07:21:49.817 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-02-05T07:21:49.817 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (5999 ms) 2024-02-05T07:21:49.817 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-02-05T07:21:49.817 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (3265 ms) 2024-02-05T07:21:49.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-02-05T07:21:49.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (2790 ms) 2024-02-05T07:21:49.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-02-05T07:21:49.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (2911 ms) 2024-02-05T07:21:49.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-02-05T07:21:49.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3008 ms) 2024-02-05T07:21:49.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-02-05T07:21:49.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (3012 ms) 2024-02-05T07:21:49.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-02-05T07:21:49.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3238 ms) 2024-02-05T07:21:49.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-02-05T07:21:49.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (2766 ms) 2024-02-05T07:21:49.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-02-05T07:21:49.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (3042 ms) 2024-02-05T07:21:49.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-02-05T07:21:49.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (2945 ms) 2024-02-05T07:21:49.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-02-05T07:21:49.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (3020 ms) 2024-02-05T07:21:49.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-02-05T07:21:49.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3019 ms) 2024-02-05T07:21:49.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-02-05T07:21:49.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3009 ms) 2024-02-05T07:21:49.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-02-05T07:21:49.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3017 ms) 2024-02-05T07:21:49.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-02-05T07:21:49.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (3010 ms) 2024-02-05T07:21:49.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-02-05T07:21:49.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (3017 ms) 2024-02-05T07:21:49.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-02-05T07:21:49.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (2916 ms) 2024-02-05T07:21:49.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-02-05T07:21:49.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3008 ms) 2024-02-05T07:21:49.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-02-05T07:21:49.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3019 ms) 2024-02-05T07:21:49.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-02-05T07:21:49.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (3019 ms) 2024-02-05T07:21:49.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-02-05T07:21:49.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3499 ms) 2024-02-05T07:21:49.821 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-02-05T07:21:49.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (2463 ms) 2024-02-05T07:21:49.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-02-05T07:21:49.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (3010 ms) 2024-02-05T07:21:49.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-02-05T07:21:49.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3011 ms) 2024-02-05T07:21:49.822 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-02-05T07:21:50.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:50 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:50.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:50 smithi188 ceph-mon[33283]: from='client.35921 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi184-81207-29"}]': finished 2024-02-05T07:21:50.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:50 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:50.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:50 smithi188 ceph-mon[33283]: from='client.35939 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81303-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:50.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:50 smithi188 ceph-mon[33283]: osdmap e176: 8 total, 8 up, 8 in 2024-02-05T07:21:50.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:50.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:50 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:50.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2192188281' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi184-81303-3","pool2":"test-rados-api-smithi184-81303-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-05T07:21:50.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:50 smithi188 ceph-mon[33283]: from='client.35939 ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi184-81303-3","pool2":"test-rados-api-smithi184-81303-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-05T07:21:50.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:50.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:50 smithi188 ceph-mon[33283]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:50.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:50.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:50 smithi188 ceph-mon[33283]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:50.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi184-81207-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:50.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:50 smithi188 ceph-mon[33283]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi184-81207-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[29861]: from='client.35921 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi184-81207-29"}]': finished 2024-02-05T07:21:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[29861]: from='client.35939 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81303-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[29861]: osdmap e176: 8 total, 8 up, 8 in 2024-02-05T07:21:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2192188281' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi184-81303-3","pool2":"test-rados-api-smithi184-81303-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-05T07:21:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[29861]: from='client.35939 ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi184-81303-3","pool2":"test-rados-api-smithi184-81303-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-05T07:21:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[29861]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:50.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:50.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[29861]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:50.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi184-81207-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:50.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[29861]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi184-81207-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:50.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:50.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[41609]: from='client.35921 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi184-81207-29"}]': finished 2024-02-05T07:21:50.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:50.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[41609]: from='client.35939 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81303-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:50.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[41609]: osdmap e176: 8 total, 8 up, 8 in 2024-02-05T07:21:50.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:50.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:50.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2192188281' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi184-81303-3","pool2":"test-rados-api-smithi184-81303-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-05T07:21:50.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[41609]: from='client.35939 ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi184-81303-3","pool2":"test-rados-api-smithi184-81303-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-05T07:21:50.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:50.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[41609]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:50.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:50.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[41609]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:50.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi184-81207-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:50.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:50 smithi184 ceph-mon[41609]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi184-81207-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:50.817 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAitObjectsStart 2024-02-05T07:21:50.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 1 0 2024-02-05T07:21:50.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 10 0 2024-02-05T07:21:50.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 13 0 2024-02-05T07:21:50.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 7 0 2024-02-05T07:21:50.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 14 0 2024-02-05T07:21:50.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 0 0 2024-02-05T07:21:50.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 15 0 2024-02-05T07:21:50.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 11 0 2024-02-05T07:21:50.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 5 0 2024-02-05T07:21:50.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 8 0 2024-02-05T07:21:50.818 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 6 0 2024-02-05T07:21:50.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 3 0 2024-02-05T07:21:50.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 4 0 2024-02-05T07:21:50.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 12 0 2024-02-05T07:21:50.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 9 0 2024-02-05T07:21:50.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 2 0 2024-02-05T07:21:50.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-02-05T07:21:50.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (43 ms) 2024-02-05T07:21:50.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [----------] 3 tests from LibRadosListEC (1114 ms total) 2024-02-05T07:21:50.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 2024-02-05T07:21:50.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-02-05T07:21:50.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-02-05T07:21:50.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (2731 ms) 2024-02-05T07:21:50.819 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [----------] 1 test from LibRadosListNP (2731 ms total) 2024-02-05T07:21:50.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: 2024-02-05T07:21:50.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [----------] Global test environment tear-down 2024-02-05T07:21:50.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [==========] 11 tests from 3 test suites ran. (112115 ms total) 2024-02-05T07:21:50.820 INFO:tasks.workunit.client.0.smithi184.stdout: api_list: [ PASSED ] 11 tests. 2024-02-05T07:21:51.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:51 smithi188 ceph-mon[33283]: pgmap v225: 388 pgs: 64 unknown, 324 active+clean; 583 KiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:21:51.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:51 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:21:51.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:51 smithi188 ceph-mon[33283]: from='client.35939 ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi184-81303-3","pool2":"test-rados-api-smithi184-81303-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-02-05T07:21:51.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:51 smithi188 ceph-mon[33283]: from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi184-81207-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:51.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:51 smithi188 ceph-mon[33283]: osdmap e177: 8 total, 8 up, 8 in 2024-02-05T07:21:51.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi184-81207-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:51.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-17"}]: dispatch 2024-02-05T07:21:51.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4168963471' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi184-81228-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:51.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:51 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-17"}]: dispatch 2024-02-05T07:21:51.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:51 smithi188 ceph-mon[33283]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi184-81207-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:51.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[29861]: pgmap v225: 388 pgs: 64 unknown, 324 active+clean; 583 KiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:21:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:21:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[29861]: from='client.35939 ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi184-81303-3","pool2":"test-rados-api-smithi184-81303-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-02-05T07:21:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[29861]: from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi184-81207-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[29861]: osdmap e177: 8 total, 8 up, 8 in 2024-02-05T07:21:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi184-81207-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-17"}]: dispatch 2024-02-05T07:21:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4168963471' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi184-81228-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-17"}]: dispatch 2024-02-05T07:21:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[29861]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi184-81207-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:51.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[41609]: pgmap v225: 388 pgs: 64 unknown, 324 active+clean; 583 KiB data, 611 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:21:51.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:21:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[41609]: from='client.35939 ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi184-81303-3","pool2":"test-rados-api-smithi184-81303-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-02-05T07:21:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[41609]: from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi184-81207-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[41609]: osdmap e177: 8 total, 8 up, 8 in 2024-02-05T07:21:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi184-81207-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-17"}]: dispatch 2024-02-05T07:21:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4168963471' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi184-81228-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-17"}]: dispatch 2024-02-05T07:21:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-mon[41609]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi184-81207-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:52.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:21:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:21:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:21:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4168963471' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi184-81228-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:52 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-17"}]': finished 2024-02-05T07:21:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-17", "mode": "writeback"}]: dispatch 2024-02-05T07:21:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:52 smithi188 ceph-mon[33283]: osdmap e178: 8 total, 8 up, 8 in 2024-02-05T07:21:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:52 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-17", "mode": "writeback"}]: dispatch 2024-02-05T07:21:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:52 smithi188 ceph-mon[33283]: pgmap v228: 388 pgs: 64 unknown, 324 active+clean; 583 KiB data, 611 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:53.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4168963471' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi184-81228-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:53.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:52 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-17"}]': finished 2024-02-05T07:21:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-17", "mode": "writeback"}]: dispatch 2024-02-05T07:21:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:52 smithi184 ceph-mon[29861]: osdmap e178: 8 total, 8 up, 8 in 2024-02-05T07:21:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:52 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-17", "mode": "writeback"}]: dispatch 2024-02-05T07:21:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:52 smithi184 ceph-mon[29861]: pgmap v228: 388 pgs: 64 unknown, 324 active+clean; 583 KiB data, 611 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:53.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4168963471' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi184-81228-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:53.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:52 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-17"}]': finished 2024-02-05T07:21:53.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-17", "mode": "writeback"}]: dispatch 2024-02-05T07:21:53.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:52 smithi184 ceph-mon[41609]: osdmap e178: 8 total, 8 up, 8 in 2024-02-05T07:21:53.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:52 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-17", "mode": "writeback"}]: dispatch 2024-02-05T07:21:53.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:52 smithi184 ceph-mon[41609]: pgmap v228: 388 pgs: 64 unknown, 324 active+clean; 583 KiB data, 611 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:21:54.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:53 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:21:54.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:53 smithi188 ceph-mon[33283]: from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi184-81207-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi184-81207-30"}]': finished 2024-02-05T07:21:54.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:53 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-17", "mode": "writeback"}]': finished 2024-02-05T07:21:54.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:53 smithi188 ceph-mon[33283]: osdmap e179: 8 total, 8 up, 8 in 2024-02-05T07:21:54.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:53 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:54.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:53 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:54.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:53 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:21:54.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:53 smithi184 ceph-mon[29861]: from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi184-81207-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi184-81207-30"}]': finished 2024-02-05T07:21:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:53 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-17", "mode": "writeback"}]': finished 2024-02-05T07:21:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:53 smithi184 ceph-mon[29861]: osdmap e179: 8 total, 8 up, 8 in 2024-02-05T07:21:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:53 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:54.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:53 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:21:54.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:53 smithi184 ceph-mon[41609]: from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi184-81207-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi184-81207-30"}]': finished 2024-02-05T07:21:54.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:53 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-17", "mode": "writeback"}]': finished 2024-02-05T07:21:54.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:53 smithi184 ceph-mon[41609]: osdmap e179: 8 total, 8 up, 8 in 2024-02-05T07:21:54.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:53 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:54.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:53 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:21:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:54 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:21:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:54 smithi188 ceph-mon[33283]: osdmap e180: 8 total, 8 up, 8 in 2024-02-05T07:21:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17"}]: dispatch 2024-02-05T07:21:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2218651764' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi184-81228-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:54 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17"}]: dispatch 2024-02-05T07:21:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:54 smithi188 ceph-mon[33283]: from='client.35957 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi184-81228-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:54 smithi188 ceph-mon[33283]: pgmap v231: 396 pgs: 40 unknown, 356 active+clean; 583 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:21:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:54 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:55.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:21:55.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[29861]: osdmap e180: 8 total, 8 up, 8 in 2024-02-05T07:21:55.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17"}]: dispatch 2024-02-05T07:21:55.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2218651764' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi184-81228-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:55.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17"}]: dispatch 2024-02-05T07:21:55.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[29861]: from='client.35957 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi184-81228-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:55.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[29861]: pgmap v231: 396 pgs: 40 unknown, 356 active+clean; 583 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:21:55.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:55.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:21:55.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[41609]: osdmap e180: 8 total, 8 up, 8 in 2024-02-05T07:21:55.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17"}]: dispatch 2024-02-05T07:21:55.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2218651764' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi184-81228-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:55.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17"}]: dispatch 2024-02-05T07:21:55.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[41609]: from='client.35957 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi184-81228-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:55.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[41609]: pgmap v231: 396 pgs: 40 unknown, 356 active+clean; 583 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:21:55.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:54 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:21:56.151 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:55 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:21:56.151 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:55 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17"}]': finished 2024-02-05T07:21:56.151 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:55 smithi188 ceph-mon[33283]: from='client.35957 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi184-81228-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:56.151 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:55 smithi188 ceph-mon[33283]: osdmap e181: 8 total, 8 up, 8 in 2024-02-05T07:21:56.151 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:55 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:56.151 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:55 smithi188 ceph-mon[33283]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:56.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:55 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:21:56.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:55 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17"}]': finished 2024-02-05T07:21:56.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:55 smithi184 ceph-mon[41609]: from='client.35957 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi184-81228-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:56.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:55 smithi184 ceph-mon[41609]: osdmap e181: 8 total, 8 up, 8 in 2024-02-05T07:21:56.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:55 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:56.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:55 smithi184 ceph-mon[41609]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:56.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:55 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:21:56.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:55 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-17"}]': finished 2024-02-05T07:21:56.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:55 smithi184 ceph-mon[29861]: from='client.35957 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi184-81228-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:56.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:55 smithi184 ceph-mon[29861]: osdmap e181: 8 total, 8 up, 8 in 2024-02-05T07:21:56.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:55 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:56.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:55 smithi184 ceph-mon[29861]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:57.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:56 smithi188 ceph-mon[33283]: from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi184-81207-30"}]': finished 2024-02-05T07:21:57.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:56 smithi188 ceph-mon[33283]: osdmap e182: 8 total, 8 up, 8 in 2024-02-05T07:21:57.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:56 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:57.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:56 smithi188 ceph-mon[33283]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:57.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:56 smithi188 ceph-mon[33283]: pgmap v234: 324 pgs: 324 active+clean; 583 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:21:57.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:56 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.b", "id": [3, 7]}]: dispatch 2024-02-05T07:21:57.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:56 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.d", "id": [3, 1]}]: dispatch 2024-02-05T07:21:57.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:56 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]: dispatch 2024-02-05T07:21:57.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:56 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1d", "id": [6, 1]}]: dispatch 2024-02-05T07:21:57.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[29861]: from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi184-81207-30"}]': finished 2024-02-05T07:21:57.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[29861]: osdmap e182: 8 total, 8 up, 8 in 2024-02-05T07:21:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[29861]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[29861]: pgmap v234: 324 pgs: 324 active+clean; 583 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:21:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.b", "id": [3, 7]}]: dispatch 2024-02-05T07:21:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.d", "id": [3, 1]}]: dispatch 2024-02-05T07:21:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]: dispatch 2024-02-05T07:21:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1d", "id": [6, 1]}]: dispatch 2024-02-05T07:21:57.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[41609]: from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi184-81207-30"}]': finished 2024-02-05T07:21:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[41609]: osdmap e182: 8 total, 8 up, 8 in 2024-02-05T07:21:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/361325002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[41609]: from='client.25954 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi184-81207-30"}]: dispatch 2024-02-05T07:21:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[41609]: pgmap v234: 324 pgs: 324 active+clean; 583 KiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:21:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.b", "id": [3, 7]}]: dispatch 2024-02-05T07:21:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.d", "id": [3, 1]}]: dispatch 2024-02-05T07:21:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]: dispatch 2024-02-05T07:21:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:56 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1d", "id": [6, 1]}]: dispatch 2024-02-05T07:21:57.856 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:21:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:21:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:57 smithi188 ceph-mon[33283]: from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi184-81207-30"}]': finished 2024-02-05T07:21:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.b", "id": [3, 7]}]': finished 2024-02-05T07:21:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.d", "id": [3, 1]}]': finished 2024-02-05T07:21:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]': finished 2024-02-05T07:21:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1d", "id": [6, 1]}]': finished 2024-02-05T07:21:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:57 smithi188 ceph-mon[33283]: osdmap e183: 8 total, 8 up, 8 in 2024-02-05T07:21:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:58.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3601474437' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi184-81228-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:58.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:57 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:58.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:57 smithi188 ceph-mon[33283]: from='client.35963 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi184-81228-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:58.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi184-81207-31"}]: dispatch 2024-02-05T07:21:58.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi184-81207-31"}]: dispatch 2024-02-05T07:21:58.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi184-81207-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:58.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[29861]: from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi184-81207-30"}]': finished 2024-02-05T07:21:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.b", "id": [3, 7]}]': finished 2024-02-05T07:21:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.d", "id": [3, 1]}]': finished 2024-02-05T07:21:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]': finished 2024-02-05T07:21:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1d", "id": [6, 1]}]': finished 2024-02-05T07:21:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[29861]: osdmap e183: 8 total, 8 up, 8 in 2024-02-05T07:21:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3601474437' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi184-81228-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[29861]: from='client.35963 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi184-81228-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi184-81207-31"}]: dispatch 2024-02-05T07:21:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi184-81207-31"}]: dispatch 2024-02-05T07:21:58.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi184-81207-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[41609]: from='client.25954 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi184-81207-30"}]': finished 2024-02-05T07:21:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.b", "id": [3, 7]}]': finished 2024-02-05T07:21:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.d", "id": [3, 1]}]': finished 2024-02-05T07:21:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1b", "id": [3, 1]}]': finished 2024-02-05T07:21:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "39.1d", "id": [6, 1]}]': finished 2024-02-05T07:21:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[41609]: osdmap e183: 8 total, 8 up, 8 in 2024-02-05T07:21:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3601474437' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi184-81228-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[41609]: from='client.35963 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi184-81228-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:21:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi184-81207-31"}]: dispatch 2024-02-05T07:21:58.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi184-81207-31"}]: dispatch 2024-02-05T07:21:58.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi184-81207-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:21:59.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:59.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:59.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:59 smithi188 ceph-mon[33283]: from='client.35963 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi184-81228-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:59.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi184-81207-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:59.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:59 smithi188 ceph-mon[33283]: osdmap e184: 8 total, 8 up, 8 in 2024-02-05T07:21:59.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi184-81207-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi184-81207-31"}]: dispatch 2024-02-05T07:21:59.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:59.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:59.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:21:59.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:59 smithi188 ceph-mon[33283]: pgmap v237: 388 pgs: 64 creating+peering, 4 peering, 320 active+clean; 583 KiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:21:59.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:21:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:21:59.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:59.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:59.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[29861]: from='client.35963 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi184-81228-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:59.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi184-81207-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:59.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[29861]: osdmap e184: 8 total, 8 up, 8 in 2024-02-05T07:21:59.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi184-81207-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi184-81207-31"}]: dispatch 2024-02-05T07:21:59.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:59.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:59.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:21:59.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[29861]: pgmap v237: 388 pgs: 64 creating+peering, 4 peering, 320 active+clean; 583 KiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:21:59.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:21:59.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:21:59.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:59.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[41609]: from='client.35963 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi184-81228-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:21:59.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi184-81207-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:21:59.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[41609]: osdmap e184: 8 total, 8 up, 8 in 2024-02-05T07:21:59.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi184-81207-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi184-81207-31"}]: dispatch 2024-02-05T07:21:59.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:59.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:21:59.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:21:59.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[41609]: pgmap v237: 388 pgs: 64 creating+peering, 4 peering, 320 active+clean; 583 KiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:21:59.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:21:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:00.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-19"}]: dispatch 2024-02-05T07:22:00.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:00 smithi188 ceph-mon[33283]: osdmap e185: 8 total, 8 up, 8 in 2024-02-05T07:22:00.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:00 smithi188 ceph-mon[33283]: Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2024-02-05T07:22:00.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:00 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-19"}]: dispatch 2024-02-05T07:22:00.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi184-81207-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi184-81207-31"}]': finished 2024-02-05T07:22:00.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:00 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-19"}]': finished 2024-02-05T07:22:00.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:00 smithi188 ceph-mon[33283]: osdmap e186: 8 total, 8 up, 8 in 2024-02-05T07:22:00.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-19", "mode": "writeback"}]: dispatch 2024-02-05T07:22:00.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/48424670' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi184-81228-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:00.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:00 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-19", "mode": "writeback"}]: dispatch 2024-02-05T07:22:00.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:00 smithi188 ceph-mon[33283]: from='client.35975 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi184-81228-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:00.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-19"}]: dispatch 2024-02-05T07:22:00.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[29861]: osdmap e185: 8 total, 8 up, 8 in 2024-02-05T07:22:00.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[29861]: Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2024-02-05T07:22:00.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-19"}]: dispatch 2024-02-05T07:22:00.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi184-81207-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi184-81207-31"}]': finished 2024-02-05T07:22:00.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-19"}]': finished 2024-02-05T07:22:00.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[29861]: osdmap e186: 8 total, 8 up, 8 in 2024-02-05T07:22:00.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-19", "mode": "writeback"}]: dispatch 2024-02-05T07:22:00.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/48424670' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi184-81228-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:00.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-19", "mode": "writeback"}]: dispatch 2024-02-05T07:22:00.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[29861]: from='client.35975 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi184-81228-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:00.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-19"}]: dispatch 2024-02-05T07:22:00.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[41609]: osdmap e185: 8 total, 8 up, 8 in 2024-02-05T07:22:00.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[41609]: Health check failed: Reduced data availability: 2 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2024-02-05T07:22:00.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-19"}]: dispatch 2024-02-05T07:22:00.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi184-81207-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi184-81207-31"}]': finished 2024-02-05T07:22:00.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-19"}]': finished 2024-02-05T07:22:00.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[41609]: osdmap e186: 8 total, 8 up, 8 in 2024-02-05T07:22:00.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-19", "mode": "writeback"}]: dispatch 2024-02-05T07:22:00.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/48424670' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi184-81228-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:00.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-19", "mode": "writeback"}]: dispatch 2024-02-05T07:22:00.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:00 smithi184 ceph-mon[41609]: from='client.35975 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi184-81228-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:01.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:01 smithi188 ceph-mon[33283]: pgmap v240: 364 pgs: 40 unknown, 32 creating+peering, 292 active+clean; 583 KiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:22:01.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:01 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:01.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:01 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-19", "mode": "writeback"}]': finished 2024-02-05T07:22:01.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:01 smithi188 ceph-mon[33283]: from='client.35975 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi184-81228-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:01.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:01 smithi188 ceph-mon[33283]: osdmap e187: 8 total, 8 up, 8 in 2024-02-05T07:22:01.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:01.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:01 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:01.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:01 smithi184 ceph-mon[29861]: pgmap v240: 364 pgs: 40 unknown, 32 creating+peering, 292 active+clean; 583 KiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:22:01.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:01 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:01.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:01 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-19", "mode": "writeback"}]': finished 2024-02-05T07:22:01.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:01 smithi184 ceph-mon[29861]: from='client.35975 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi184-81228-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:01.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:01 smithi184 ceph-mon[29861]: osdmap e187: 8 total, 8 up, 8 in 2024-02-05T07:22:01.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:01.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:01 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:01.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:01 smithi184 ceph-mon[41609]: pgmap v240: 364 pgs: 40 unknown, 32 creating+peering, 292 active+clean; 583 KiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:22:01.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:01 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:01.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:01 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-19", "mode": "writeback"}]': finished 2024-02-05T07:22:01.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:01 smithi184 ceph-mon[41609]: from='client.35975 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi184-81228-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:01.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:01 smithi184 ceph-mon[41609]: osdmap e187: 8 total, 8 up, 8 in 2024-02-05T07:22:01.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:01.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:01 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:02.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:22:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:22:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:22:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 2 pgs peering) 2024-02-05T07:22:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/48424670' entity='client.admin' cmd=[{ 2024-02-05T07:22:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: "prefix": "osd pool set", 2024-02-05T07:22:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: "pool": "PoolEIOFlag_smithi184-81228-33", 2024-02-05T07:22:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: "var": "eio", 2024-02-05T07:22:02.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: "val": "true" 2024-02-05T07:22:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: }]: dispatch 2024-02-05T07:22:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: from='client.35975 ' entity='client.admin' cmd=[{ 2024-02-05T07:22:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: "prefix": "osd pool set", 2024-02-05T07:22:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: "pool": "PoolEIOFlag_smithi184-81228-33", 2024-02-05T07:22:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: "var": "eio", 2024-02-05T07:22:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: "val": "true" 2024-02-05T07:22:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: }]: dispatch 2024-02-05T07:22:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: from='client.35975 ' entity='client.admin' cmd='[{ 2024-02-05T07:22:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: "prefix": "osd pool set", 2024-02-05T07:22:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: "pool": "PoolEIOFlag_smithi184-81228-33", 2024-02-05T07:22:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: "var": "eio", 2024-02-05T07:22:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: "val": "true" 2024-02-05T07:22:02.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: }]': finished 2024-02-05T07:22:02.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: osdmap e188: 8 total, 8 up, 8 in 2024-02-05T07:22:02.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi184-81207-31"}]: dispatch 2024-02-05T07:22:02.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19"}]: dispatch 2024-02-05T07:22:02.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19"}]: dispatch 2024-02-05T07:22:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 2 pgs peering) 2024-02-05T07:22:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/48424670' entity='client.admin' cmd=[{ 2024-02-05T07:22:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: "prefix": "osd pool set", 2024-02-05T07:22:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: "pool": "PoolEIOFlag_smithi184-81228-33", 2024-02-05T07:22:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: "var": "eio", 2024-02-05T07:22:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: "val": "true" 2024-02-05T07:22:02.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: }]: dispatch 2024-02-05T07:22:02.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: from='client.35975 ' entity='client.admin' cmd=[{ 2024-02-05T07:22:02.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: "prefix": "osd pool set", 2024-02-05T07:22:02.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: "pool": "PoolEIOFlag_smithi184-81228-33", 2024-02-05T07:22:02.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: "var": "eio", 2024-02-05T07:22:02.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: "val": "true" 2024-02-05T07:22:02.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: }]: dispatch 2024-02-05T07:22:02.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:02.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: from='client.35975 ' entity='client.admin' cmd='[{ 2024-02-05T07:22:02.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: "prefix": "osd pool set", 2024-02-05T07:22:02.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: "pool": "PoolEIOFlag_smithi184-81228-33", 2024-02-05T07:22:02.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: "var": "eio", 2024-02-05T07:22:02.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: "val": "true" 2024-02-05T07:22:02.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: }]': finished 2024-02-05T07:22:02.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: osdmap e188: 8 total, 8 up, 8 in 2024-02-05T07:22:02.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi184-81207-31"}]: dispatch 2024-02-05T07:22:02.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19"}]: dispatch 2024-02-05T07:22:02.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:02 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19"}]: dispatch 2024-02-05T07:22:02.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:02.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 2 pgs peering) 2024-02-05T07:22:02.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/48424670' entity='client.admin' cmd=[{ 2024-02-05T07:22:02.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: "prefix": "osd pool set", 2024-02-05T07:22:02.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: "pool": "PoolEIOFlag_smithi184-81228-33", 2024-02-05T07:22:02.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: "var": "eio", 2024-02-05T07:22:02.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: "val": "true" 2024-02-05T07:22:02.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: }]: dispatch 2024-02-05T07:22:02.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: from='client.35975 ' entity='client.admin' cmd=[{ 2024-02-05T07:22:02.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: "prefix": "osd pool set", 2024-02-05T07:22:02.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: "pool": "PoolEIOFlag_smithi184-81228-33", 2024-02-05T07:22:02.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: "var": "eio", 2024-02-05T07:22:02.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: "val": "true" 2024-02-05T07:22:02.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: }]: dispatch 2024-02-05T07:22:02.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:02.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: from='client.35975 ' entity='client.admin' cmd='[{ 2024-02-05T07:22:02.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: "prefix": "osd pool set", 2024-02-05T07:22:02.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: "pool": "PoolEIOFlag_smithi184-81228-33", 2024-02-05T07:22:02.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: "var": "eio", 2024-02-05T07:22:02.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: "val": "true" 2024-02-05T07:22:02.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: }]': finished 2024-02-05T07:22:02.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: osdmap e188: 8 total, 8 up, 8 in 2024-02-05T07:22:02.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi184-81207-31"}]: dispatch 2024-02-05T07:22:02.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19"}]: dispatch 2024-02-05T07:22:02.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:02 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19"}]: dispatch 2024-02-05T07:22:03.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:03 smithi188 ceph-mon[33283]: pgmap v243: 388 pgs: 64 unknown, 32 creating+peering, 292 active+clean; 583 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:03.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:03 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:03.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:03 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi184-81207-31"}]': finished 2024-02-05T07:22:03.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:03 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19"}]': finished 2024-02-05T07:22:03.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:03 smithi188 ceph-mon[33283]: osdmap e189: 8 total, 8 up, 8 in 2024-02-05T07:22:03.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:03 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi184-81207-31"}]: dispatch 2024-02-05T07:22:03.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:03 smithi184 ceph-mon[29861]: pgmap v243: 388 pgs: 64 unknown, 32 creating+peering, 292 active+clean; 583 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:03.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:03 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:03.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:03 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi184-81207-31"}]': finished 2024-02-05T07:22:03.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:03 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19"}]': finished 2024-02-05T07:22:03.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:03 smithi184 ceph-mon[29861]: osdmap e189: 8 total, 8 up, 8 in 2024-02-05T07:22:03.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:03 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi184-81207-31"}]: dispatch 2024-02-05T07:22:03.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:03 smithi184 ceph-mon[41609]: pgmap v243: 388 pgs: 64 unknown, 32 creating+peering, 292 active+clean; 583 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:03.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:03 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:03.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:03 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi184-81207-31"}]': finished 2024-02-05T07:22:03.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:03 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-19"}]': finished 2024-02-05T07:22:03.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:03 smithi184 ceph-mon[41609]: osdmap e189: 8 total, 8 up, 8 in 2024-02-05T07:22:03.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:03 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi184-81207-31"}]: dispatch 2024-02-05T07:22:05.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:04 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi184-81207-31"}]': finished 2024-02-05T07:22:05.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:04 smithi188 ceph-mon[33283]: osdmap e190: 8 total, 8 up, 8 in 2024-02-05T07:22:05.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:04 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/631123354' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi184-81228-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:05.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:04 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:05.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:04 smithi188 ceph-mon[33283]: from='client.35993 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi184-81228-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:05.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:04 smithi188 ceph-mon[33283]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:05.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:04 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:05.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:04 smithi188 ceph-mon[33283]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:05.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:04 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi184-81207-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:05.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:04 smithi188 ceph-mon[33283]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi184-81207-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:05.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:04 smithi188 ceph-mon[33283]: pgmap v246: 356 pgs: 64 unknown, 292 active+clean; 583 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:22:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi184-81207-31"}]': finished 2024-02-05T07:22:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[29861]: osdmap e190: 8 total, 8 up, 8 in 2024-02-05T07:22:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/631123354' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi184-81228-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[29861]: from='client.35993 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi184-81228-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[29861]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[29861]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi184-81207-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[29861]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi184-81207-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[29861]: pgmap v246: 356 pgs: 64 unknown, 292 active+clean; 583 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:22:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/229751717' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi184-81207-31"}]': finished 2024-02-05T07:22:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[41609]: osdmap e190: 8 total, 8 up, 8 in 2024-02-05T07:22:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/631123354' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi184-81228-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[41609]: from='client.35993 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi184-81228-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[41609]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[41609]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi184-81207-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[41609]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi184-81207-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:04 smithi184 ceph-mon[41609]: pgmap v246: 356 pgs: 64 unknown, 292 active+clean; 583 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:22:06.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:06 smithi188 ceph-mon[33283]: from='client.35993 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi184-81228-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:06.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:06 smithi188 ceph-mon[33283]: from='client.35996 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi184-81207-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:06.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:06 smithi188 ceph-mon[33283]: osdmap e191: 8 total, 8 up, 8 in 2024-02-05T07:22:06.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi184-81207-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:06.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:06.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:06 smithi188 ceph-mon[33283]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi184-81207-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:06.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:06 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:06.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:06 smithi184 ceph-mon[29861]: from='client.35993 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi184-81228-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:06.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:06 smithi184 ceph-mon[29861]: from='client.35996 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi184-81207-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:06.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:06 smithi184 ceph-mon[29861]: osdmap e191: 8 total, 8 up, 8 in 2024-02-05T07:22:06.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi184-81207-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:06.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:06.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:06 smithi184 ceph-mon[29861]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi184-81207-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:06.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:06 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:06.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:06 smithi184 ceph-mon[41609]: from='client.35993 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi184-81228-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:06.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:06 smithi184 ceph-mon[41609]: from='client.35996 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi184-81207-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:06.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:06 smithi184 ceph-mon[41609]: osdmap e191: 8 total, 8 up, 8 in 2024-02-05T07:22:06.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi184-81207-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:06.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:06.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:06 smithi184 ceph-mon[41609]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi184-81207-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:06.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:06 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:07.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:07 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:07.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:07.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:07 smithi188 ceph-mon[33283]: osdmap e192: 8 total, 8 up, 8 in 2024-02-05T07:22:07.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:07 smithi188 ceph-mon[33283]: pgmap v249: 324 pgs: 32 unknown, 292 active+clean; 583 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:22:07.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:07 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:07.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:07 smithi188 ceph-mon[33283]: from='client.35996 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi184-81207-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi184-81207-32"}]': finished 2024-02-05T07:22:07.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:07 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:07.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:07 smithi188 ceph-mon[33283]: osdmap e193: 8 total, 8 up, 8 in 2024-02-05T07:22:07.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-21"}]: dispatch 2024-02-05T07:22:07.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:07 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-21"}]: dispatch 2024-02-05T07:22:07.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1802217850' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi184-81228-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:07.501 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:07 smithi188 ceph-mon[33283]: from='client.36008 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi184-81228-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:07.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:07.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[41609]: osdmap e192: 8 total, 8 up, 8 in 2024-02-05T07:22:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[41609]: pgmap v249: 324 pgs: 32 unknown, 292 active+clean; 583 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:22:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[41609]: from='client.35996 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi184-81207-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi184-81207-32"}]': finished 2024-02-05T07:22:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[41609]: osdmap e193: 8 total, 8 up, 8 in 2024-02-05T07:22:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-21"}]: dispatch 2024-02-05T07:22:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-21"}]: dispatch 2024-02-05T07:22:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1802217850' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi184-81228-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[41609]: from='client.36008 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi184-81228-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:07.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:07.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:07.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[29861]: osdmap e192: 8 total, 8 up, 8 in 2024-02-05T07:22:07.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[29861]: pgmap v249: 324 pgs: 32 unknown, 292 active+clean; 583 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:22:07.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:07.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[29861]: from='client.35996 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi184-81207-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi184-81207-32"}]': finished 2024-02-05T07:22:07.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:07.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[29861]: osdmap e193: 8 total, 8 up, 8 in 2024-02-05T07:22:07.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-21"}]: dispatch 2024-02-05T07:22:07.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-21"}]: dispatch 2024-02-05T07:22:07.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1802217850' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi184-81228-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:07.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:07 smithi184 ceph-mon[29861]: from='client.36008 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi184-81228-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:07.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:22:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:22:08.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:08 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:08.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:08 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-21"}]': finished 2024-02-05T07:22:08.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:08 smithi184 ceph-mon[29861]: from='client.36008 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi184-81228-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:08.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:08 smithi184 ceph-mon[29861]: osdmap e194: 8 total, 8 up, 8 in 2024-02-05T07:22:08.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-21", "mode": "writeback"}]: dispatch 2024-02-05T07:22:08.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:08 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-21", "mode": "writeback"}]: dispatch 2024-02-05T07:22:08.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:08 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:08.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:08 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-21"}]': finished 2024-02-05T07:22:08.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:08 smithi184 ceph-mon[41609]: from='client.36008 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi184-81228-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:08.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:08 smithi184 ceph-mon[41609]: osdmap e194: 8 total, 8 up, 8 in 2024-02-05T07:22:08.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-21", "mode": "writeback"}]: dispatch 2024-02-05T07:22:08.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:08 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-21", "mode": "writeback"}]: dispatch 2024-02-05T07:22:08.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:08 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:08.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:08 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-21"}]': finished 2024-02-05T07:22:08.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:08 smithi188 ceph-mon[33283]: from='client.36008 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi184-81228-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:08.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:08 smithi188 ceph-mon[33283]: osdmap e194: 8 total, 8 up, 8 in 2024-02-05T07:22:08.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-21", "mode": "writeback"}]: dispatch 2024-02-05T07:22:08.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:08 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-21", "mode": "writeback"}]: dispatch 2024-02-05T07:22:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:09 smithi188 ceph-mon[33283]: pgmap v252: 396 pgs: 72 creating+peering, 324 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:22:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:09 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:09 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-21", "mode": "writeback"}]': finished 2024-02-05T07:22:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:09 smithi188 ceph-mon[33283]: osdmap e195: 8 total, 8 up, 8 in 2024-02-05T07:22:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:09 smithi188 ceph-mon[33283]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:09.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:09.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:09 smithi184 ceph-mon[29861]: pgmap v252: 396 pgs: 72 creating+peering, 324 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:22:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:09 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:09 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-21", "mode": "writeback"}]': finished 2024-02-05T07:22:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:09 smithi184 ceph-mon[29861]: osdmap e195: 8 total, 8 up, 8 in 2024-02-05T07:22:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:09 smithi184 ceph-mon[29861]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:09.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:09.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:09 smithi184 ceph-mon[41609]: pgmap v252: 396 pgs: 72 creating+peering, 324 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:22:09.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:09 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:09.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:09 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-21", "mode": "writeback"}]': finished 2024-02-05T07:22:09.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:09 smithi184 ceph-mon[41609]: osdmap e195: 8 total, 8 up, 8 in 2024-02-05T07:22:09.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:09 smithi184 ceph-mon[41609]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:10 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:10 smithi188 ceph-mon[33283]: from='client.35996 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi184-81207-32"}]': finished 2024-02-05T07:22:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:10 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:10 smithi188 ceph-mon[33283]: osdmap e196: 8 total, 8 up, 8 in 2024-02-05T07:22:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21"}]: dispatch 2024-02-05T07:22:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:10 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21"}]: dispatch 2024-02-05T07:22:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1787497785' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:10 smithi188 ceph-mon[33283]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:10.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:10 smithi188 ceph-mon[33283]: from='client.36020 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[29861]: from='client.35996 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi184-81207-32"}]': finished 2024-02-05T07:22:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[29861]: osdmap e196: 8 total, 8 up, 8 in 2024-02-05T07:22:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21"}]: dispatch 2024-02-05T07:22:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21"}]: dispatch 2024-02-05T07:22:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1787497785' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[29861]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[29861]: from='client.36020 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:10.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:10.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:10.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[41609]: from='client.35996 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi184-81207-32"}]': finished 2024-02-05T07:22:10.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:10.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[41609]: osdmap e196: 8 total, 8 up, 8 in 2024-02-05T07:22:10.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21"}]: dispatch 2024-02-05T07:22:10.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3646527234' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:10.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21"}]: dispatch 2024-02-05T07:22:10.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1787497785' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:10.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[41609]: from='client.35996 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi184-81207-32"}]: dispatch 2024-02-05T07:22:10.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:10 smithi184 ceph-mon[41609]: from='client.36020 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:11 smithi188 ceph-mon[33283]: pgmap v255: 388 pgs: 64 unknown, 324 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:22:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:11 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:11 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21"}]': finished 2024-02-05T07:22:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:11 smithi188 ceph-mon[33283]: from='client.35996 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi184-81207-32"}]': finished 2024-02-05T07:22:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:11 smithi188 ceph-mon[33283]: from='client.36020 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:11 smithi188 ceph-mon[33283]: osdmap e197: 8 total, 8 up, 8 in 2024-02-05T07:22:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi184-81207-33"}]: dispatch 2024-02-05T07:22:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi184-81207-33"}]: dispatch 2024-02-05T07:22:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi184-81207-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:11.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[29861]: pgmap v255: 388 pgs: 64 unknown, 324 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:22:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21"}]': finished 2024-02-05T07:22:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[29861]: from='client.35996 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi184-81207-32"}]': finished 2024-02-05T07:22:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[29861]: from='client.36020 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[29861]: osdmap e197: 8 total, 8 up, 8 in 2024-02-05T07:22:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi184-81207-33"}]: dispatch 2024-02-05T07:22:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi184-81207-33"}]: dispatch 2024-02-05T07:22:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi184-81207-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:11.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[41609]: pgmap v255: 388 pgs: 64 unknown, 324 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:22:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-21"}]': finished 2024-02-05T07:22:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[41609]: from='client.35996 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi184-81207-32"}]': finished 2024-02-05T07:22:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[41609]: from='client.36020 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[41609]: osdmap e197: 8 total, 8 up, 8 in 2024-02-05T07:22:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi184-81207-33"}]: dispatch 2024-02-05T07:22:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi184-81207-33"}]: dispatch 2024-02-05T07:22:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi184-81207-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:12.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:22:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:22:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:22:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi184-81207-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:12 smithi188 ceph-mon[33283]: osdmap e198: 8 total, 8 up, 8 in 2024-02-05T07:22:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi184-81207-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi184-81207-33"}]: dispatch 2024-02-05T07:22:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/276908162' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:12 smithi188 ceph-mon[33283]: pgmap v258: 356 pgs: 64 unknown, 292 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:13.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi184-81207-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:13.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:12 smithi184 ceph-mon[29861]: osdmap e198: 8 total, 8 up, 8 in 2024-02-05T07:22:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi184-81207-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi184-81207-33"}]: dispatch 2024-02-05T07:22:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/276908162' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:12 smithi184 ceph-mon[29861]: pgmap v258: 356 pgs: 64 unknown, 292 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:13.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi184-81207-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:13.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:12 smithi184 ceph-mon[41609]: osdmap e198: 8 total, 8 up, 8 in 2024-02-05T07:22:13.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi184-81207-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi184-81207-33"}]: dispatch 2024-02-05T07:22:13.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/276908162' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:13.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:12 smithi184 ceph-mon[41609]: pgmap v258: 356 pgs: 64 unknown, 292 active+clean; 583 KiB data, 594 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:14.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:13 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:14.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/276908162' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:14.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:13 smithi188 ceph-mon[33283]: osdmap e199: 8 total, 8 up, 8 in 2024-02-05T07:22:14.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:14.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:13 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:22:14.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:13 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:14.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:13 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:14.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/276908162' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:14.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:13 smithi184 ceph-mon[41609]: osdmap e199: 8 total, 8 up, 8 in 2024-02-05T07:22:14.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:14.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:13 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:22:14.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:13 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:13 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/276908162' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:13 smithi184 ceph-mon[29861]: osdmap e199: 8 total, 8 up, 8 in 2024-02-05T07:22:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:13 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:22:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:13 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi184-81207-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi184-81207-33"}]': finished 2024-02-05T07:22:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:14 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:14 smithi188 ceph-mon[33283]: osdmap e200: 8 total, 8 up, 8 in 2024-02-05T07:22:15.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4126321758' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:15.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:14 smithi188 ceph-mon[33283]: pgmap v261: 460 pgs: 104 unknown, 32 creating+peering, 324 active+clean; 584 KiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-05T07:22:15.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi184-81207-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi184-81207-33"}]': finished 2024-02-05T07:22:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:14 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:14 smithi184 ceph-mon[29861]: osdmap e200: 8 total, 8 up, 8 in 2024-02-05T07:22:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4126321758' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:14 smithi184 ceph-mon[29861]: pgmap v261: 460 pgs: 104 unknown, 32 creating+peering, 324 active+clean; 584 KiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-05T07:22:15.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi184-81207-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi184-81207-33"}]': finished 2024-02-05T07:22:15.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:14 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:15.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:14 smithi184 ceph-mon[41609]: osdmap e200: 8 total, 8 up, 8 in 2024-02-05T07:22:15.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4126321758' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:15.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:14 smithi184 ceph-mon[41609]: pgmap v261: 460 pgs: 104 unknown, 32 creating+peering, 324 active+clean; 584 KiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-05T07:22:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4126321758' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:15 smithi188 ceph-mon[33283]: osdmap e201: 8 total, 8 up, 8 in 2024-02-05T07:22:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:15 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:16.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4126321758' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:16.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:15 smithi184 ceph-mon[29861]: osdmap e201: 8 total, 8 up, 8 in 2024-02-05T07:22:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:15 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:16.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4126321758' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi184-81228-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:16.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:15 smithi184 ceph-mon[41609]: osdmap e201: 8 total, 8 up, 8 in 2024-02-05T07:22:16.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:16.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:15 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:16 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:16 smithi188 ceph-mon[33283]: osdmap e202: 8 total, 8 up, 8 in 2024-02-05T07:22:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-23"}]: dispatch 2024-02-05T07:22:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:16 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-23"}]: dispatch 2024-02-05T07:22:17.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi184-81207-33"}]: dispatch 2024-02-05T07:22:17.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:16 smithi188 ceph-mon[33283]: pgmap v264: 420 pgs: 64 unknown, 32 creating+peering, 324 active+clean; 584 KiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-05T07:22:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:16 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:16 smithi184 ceph-mon[29861]: osdmap e202: 8 total, 8 up, 8 in 2024-02-05T07:22:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-23"}]: dispatch 2024-02-05T07:22:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:16 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-23"}]: dispatch 2024-02-05T07:22:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi184-81207-33"}]: dispatch 2024-02-05T07:22:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:16 smithi184 ceph-mon[29861]: pgmap v264: 420 pgs: 64 unknown, 32 creating+peering, 324 active+clean; 584 KiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-05T07:22:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:16 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:16 smithi184 ceph-mon[41609]: osdmap e202: 8 total, 8 up, 8 in 2024-02-05T07:22:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-23"}]: dispatch 2024-02-05T07:22:17.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:16 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-23"}]: dispatch 2024-02-05T07:22:17.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi184-81207-33"}]: dispatch 2024-02-05T07:22:17.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:16 smithi184 ceph-mon[41609]: pgmap v264: 420 pgs: 64 unknown, 32 creating+peering, 324 active+clean; 584 KiB data, 595 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-05T07:22:17.953 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:22:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:22:18.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:17 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-23"}]': finished 2024-02-05T07:22:18.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi184-81207-33"}]': finished 2024-02-05T07:22:18.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:17 smithi188 ceph-mon[33283]: osdmap e203: 8 total, 8 up, 8 in 2024-02-05T07:22:18.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi184-81207-33"}]: dispatch 2024-02-05T07:22:18.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-23", "mode": "writeback"}]: dispatch 2024-02-05T07:22:18.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:17 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-23", "mode": "writeback"}]: dispatch 2024-02-05T07:22:18.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:17 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-23"}]': finished 2024-02-05T07:22:18.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi184-81207-33"}]': finished 2024-02-05T07:22:18.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:17 smithi184 ceph-mon[29861]: osdmap e203: 8 total, 8 up, 8 in 2024-02-05T07:22:18.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi184-81207-33"}]: dispatch 2024-02-05T07:22:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-23", "mode": "writeback"}]: dispatch 2024-02-05T07:22:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:17 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-23", "mode": "writeback"}]: dispatch 2024-02-05T07:22:18.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:17 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-23"}]': finished 2024-02-05T07:22:18.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi184-81207-33"}]': finished 2024-02-05T07:22:18.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:17 smithi184 ceph-mon[41609]: osdmap e203: 8 total, 8 up, 8 in 2024-02-05T07:22:18.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi184-81207-33"}]: dispatch 2024-02-05T07:22:18.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-23", "mode": "writeback"}]: dispatch 2024-02-05T07:22:18.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:17 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-23", "mode": "writeback"}]: dispatch 2024-02-05T07:22:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:18 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:18 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi184-81207-33"}]': finished 2024-02-05T07:22:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:18 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-23", "mode": "writeback"}]': finished 2024-02-05T07:22:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:18 smithi188 ceph-mon[33283]: osdmap e204: 8 total, 8 up, 8 in 2024-02-05T07:22:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:18 smithi188 ceph-mon[33283]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:18 smithi188 ceph-mon[33283]: pgmap v267: 324 pgs: 324 active+clean; 584 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-05T07:22:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:18 smithi188 ceph-mon[33283]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi184-81207-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:18 smithi188 ceph-mon[33283]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi184-81207-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:19.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:19.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi184-81207-33"}]': finished 2024-02-05T07:22:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-23", "mode": "writeback"}]': finished 2024-02-05T07:22:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[29861]: osdmap e204: 8 total, 8 up, 8 in 2024-02-05T07:22:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[29861]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[29861]: pgmap v267: 324 pgs: 324 active+clean; 584 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-05T07:22:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[29861]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi184-81207-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[29861]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi184-81207-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:19.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2585624373' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi184-81207-33"}]': finished 2024-02-05T07:22:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-23", "mode": "writeback"}]': finished 2024-02-05T07:22:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[41609]: osdmap e204: 8 total, 8 up, 8 in 2024-02-05T07:22:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[41609]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[41609]: pgmap v267: 324 pgs: 324 active+clean; 584 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-05T07:22:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[41609]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi184-81207-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:18 smithi184 ceph-mon[41609]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi184-81207-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:19 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:19 smithi188 ceph-mon[33283]: from='client.26068 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi184-81207-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:19 smithi188 ceph-mon[33283]: osdmap e205: 8 total, 8 up, 8 in 2024-02-05T07:22:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi184-81207-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2953192748' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:19 smithi188 ceph-mon[33283]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi184-81207-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:19 smithi188 ceph-mon[33283]: from='client.36065 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:19 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:20.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[41609]: from='client.26068 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi184-81207-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[41609]: osdmap e205: 8 total, 8 up, 8 in 2024-02-05T07:22:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi184-81207-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2953192748' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[41609]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi184-81207-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[41609]: from='client.36065 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:20.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:20.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[29861]: from='client.26068 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi184-81207-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:20.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[29861]: osdmap e205: 8 total, 8 up, 8 in 2024-02-05T07:22:20.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi184-81207-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:20.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2953192748' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:20.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[29861]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi184-81207-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:20.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[29861]: from='client.36065 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:20.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:20.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:19 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:20 smithi188 ceph-mon[33283]: from='client.36065 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:20 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23"}]: dispatch 2024-02-05T07:22:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:20 smithi188 ceph-mon[33283]: pgmap v270: 388 pgs: 64 unknown, 324 active+clean; 584 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-05T07:22:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:20 smithi188 ceph-mon[33283]: osdmap e206: 8 total, 8 up, 8 in 2024-02-05T07:22:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:20 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23"}]: dispatch 2024-02-05T07:22:21.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:20 smithi184 ceph-mon[29861]: from='client.36065 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:21.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:20 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:21.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23"}]: dispatch 2024-02-05T07:22:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:20 smithi184 ceph-mon[29861]: pgmap v270: 388 pgs: 64 unknown, 324 active+clean; 584 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-05T07:22:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:20 smithi184 ceph-mon[29861]: osdmap e206: 8 total, 8 up, 8 in 2024-02-05T07:22:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:20 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23"}]: dispatch 2024-02-05T07:22:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:20 smithi184 ceph-mon[41609]: from='client.36065 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:20 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23"}]: dispatch 2024-02-05T07:22:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:20 smithi184 ceph-mon[41609]: pgmap v270: 388 pgs: 64 unknown, 324 active+clean; 584 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-05T07:22:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:20 smithi184 ceph-mon[41609]: osdmap e206: 8 total, 8 up, 8 in 2024-02-05T07:22:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:20 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23"}]: dispatch 2024-02-05T07:22:22.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:21 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:22.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:21 smithi188 ceph-mon[33283]: from='client.26068 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi184-81207-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi184-81207-34"}]': finished 2024-02-05T07:22:22.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:21 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23"}]': finished 2024-02-05T07:22:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:21 smithi188 ceph-mon[33283]: osdmap e207: 8 total, 8 up, 8 in 2024-02-05T07:22:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3724120606' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:21 smithi188 ceph-mon[33283]: from='client.36071 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:21 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:21 smithi184 ceph-mon[29861]: from='client.26068 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi184-81207-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi184-81207-34"}]': finished 2024-02-05T07:22:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:21 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23"}]': finished 2024-02-05T07:22:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:21 smithi184 ceph-mon[29861]: osdmap e207: 8 total, 8 up, 8 in 2024-02-05T07:22:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3724120606' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:22.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:21 smithi184 ceph-mon[29861]: from='client.36071 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:22.273 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:22:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:22:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:22:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:21 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:21 smithi184 ceph-mon[41609]: from='client.26068 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi184-81207-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi184-81207-34"}]': finished 2024-02-05T07:22:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:21 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-23"}]': finished 2024-02-05T07:22:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:21 smithi184 ceph-mon[41609]: osdmap e207: 8 total, 8 up, 8 in 2024-02-05T07:22:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3724120606' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:22.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:21 smithi184 ceph-mon[41609]: from='client.36071 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:23.048 INFO:tasks.workunit.client.0.smithi184.stdout: 0x560254c271d0 2024-02-05T07:22:23.049 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c26d30 2024-02-05T07:22:23.049 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c26e60 2024-02-05T07:22:23.049 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c26f70 2024-02-05T07:22:23.049 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c27080 2024-02-05T07:22:23.049 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c277a0 2024-02-05T07:22:23.049 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c27300 2024-02-05T07:22:23.049 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c27430 2024-02-05T07:22:23.049 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c27560 2024-02-05T07:22:23.049 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c27670 2024-02-05T07:22:23.049 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c27d70 2024-02-05T07:22:23.049 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c278d0 2024-02-05T07:22:23.049 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c279e0 2024-02-05T07:22:23.049 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c27af0 2024-02-05T07:22:23.049 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c27c00 2024-02-05T07:22:23.050 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c28320 2024-02-05T07:22:23.050 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c27e80 2024-02-05T07:22:23.050 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c27f90 2024-02-05T07:22:23.050 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c280c0 2024-02-05T07:22:23.050 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c28210 2024-02-05T07:22:23.050 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c28470 2024-02-05T07:22:23.050 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c28a20 2024-02-05T07:22:23.050 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c285d0 2024-02-05T07:22:23.050 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c28730 2024-02-05T07:22:23.050 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c288d0 2024-02-05T07:22:23.050 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c28b70 2024-02-05T07:22:23.050 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c29000 2024-02-05T07:22:23.050 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c29110 2024-02-05T07:22:23.050 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c23480 2024-02-05T07:22:23.051 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c23590 2024-02-05T07:22:23.051 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c236a0 2024-02-05T07:22:23.051 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c29240 2024-02-05T07:22:23.051 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c29350 2024-02-05T07:22:23.051 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c29460 2024-02-05T07:22:23.051 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c29570 2024-02-05T07:22:23.051 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c29be0 2024-02-05T07:22:23.051 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c29740 2024-02-05T07:22:23.051 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c29850 2024-02-05T07:22:23.051 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c29960 2024-02-05T07:22:23.051 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c29ab0 2024-02-05T07:22:23.051 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2a190 2024-02-05T07:22:23.051 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c29cf0 2024-02-05T07:22:23.051 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c29e00 2024-02-05T07:22:23.051 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c29f30 2024-02-05T07:22:23.052 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2a060 2024-02-05T07:22:23.052 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2a760 2024-02-05T07:22:23.052 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2a2c0 2024-02-05T07:22:23.053 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2a3d0 2024-02-05T07:22:23.053 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2a4e0 2024-02-05T07:22:23.053 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2a5f0 2024-02-05T07:22:23.053 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2ad50 2024-02-05T07:22:23.053 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2a8b0 2024-02-05T07:22:23.053 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2a9e0 2024-02-05T07:22:23.053 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2ab10 2024-02-05T07:22:23.053 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2ac20 2024-02-05T07:22:23.053 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2b300 2024-02-05T07:22:23.053 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2ae60 2024-02-05T07:22:23.053 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2af70 2024-02-05T07:22:23.053 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2b0a0 2024-02-05T07:22:23.053 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2b1b0 2024-02-05T07:22:23.054 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2b8d0 2024-02-05T07:22:23.054 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2b430 2024-02-05T07:22:23.054 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2b560 2024-02-05T07:22:23.054 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2b670 2024-02-05T07:22:23.054 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2b7a0 2024-02-05T07:22:23.054 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2be80 2024-02-05T07:22:23.054 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2b9e0 2024-02-05T07:22:23.054 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2bb10 2024-02-05T07:22:23.054 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2bc20 2024-02-05T07:22:23.054 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2bd30 2024-02-05T07:22:23.054 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2c450 2024-02-05T07:22:23.054 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2bfb0 2024-02-05T07:22:23.054 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2c0e0 2024-02-05T07:22:23.054 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2c210 2024-02-05T07:22:23.055 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2c340 2024-02-05T07:22:23.055 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2ca20 2024-02-05T07:22:23.055 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2c580 2024-02-05T07:22:23.055 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2c720 2024-02-05T07:22:23.055 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2c850 2024-02-05T07:22:23.055 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2cb70 2024-02-05T07:22:23.055 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2d000 2024-02-05T07:22:23.055 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2d130 2024-02-05T07:22:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:22 smithi188 ceph-mon[33283]: from='client.36071 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:22 smithi188 ceph-mon[33283]: osdmap e208: 8 total, 8 up, 8 in 2024-02-05T07:22:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:22 smithi188 ceph-mon[33283]: pgmap v273: 396 pgs: 104 unknown, 292 active+clean; 584 KiB data, 579 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:23.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:22 smithi184 ceph-mon[41609]: from='client.36071 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:22 smithi184 ceph-mon[41609]: osdmap e208: 8 total, 8 up, 8 in 2024-02-05T07:22:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:22 smithi184 ceph-mon[41609]: pgmap v273: 396 pgs: 104 unknown, 292 active+clean; 584 KiB data, 579 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:22 smithi184 ceph-mon[29861]: from='client.36071 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:22 smithi184 ceph-mon[29861]: osdmap e208: 8 total, 8 up, 8 in 2024-02-05T07:22:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:22 smithi184 ceph-mon[29861]: pgmap v273: 396 pgs: 104 unknown, 292 active+clean; 584 KiB data, 579 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:24.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:24 smithi184 ceph-mon[29861]: osdmap e209: 8 total, 8 up, 8 in 2024-02-05T07:22:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/50700759' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:24 smithi184 ceph-mon[29861]: from='client.36083 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:24 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:24 smithi184 ceph-mon[29861]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:24.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:24 smithi184 ceph-mon[41609]: osdmap e209: 8 total, 8 up, 8 in 2024-02-05T07:22:24.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/50700759' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:24.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:24.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:24.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:24 smithi184 ceph-mon[41609]: from='client.36083 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:24.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:24 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:24.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:24 smithi184 ceph-mon[41609]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:24 smithi188 ceph-mon[33283]: osdmap e209: 8 total, 8 up, 8 in 2024-02-05T07:22:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/50700759' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:24 smithi188 ceph-mon[33283]: from='client.36083 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:24 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:24 smithi188 ceph-mon[33283]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[29861]: from='client.36083 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[29861]: from='client.26068 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi184-81207-34"}]': finished 2024-02-05T07:22:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[29861]: osdmap e210: 8 total, 8 up, 8 in 2024-02-05T07:22:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[29861]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[29861]: pgmap v276: 420 pgs: 64 unknown, 356 active+clean; 584 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:22:25.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:25.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[29861]: from='client.26068 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi184-81207-34"}]': finished 2024-02-05T07:22:25.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[29861]: osdmap e211: 8 total, 8 up, 8 in 2024-02-05T07:22:25.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4222433740' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:25.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[29861]: from='client.36092 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:25.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[41609]: from='client.36083 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:25.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:25.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[41609]: from='client.26068 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi184-81207-34"}]': finished 2024-02-05T07:22:25.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[41609]: osdmap e210: 8 total, 8 up, 8 in 2024-02-05T07:22:25.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:25.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[41609]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:25.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[41609]: pgmap v276: 420 pgs: 64 unknown, 356 active+clean; 584 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:22:25.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:25.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[41609]: from='client.26068 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi184-81207-34"}]': finished 2024-02-05T07:22:25.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[41609]: osdmap e211: 8 total, 8 up, 8 in 2024-02-05T07:22:25.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4222433740' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:25.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:25 smithi184 ceph-mon[41609]: from='client.36092 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:25.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:25 smithi188 ceph-mon[33283]: from='client.36083 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:25.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:25 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:25.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:25 smithi188 ceph-mon[33283]: from='client.26068 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi184-81207-34"}]': finished 2024-02-05T07:22:25.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:25 smithi188 ceph-mon[33283]: osdmap e210: 8 total, 8 up, 8 in 2024-02-05T07:22:25.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/974115197' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:25.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:25 smithi188 ceph-mon[33283]: from='client.26068 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi184-81207-34"}]: dispatch 2024-02-05T07:22:25.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:25 smithi188 ceph-mon[33283]: pgmap v276: 420 pgs: 64 unknown, 356 active+clean; 584 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:22:25.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:25 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:25.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:25 smithi188 ceph-mon[33283]: from='client.26068 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi184-81207-34"}]': finished 2024-02-05T07:22:25.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:25 smithi188 ceph-mon[33283]: osdmap e211: 8 total, 8 up, 8 in 2024-02-05T07:22:25.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4222433740' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:25.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:25 smithi188 ceph-mon[33283]: from='client.36092 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:26.400 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:26.401 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:26.401 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.401 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.401 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.401 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.401 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi184-81207-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:26.401 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi184-81207-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:26.401 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: from='client.36092 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:26.401 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:26.401 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: from='client.36098 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi184-81207-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:26.401 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-25"}]: dispatch 2024-02-05T07:22:26.401 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: osdmap e212: 8 total, 8 up, 8 in 2024-02-05T07:22:26.402 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi184-81207-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.402 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-25"}]: dispatch 2024-02-05T07:22:26.402 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:26 smithi188 ceph-mon[33283]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi184-81207-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:26.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:26.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi184-81207-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:26.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi184-81207-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:26.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: from='client.36092 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:26.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:26.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: from='client.36098 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi184-81207-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:26.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-25"}]: dispatch 2024-02-05T07:22:26.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: osdmap e212: 8 total, 8 up, 8 in 2024-02-05T07:22:26.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi184-81207-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-25"}]: dispatch 2024-02-05T07:22:26.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[29861]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi184-81207-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:26.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:26.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi184-81207-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:26.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi184-81207-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:26.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: from='client.36092 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:26.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:26.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: from='client.36098 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi184-81207-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:26.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-25"}]: dispatch 2024-02-05T07:22:26.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: osdmap e212: 8 total, 8 up, 8 in 2024-02-05T07:22:26.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi184-81207-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:26.526 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-25"}]: dispatch 2024-02-05T07:22:26.527 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:26 smithi184 ceph-mon[41609]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi184-81207-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:27.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:27 smithi184 ceph-mon[29861]: pgmap v279: 484 pgs: 128 unknown, 356 active+clean; 584 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:22:27.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:27 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-25"}]': finished 2024-02-05T07:22:27.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:27 smithi184 ceph-mon[41609]: pgmap v279: 484 pgs: 128 unknown, 356 active+clean; 584 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:22:27.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:27 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-25"}]': finished 2024-02-05T07:22:27.603 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:27 smithi188 ceph-mon[33283]: pgmap v279: 484 pgs: 128 unknown, 356 active+clean; 584 KiB data, 588 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:22:27.603 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:27 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-25"}]': finished 2024-02-05T07:22:27.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:22:27 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:22:28.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-25", "mode": "writeback"}]: dispatch 2024-02-05T07:22:28.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[29861]: osdmap e213: 8 total, 8 up, 8 in 2024-02-05T07:22:28.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3492075447' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:28.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-25", "mode": "writeback"}]: dispatch 2024-02-05T07:22:28.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[29861]: from='client.36104 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:28.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:28.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[29861]: from='client.36098 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi184-81207-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi184-81207-35"}]': finished 2024-02-05T07:22:28.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-25", "mode": "writeback"}]': finished 2024-02-05T07:22:28.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[29861]: from='client.36104 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:28.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[29861]: osdmap e214: 8 total, 8 up, 8 in 2024-02-05T07:22:28.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:28.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:28.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:22:28.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:22:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-25", "mode": "writeback"}]: dispatch 2024-02-05T07:22:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[41609]: osdmap e213: 8 total, 8 up, 8 in 2024-02-05T07:22:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3492075447' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-25", "mode": "writeback"}]: dispatch 2024-02-05T07:22:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[41609]: from='client.36104 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[41609]: from='client.36098 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi184-81207-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi184-81207-35"}]': finished 2024-02-05T07:22:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-25", "mode": "writeback"}]': finished 2024-02-05T07:22:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[41609]: from='client.36104 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[41609]: osdmap e214: 8 total, 8 up, 8 in 2024-02-05T07:22:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:28.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:28.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:22:28.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:28 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:22:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-25", "mode": "writeback"}]: dispatch 2024-02-05T07:22:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:28 smithi188 ceph-mon[33283]: osdmap e213: 8 total, 8 up, 8 in 2024-02-05T07:22:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3492075447' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:28 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-25", "mode": "writeback"}]: dispatch 2024-02-05T07:22:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:28 smithi188 ceph-mon[33283]: from='client.36104 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:28 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:28.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:28 smithi188 ceph-mon[33283]: from='client.36098 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi184-81207-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi184-81207-35"}]': finished 2024-02-05T07:22:28.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:28 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-25", "mode": "writeback"}]': finished 2024-02-05T07:22:28.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:28 smithi188 ceph-mon[33283]: from='client.36104 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi184-81228-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:28.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:28 smithi188 ceph-mon[33283]: osdmap e214: 8 total, 8 up, 8 in 2024-02-05T07:22:28.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:28.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:28 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:28.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:28 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:22:28.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:28 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:22:29.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:29 smithi184 ceph-mon[29861]: pgmap v282: 524 pgs: 40 unknown, 32 creating+peering, 452 active+clean; 584 KiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-05T07:22:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:29 smithi184 ceph-mon[29861]: osdmap e215: 8 total, 8 up, 8 in 2024-02-05T07:22:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25"}]: dispatch 2024-02-05T07:22:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25"}]: dispatch 2024-02-05T07:22:29.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:29.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:29 smithi184 ceph-mon[41609]: pgmap v282: 524 pgs: 40 unknown, 32 creating+peering, 452 active+clean; 584 KiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-05T07:22:29.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:29.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:29 smithi184 ceph-mon[41609]: osdmap e215: 8 total, 8 up, 8 in 2024-02-05T07:22:29.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25"}]: dispatch 2024-02-05T07:22:29.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25"}]: dispatch 2024-02-05T07:22:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:29 smithi188 ceph-mon[33283]: pgmap v282: 524 pgs: 40 unknown, 32 creating+peering, 452 active+clean; 584 KiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-05T07:22:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:29 smithi188 ceph-mon[33283]: osdmap e215: 8 total, 8 up, 8 in 2024-02-05T07:22:29.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25"}]: dispatch 2024-02-05T07:22:29.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25"}]: dispatch 2024-02-05T07:22:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:30 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:30 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25"}]': finished 2024-02-05T07:22:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:30 smithi184 ceph-mon[29861]: osdmap e216: 8 total, 8 up, 8 in 2024-02-05T07:22:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:30 smithi184 ceph-mon[29861]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:30 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:30 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25"}]': finished 2024-02-05T07:22:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:30 smithi184 ceph-mon[41609]: osdmap e216: 8 total, 8 up, 8 in 2024-02-05T07:22:30.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:30.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:30 smithi184 ceph-mon[41609]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:30 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:30 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-25"}]': finished 2024-02-05T07:22:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:30 smithi188 ceph-mon[33283]: osdmap e216: 8 total, 8 up, 8 in 2024-02-05T07:22:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:30 smithi188 ceph-mon[33283]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:31.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:31 smithi184 ceph-mon[29861]: pgmap v285: 420 pgs: 420 active+clean; 584 KiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-05T07:22:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:31 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:31 smithi184 ceph-mon[29861]: from='client.36098 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi184-81207-35"}]': finished 2024-02-05T07:22:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:31 smithi184 ceph-mon[29861]: osdmap e217: 8 total, 8 up, 8 in 2024-02-05T07:22:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:31 smithi184 ceph-mon[29861]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:31.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:31 smithi184 ceph-mon[41609]: pgmap v285: 420 pgs: 420 active+clean; 584 KiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-05T07:22:31.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:31 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:31.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:31 smithi184 ceph-mon[41609]: from='client.36098 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi184-81207-35"}]': finished 2024-02-05T07:22:31.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:31 smithi184 ceph-mon[41609]: osdmap e217: 8 total, 8 up, 8 in 2024-02-05T07:22:31.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:31 smithi184 ceph-mon[41609]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:31 smithi188 ceph-mon[33283]: pgmap v285: 420 pgs: 420 active+clean; 584 KiB data, 601 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-05T07:22:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:31 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:31 smithi188 ceph-mon[33283]: from='client.36098 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi184-81207-35"}]': finished 2024-02-05T07:22:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:31 smithi188 ceph-mon[33283]: osdmap e217: 8 total, 8 up, 8 in 2024-02-05T07:22:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/484388528' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:31 smithi188 ceph-mon[33283]: from='client.36098 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi184-81207-35"}]: dispatch 2024-02-05T07:22:32.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:22:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:22:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:22:33.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:32 smithi188 ceph-mon[33283]: from='client.36098 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi184-81207-35"}]': finished 2024-02-05T07:22:33.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:32 smithi188 ceph-mon[33283]: osdmap e218: 8 total, 8 up, 8 in 2024-02-05T07:22:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:32 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:32 smithi188 ceph-mon[33283]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:32 smithi188 ceph-mon[33283]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi184-81207-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:32 smithi188 ceph-mon[33283]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi184-81207-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:32 smithi188 ceph-mon[33283]: pgmap v288: 388 pgs: 64 unknown, 324 active+clean; 584 KiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:32 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:22:33.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[29861]: from='client.36098 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi184-81207-35"}]': finished 2024-02-05T07:22:33.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[29861]: osdmap e218: 8 total, 8 up, 8 in 2024-02-05T07:22:33.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:33.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:33.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:33.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[29861]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:33.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:33.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[29861]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:33.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi184-81207-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:33.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[29861]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi184-81207-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:33.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[29861]: pgmap v288: 388 pgs: 64 unknown, 324 active+clean; 584 KiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:33.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:22:33.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[41609]: from='client.36098 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi184-81207-35"}]': finished 2024-02-05T07:22:33.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[41609]: osdmap e218: 8 total, 8 up, 8 in 2024-02-05T07:22:33.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:33.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:33.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:33.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[41609]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:33.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:33.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[41609]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:33.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi184-81207-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:33.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[41609]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi184-81207-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:33.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[41609]: pgmap v288: 388 pgs: 64 unknown, 324 active+clean; 584 KiB data, 601 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:33.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:32 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:22:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:33 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:22:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:33 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:22:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:33 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:33 smithi188 ceph-mon[33283]: from='client.36122 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi184-81207-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:33 smithi188 ceph-mon[33283]: osdmap e219: 8 total, 8 up, 8 in 2024-02-05T07:22:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi184-81207-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:33 smithi188 ceph-mon[33283]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi184-81207-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:34.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:33 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:22:34.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:22:34.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:22:34.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:34.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[41609]: from='client.36122 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi184-81207-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:34.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[41609]: osdmap e219: 8 total, 8 up, 8 in 2024-02-05T07:22:34.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi184-81207-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:34.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[41609]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi184-81207-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:34.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:22:34.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:22:34.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:22:34.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:34.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[29861]: from='client.36122 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi184-81207-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:34.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[29861]: osdmap e219: 8 total, 8 up, 8 in 2024-02-05T07:22:34.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi184-81207-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:34.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[29861]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi184-81207-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:34.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:33 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:22:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:34 smithi188 ceph-mon[33283]: osdmap e220: 8 total, 8 up, 8 in 2024-02-05T07:22:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3896705372' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi184-81228-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:34 smithi188 ceph-mon[33283]: from='client.36128 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi184-81228-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:34 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:34 smithi188 ceph-mon[33283]: pgmap v291: 388 pgs: 64 unknown, 32 creating+peering, 292 active+clean; 583 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:22:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:34 smithi184 ceph-mon[29861]: osdmap e220: 8 total, 8 up, 8 in 2024-02-05T07:22:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3896705372' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi184-81228-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:34 smithi184 ceph-mon[29861]: from='client.36128 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi184-81228-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:34 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:34 smithi184 ceph-mon[29861]: pgmap v291: 388 pgs: 64 unknown, 32 creating+peering, 292 active+clean; 583 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:22:35.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:34 smithi184 ceph-mon[41609]: osdmap e220: 8 total, 8 up, 8 in 2024-02-05T07:22:35.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3896705372' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi184-81228-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:34 smithi184 ceph-mon[41609]: from='client.36128 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi184-81228-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:34 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:34 smithi184 ceph-mon[41609]: pgmap v291: 388 pgs: 64 unknown, 32 creating+peering, 292 active+clean; 583 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:22:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:35 smithi188 ceph-mon[33283]: from='client.36122 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi184-81207-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi184-81207-36"}]': finished 2024-02-05T07:22:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:35 smithi188 ceph-mon[33283]: from='client.36128 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi184-81228-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:35 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-27"}]: dispatch 2024-02-05T07:22:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:35 smithi188 ceph-mon[33283]: osdmap e221: 8 total, 8 up, 8 in 2024-02-05T07:22:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:35 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-27"}]: dispatch 2024-02-05T07:22:36.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:35 smithi184 ceph-mon[29861]: from='client.36122 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi184-81207-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi184-81207-36"}]': finished 2024-02-05T07:22:36.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:35 smithi184 ceph-mon[29861]: from='client.36128 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi184-81228-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:36.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:35 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-27"}]: dispatch 2024-02-05T07:22:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:35 smithi184 ceph-mon[29861]: osdmap e221: 8 total, 8 up, 8 in 2024-02-05T07:22:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:35 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-27"}]: dispatch 2024-02-05T07:22:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:35 smithi184 ceph-mon[41609]: from='client.36122 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi184-81207-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi184-81207-36"}]': finished 2024-02-05T07:22:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:35 smithi184 ceph-mon[41609]: from='client.36128 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi184-81228-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:35 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-27"}]: dispatch 2024-02-05T07:22:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:35 smithi184 ceph-mon[41609]: osdmap e221: 8 total, 8 up, 8 in 2024-02-05T07:22:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:35 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-27"}]: dispatch 2024-02-05T07:22:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:36 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-27"}]': finished 2024-02-05T07:22:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:36 smithi188 ceph-mon[33283]: osdmap e222: 8 total, 8 up, 8 in 2024-02-05T07:22:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-27", "mode": "writeback"}]: dispatch 2024-02-05T07:22:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:36 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-27", "mode": "writeback"}]: dispatch 2024-02-05T07:22:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:36 smithi188 ceph-mon[33283]: pgmap v294: 332 pgs: 8 unknown, 32 creating+peering, 292 active+clean; 583 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:22:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:36 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-27"}]': finished 2024-02-05T07:22:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:36 smithi184 ceph-mon[29861]: osdmap e222: 8 total, 8 up, 8 in 2024-02-05T07:22:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-27", "mode": "writeback"}]: dispatch 2024-02-05T07:22:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:36 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-27", "mode": "writeback"}]: dispatch 2024-02-05T07:22:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:36 smithi184 ceph-mon[29861]: pgmap v294: 332 pgs: 8 unknown, 32 creating+peering, 292 active+clean; 583 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:22:37.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:36 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-27"}]': finished 2024-02-05T07:22:37.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:36 smithi184 ceph-mon[41609]: osdmap e222: 8 total, 8 up, 8 in 2024-02-05T07:22:37.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-27", "mode": "writeback"}]: dispatch 2024-02-05T07:22:37.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:36 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-27", "mode": "writeback"}]: dispatch 2024-02-05T07:22:37.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:36 smithi184 ceph-mon[41609]: pgmap v294: 332 pgs: 8 unknown, 32 creating+peering, 292 active+clean; 583 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:22:37.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:22:37 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:22:37.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:37 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:37.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:37 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:37.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:37 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-27", "mode": "writeback"}]': finished 2024-02-05T07:22:37.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:37 smithi188 ceph-mon[33283]: osdmap e223: 8 total, 8 up, 8 in 2024-02-05T07:22:37.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:38.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2383860687' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi184-81228-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:38.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:37 smithi188 ceph-mon[33283]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:38.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:37 smithi188 ceph-mon[33283]: from='client.26137 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi184-81228-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-27", "mode": "writeback"}]': finished 2024-02-05T07:22:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[29861]: osdmap e223: 8 total, 8 up, 8 in 2024-02-05T07:22:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2383860687' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi184-81228-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[29861]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[29861]: from='client.26137 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi184-81228-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-27", "mode": "writeback"}]': finished 2024-02-05T07:22:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[41609]: osdmap e223: 8 total, 8 up, 8 in 2024-02-05T07:22:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2383860687' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi184-81228-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[41609]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:37 smithi184 ceph-mon[41609]: from='client.26137 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi184-81228-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:38.879 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: sta read_operations: Running main() from gmock_main.cc 2024-02-05T07:22:38.879 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [==========] Running 14 tests from 1 test suite. 2024-02-05T07:22:38.879 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [----------] Global test environment set-up. 2024-02-05T07:22:38.879 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps 2024-02-05T07:22:38.880 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2024-02-05T07:22:38.880 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (120785 ms) 2024-02-05T07:22:38.880 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2024-02-05T07:22:38.880 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (3002 ms) 2024-02-05T07:22:38.880 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2024-02-05T07:22:38.880 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (3261 ms) 2024-02-05T07:22:38.880 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2024-02-05T07:22:38.880 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (2763 ms) 2024-02-05T07:22:38.880 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2024-02-05T07:22:38.880 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (3015 ms) 2024-02-05T07:22:38.880 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2024-02-05T07:22:38.880 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (3022 ms) 2024-02-05T07:22:38.880 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2024-02-05T07:22:38.881 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (3019 ms) 2024-02-05T07:22:38.881 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2024-02-05T07:22:38.881 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (3038 ms) 2024-02-05T07:22:38.881 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2024-02-05T07:22:38.881 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (3021 ms) 2024-02-05T07:22:38.881 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2024-02-05T07:22:38.881 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (3247 ms) 2024-02-05T07:22:38.881 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2024-02-05T07:22:38.881 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (2555 ms) 2024-02-05T07:22:38.881 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2024-02-05T07:22:38.881 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (3027 ms) 2024-02-05T07:22:38.881 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2024-02-05T07:22:38.881 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (3011 ms) 2024-02-05T07:22:38.882 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2024-02-05T07:22:38.882 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (3034 ms) 2024-02-05T07:22:38.882 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps (159800 ms total) 2024-02-05T07:22:38.882 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: 2024-02-05T07:22:38.882 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [----------] Global test environment tear-down 2024-02-05T07:22:38.882 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [==========] 14 tests from 1 test suite ran. (159800 ms total) 2024-02-05T07:22:38.882 INFO:tasks.workunit.client.0.smithi184.stdout: read_operations: [ PASSED ] 14 tests. 2024-02-05T07:22:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:38 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:38 smithi188 ceph-mon[33283]: from='client.36122 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi184-81207-36"}]': finished 2024-02-05T07:22:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:38 smithi188 ceph-mon[33283]: from='client.26137 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi184-81228-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:38 smithi188 ceph-mon[33283]: osdmap e224: 8 total, 8 up, 8 in 2024-02-05T07:22:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:38 smithi188 ceph-mon[33283]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:39.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:38 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:39.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:38 smithi188 ceph-mon[33283]: pgmap v297: 388 pgs: 64 creating+peering, 324 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-05T07:22:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[29861]: from='client.36122 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi184-81207-36"}]': finished 2024-02-05T07:22:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[29861]: from='client.26137 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi184-81228-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[29861]: osdmap e224: 8 total, 8 up, 8 in 2024-02-05T07:22:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[29861]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[29861]: pgmap v297: 388 pgs: 64 creating+peering, 324 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-05T07:22:39.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:39.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[41609]: from='client.36122 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi184-81207-36"}]': finished 2024-02-05T07:22:39.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[41609]: from='client.26137 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi184-81228-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:39.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[41609]: osdmap e224: 8 total, 8 up, 8 in 2024-02-05T07:22:39.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/507057548' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:39.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[41609]: from='client.36122 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi184-81207-36"}]: dispatch 2024-02-05T07:22:39.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:39.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:39.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:38 smithi184 ceph-mon[41609]: pgmap v297: 388 pgs: 64 creating+peering, 324 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-05T07:22:40.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.36122 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi184-81207-36"}]': finished 2024-02-05T07:22:40.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:40.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: osdmap e225: 8 total, 8 up, 8 in 2024-02-05T07:22:40.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27"}]: dispatch 2024-02-05T07:22:40.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27"}]: dispatch 2024-02-05T07:22:40.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:40.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:40.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:40.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:40.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:40.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:40.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:40.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:40.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:40.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:40.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:40.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:39 smithi188 ceph-mon[33283]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.36122 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi184-81207-36"}]': finished 2024-02-05T07:22:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: osdmap e225: 8 total, 8 up, 8 in 2024-02-05T07:22:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27"}]: dispatch 2024-02-05T07:22:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27"}]: dispatch 2024-02-05T07:22:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:40.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:40.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:40.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:40.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:40.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:40.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:40.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:40.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:40.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:40.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[29861]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:40.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.36122 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi184-81207-36"}]': finished 2024-02-05T07:22:40.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:40.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: osdmap e225: 8 total, 8 up, 8 in 2024-02-05T07:22:40.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27"}]: dispatch 2024-02-05T07:22:40.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27"}]: dispatch 2024-02-05T07:22:40.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:40.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:40.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:40.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:40.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:40.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:40.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:40.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:40.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:40.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:40.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:40.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:39 smithi184 ceph-mon[41609]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:41.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:40 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:41.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:40 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27"}]': finished 2024-02-05T07:22:41.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:40 smithi188 ceph-mon[33283]: from='client.26140 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:41.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:40 smithi188 ceph-mon[33283]: from='client.36152 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:41.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:40 smithi188 ceph-mon[33283]: osdmap e226: 8 total, 8 up, 8 in 2024-02-05T07:22:41.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi184-81207-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:41.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:40 smithi188 ceph-mon[33283]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi184-81207-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:41.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:41.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:40 smithi188 ceph-mon[33283]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:41.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:40 smithi188 ceph-mon[33283]: pgmap v300: 324 pgs: 324 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-05T07:22:41.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:41.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27"}]': finished 2024-02-05T07:22:41.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[41609]: from='client.26140 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:41.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[41609]: from='client.36152 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:41.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[41609]: osdmap e226: 8 total, 8 up, 8 in 2024-02-05T07:22:41.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi184-81207-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:41.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[41609]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi184-81207-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:41.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:41.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[41609]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:41.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[41609]: pgmap v300: 324 pgs: 324 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-05T07:22:41.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:41.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-27"}]': finished 2024-02-05T07:22:41.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[29861]: from='client.26140 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:41.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[29861]: from='client.36152 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:41.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[29861]: osdmap e226: 8 total, 8 up, 8 in 2024-02-05T07:22:41.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi184-81207-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:41.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[29861]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi184-81207-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:41.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:41.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[29861]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:41.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:40 smithi184 ceph-mon[29861]: pgmap v300: 324 pgs: 324 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-05T07:22:42.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:41 smithi188 ceph-mon[33283]: osdmap e227: 8 total, 8 up, 8 in 2024-02-05T07:22:42.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:41 smithi184 ceph-mon[29861]: osdmap e227: 8 total, 8 up, 8 in 2024-02-05T07:22:42.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:22:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:22:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:22:42.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:41 smithi184 ceph-mon[41609]: osdmap e227: 8 total, 8 up, 8 in 2024-02-05T07:22:43.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:42 smithi188 ceph-mon[33283]: from='client.26140 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi184-81207-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi184-81207-37"}]': finished 2024-02-05T07:22:43.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:42 smithi188 ceph-mon[33283]: from='client.36152 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-46"}]': finished 2024-02-05T07:22:43.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:42 smithi188 ceph-mon[33283]: osdmap e228: 8 total, 8 up, 8 in 2024-02-05T07:22:43.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:43.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:42 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:43.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:42 smithi188 ceph-mon[33283]: pgmap v303: 340 pgs: 48 unknown, 292 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:43.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:42 smithi184 ceph-mon[29861]: from='client.26140 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi184-81207-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi184-81207-37"}]': finished 2024-02-05T07:22:43.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:42 smithi184 ceph-mon[29861]: from='client.36152 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-46"}]': finished 2024-02-05T07:22:43.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:42 smithi184 ceph-mon[29861]: osdmap e228: 8 total, 8 up, 8 in 2024-02-05T07:22:43.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:43.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:42 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:43.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:42 smithi184 ceph-mon[29861]: pgmap v303: 340 pgs: 48 unknown, 292 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:43.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:42 smithi184 ceph-mon[41609]: from='client.26140 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi184-81207-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi184-81207-37"}]': finished 2024-02-05T07:22:43.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:42 smithi184 ceph-mon[41609]: from='client.36152 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-46"}]': finished 2024-02-05T07:22:43.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:42 smithi184 ceph-mon[41609]: osdmap e228: 8 total, 8 up, 8 in 2024-02-05T07:22:43.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:43.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:42 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:43.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:42 smithi184 ceph-mon[41609]: pgmap v303: 340 pgs: 48 unknown, 292 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:43 smithi188 ceph-mon[33283]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:43 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:43 smithi188 ceph-mon[33283]: osdmap e229: 8 total, 8 up, 8 in 2024-02-05T07:22:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:43 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:22:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:43 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:22:44.277 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:43 smithi184 ceph-mon[29861]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:44.277 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:43 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:44.277 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:43 smithi184 ceph-mon[29861]: osdmap e229: 8 total, 8 up, 8 in 2024-02-05T07:22:44.277 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:43 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:22:44.277 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:43 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:22:44.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:43 smithi184 ceph-mon[41609]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:44.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:43 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:44.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:43 smithi184 ceph-mon[41609]: osdmap e229: 8 total, 8 up, 8 in 2024-02-05T07:22:44.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:43 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:22:44.278 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:43 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:22:45.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:44 smithi188 ceph-mon[33283]: osdmap e230: 8 total, 8 up, 8 in 2024-02-05T07:22:45.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:44 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:45.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:44 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:45.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:44 smithi188 ceph-mon[33283]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:45.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:44 smithi188 ceph-mon[33283]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:45.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:44 smithi188 ceph-mon[33283]: pgmap v306: 324 pgs: 32 creating+peering, 292 active+clean; 584 KiB data, 551 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:22:45.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:44 smithi184 ceph-mon[29861]: osdmap e230: 8 total, 8 up, 8 in 2024-02-05T07:22:45.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:44 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:45.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:44 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:45.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:44 smithi184 ceph-mon[29861]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:45.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:44 smithi184 ceph-mon[29861]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:45.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:44 smithi184 ceph-mon[29861]: pgmap v306: 324 pgs: 32 creating+peering, 292 active+clean; 584 KiB data, 551 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:22:45.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:44 smithi184 ceph-mon[41609]: osdmap e230: 8 total, 8 up, 8 in 2024-02-05T07:22:45.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:44 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:45.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:44 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:45.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:44 smithi184 ceph-mon[41609]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:45.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:44 smithi184 ceph-mon[41609]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:45.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:44 smithi184 ceph-mon[41609]: pgmap v306: 324 pgs: 32 creating+peering, 292 active+clean; 584 KiB data, 551 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:22:46.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:45 smithi188 ceph-mon[33283]: from='client.36152 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-46"}]': finished 2024-02-05T07:22:46.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:45 smithi188 ceph-mon[33283]: from='client.26140 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37"}]': finished 2024-02-05T07:22:46.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:46.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:45 smithi188 ceph-mon[33283]: osdmap e231: 8 total, 8 up, 8 in 2024-02-05T07:22:46.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:46.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:45 smithi188 ceph-mon[33283]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:46.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:45 smithi188 ceph-mon[33283]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:46.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:46.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:45 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:46.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[29861]: from='client.36152 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-46"}]': finished 2024-02-05T07:22:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[29861]: from='client.26140 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37"}]': finished 2024-02-05T07:22:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[29861]: osdmap e231: 8 total, 8 up, 8 in 2024-02-05T07:22:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[29861]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[29861]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:46.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[41609]: from='client.36152 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-46"}]': finished 2024-02-05T07:22:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[41609]: from='client.26140 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi184-81207-37"}]': finished 2024-02-05T07:22:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3637146345' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[41609]: osdmap e231: 8 total, 8 up, 8 in 2024-02-05T07:22:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2214672717' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[41609]: from='client.26140 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi184-81207-37"}]: dispatch 2024-02-05T07:22:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[41609]: from='client.36152 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-46"}]: dispatch 2024-02-05T07:22:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:46.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:45 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.26140 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi184-81207-37"}]': finished 2024-02-05T07:22:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.36152 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-46"}]': finished 2024-02-05T07:22:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: osdmap e232: 8 total, 8 up, 8 in 2024-02-05T07:22:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-29"}]: dispatch 2024-02-05T07:22:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-29"}]: dispatch 2024-02-05T07:22:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi184-81207-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi184-81207-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:47.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:47.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: pgmap v309: 324 pgs: 32 creating+peering, 292 active+clean; 584 KiB data, 551 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:22:47.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-29"}]': finished 2024-02-05T07:22:47.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.26152 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi184-81207-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:47.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.36164 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:47.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: osdmap e233: 8 total, 8 up, 8 in 2024-02-05T07:22:47.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi184-81207-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-29", "mode": "writeback"}]: dispatch 2024-02-05T07:22:47.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi184-81207-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.251 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-29", "mode": "writeback"}]: dispatch 2024-02-05T07:22:47.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:46 smithi188 ceph-mon[33283]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.26140 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi184-81207-37"}]': finished 2024-02-05T07:22:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.36152 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-46"}]': finished 2024-02-05T07:22:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: osdmap e232: 8 total, 8 up, 8 in 2024-02-05T07:22:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-29"}]: dispatch 2024-02-05T07:22:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-29"}]: dispatch 2024-02-05T07:22:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi184-81207-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi184-81207-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:47.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:47.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: pgmap v309: 324 pgs: 32 creating+peering, 292 active+clean; 584 KiB data, 551 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:22:47.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.26140 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi184-81207-37"}]': finished 2024-02-05T07:22:47.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.36152 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-46"}]': finished 2024-02-05T07:22:47.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:47.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: osdmap e232: 8 total, 8 up, 8 in 2024-02-05T07:22:47.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-29"}]: dispatch 2024-02-05T07:22:47.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-29"}]: dispatch 2024-02-05T07:22:47.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi184-81207-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:47.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi184-81207-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:47.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:47.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:47.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: pgmap v309: 324 pgs: 32 creating+peering, 292 active+clean; 584 KiB data, 551 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:22:47.275 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-29"}]': finished 2024-02-05T07:22:47.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.26152 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi184-81207-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:47.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.36164 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:47.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: osdmap e233: 8 total, 8 up, 8 in 2024-02-05T07:22:47.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi184-81207-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-29", "mode": "writeback"}]: dispatch 2024-02-05T07:22:47.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi184-81207-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-29", "mode": "writeback"}]: dispatch 2024-02-05T07:22:47.276 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[29861]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-29"}]': finished 2024-02-05T07:22:47.276 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.26152 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi184-81207-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:47.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.36164 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi184-81228-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:47.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: osdmap e233: 8 total, 8 up, 8 in 2024-02-05T07:22:47.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi184-81207-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-29", "mode": "writeback"}]: dispatch 2024-02-05T07:22:47.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi184-81207-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:47.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-29", "mode": "writeback"}]: dispatch 2024-02-05T07:22:47.277 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:46 smithi184 ceph-mon[41609]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:47.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:22:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:22:48.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:48 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:48.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:48 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-29", "mode": "writeback"}]': finished 2024-02-05T07:22:48.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:48 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:48.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:48 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-29", "mode": "writeback"}]': finished 2024-02-05T07:22:48.777 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:48 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:48.778 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:48 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-29", "mode": "writeback"}]': finished 2024-02-05T07:22:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:49 smithi188 ceph-mon[33283]: pgmap v312: 324 pgs: 324 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-02-05T07:22:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:49 smithi188 ceph-mon[33283]: osdmap e234: 8 total, 8 up, 8 in 2024-02-05T07:22:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:49 smithi188 ceph-mon[33283]: from='client.26152 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi184-81207-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi184-81207-38"}]': finished 2024-02-05T07:22:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:49 smithi188 ceph-mon[33283]: from='client.36164 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-47"}]': finished 2024-02-05T07:22:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:49 smithi188 ceph-mon[33283]: osdmap e235: 8 total, 8 up, 8 in 2024-02-05T07:22:49.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:49.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:49 smithi184 ceph-mon[41609]: pgmap v312: 324 pgs: 324 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-02-05T07:22:49.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:49 smithi184 ceph-mon[41609]: osdmap e234: 8 total, 8 up, 8 in 2024-02-05T07:22:49.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:49 smithi184 ceph-mon[41609]: from='client.26152 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi184-81207-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi184-81207-38"}]': finished 2024-02-05T07:22:49.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:49 smithi184 ceph-mon[41609]: from='client.36164 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-47"}]': finished 2024-02-05T07:22:49.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:49 smithi184 ceph-mon[41609]: osdmap e235: 8 total, 8 up, 8 in 2024-02-05T07:22:49.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:49.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:49 smithi184 ceph-mon[29861]: pgmap v312: 324 pgs: 324 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-02-05T07:22:49.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:49 smithi184 ceph-mon[29861]: osdmap e234: 8 total, 8 up, 8 in 2024-02-05T07:22:49.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:49 smithi184 ceph-mon[29861]: from='client.26152 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi184-81207-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi184-81207-38"}]': finished 2024-02-05T07:22:49.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:49 smithi184 ceph-mon[29861]: from='client.36164 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi184-81228-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi184-81228-47"}]': finished 2024-02-05T07:22:49.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:49 smithi184 ceph-mon[29861]: osdmap e235: 8 total, 8 up, 8 in 2024-02-05T07:22:50.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:50 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:50.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:50 smithi188 ceph-mon[33283]: osdmap e236: 8 total, 8 up, 8 in 2024-02-05T07:22:50.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:50 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:50.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:50 smithi184 ceph-mon[41609]: osdmap e236: 8 total, 8 up, 8 in 2024-02-05T07:22:50.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:50 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:50.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:50 smithi184 ceph-mon[29861]: osdmap e236: 8 total, 8 up, 8 in 2024-02-05T07:22:51.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:51 smithi188 ceph-mon[33283]: pgmap v315: 340 pgs: 16 unknown, 324 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-02-05T07:22:51.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:51 smithi188 ceph-mon[33283]: osdmap e237: 8 total, 8 up, 8 in 2024-02-05T07:22:51.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:51.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:51 smithi188 ceph-mon[33283]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:51.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:51.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:51 smithi188 ceph-mon[33283]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:51.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:51.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:51 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:51.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[29861]: pgmap v315: 340 pgs: 16 unknown, 324 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-02-05T07:22:51.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[29861]: osdmap e237: 8 total, 8 up, 8 in 2024-02-05T07:22:51.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:51.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[29861]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:51.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:51.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[29861]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:51.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:51.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:51.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[41609]: pgmap v315: 340 pgs: 16 unknown, 324 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-02-05T07:22:51.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[41609]: osdmap e237: 8 total, 8 up, 8 in 2024-02-05T07:22:51.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:51.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[41609]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:51.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:51.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[41609]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:51.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:51.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:22:52.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:22:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:22:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:22:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:52 smithi188 ceph-mon[33283]: from='client.26152 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi184-81207-38"}]': finished 2024-02-05T07:22:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:52 smithi188 ceph-mon[33283]: from='client.36164 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-47"}]': finished 2024-02-05T07:22:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:52 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:53.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:53.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:52 smithi188 ceph-mon[33283]: osdmap e238: 8 total, 8 up, 8 in 2024-02-05T07:22:53.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:52 smithi188 ceph-mon[33283]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:53.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:53.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29"}]: dispatch 2024-02-05T07:22:53.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:52 smithi188 ceph-mon[33283]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:53.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:52 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29"}]: dispatch 2024-02-05T07:22:53.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:52 smithi188 ceph-mon[33283]: pgmap v318: 324 pgs: 324 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[29861]: from='client.26152 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi184-81207-38"}]': finished 2024-02-05T07:22:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[29861]: from='client.36164 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-47"}]': finished 2024-02-05T07:22:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[29861]: osdmap e238: 8 total, 8 up, 8 in 2024-02-05T07:22:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[29861]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:53.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29"}]: dispatch 2024-02-05T07:22:53.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[29861]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:53.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29"}]: dispatch 2024-02-05T07:22:53.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[29861]: pgmap v318: 324 pgs: 324 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[41609]: from='client.26152 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi184-81207-38"}]': finished 2024-02-05T07:22:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[41609]: from='client.36164 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi184-81228-47"}]': finished 2024-02-05T07:22:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:22:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4236985211' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[41609]: osdmap e238: 8 total, 8 up, 8 in 2024-02-05T07:22:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[41609]: from='client.26152 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi184-81207-38"}]: dispatch 2024-02-05T07:22:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/945888273' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:53.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29"}]: dispatch 2024-02-05T07:22:53.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[41609]: from='client.36164 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-47"}]: dispatch 2024-02-05T07:22:53.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29"}]: dispatch 2024-02-05T07:22:53.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:52 smithi184 ceph-mon[41609]: pgmap v318: 324 pgs: 324 active+clean; 4.6 MiB data, 563 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:22:54.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:53 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:54.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:53 smithi188 ceph-mon[33283]: from='client.26152 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi184-81207-38"}]': finished 2024-02-05T07:22:54.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:53 smithi188 ceph-mon[33283]: from='client.36164 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-47"}]': finished 2024-02-05T07:22:54.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:53 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29"}]': finished 2024-02-05T07:22:54.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:53 smithi188 ceph-mon[33283]: osdmap e239: 8 total, 8 up, 8 in 2024-02-05T07:22:54.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:53 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi184-81207-39"}]: dispatch 2024-02-05T07:22:54.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:53 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi184-81207-39"}]: dispatch 2024-02-05T07:22:54.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:53 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi184-81207-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:54.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:53 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi184-81228-48"}]: dispatch 2024-02-05T07:22:54.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:53 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi184-81228-48"}]: dispatch 2024-02-05T07:22:54.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:53 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi184-81228-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:54.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[29861]: from='client.26152 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi184-81207-38"}]': finished 2024-02-05T07:22:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[29861]: from='client.36164 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-47"}]': finished 2024-02-05T07:22:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29"}]': finished 2024-02-05T07:22:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[29861]: osdmap e239: 8 total, 8 up, 8 in 2024-02-05T07:22:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi184-81207-39"}]: dispatch 2024-02-05T07:22:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi184-81207-39"}]: dispatch 2024-02-05T07:22:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi184-81207-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi184-81228-48"}]: dispatch 2024-02-05T07:22:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi184-81228-48"}]: dispatch 2024-02-05T07:22:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi184-81228-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:54.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:22:54.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[41609]: from='client.26152 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi184-81207-38"}]': finished 2024-02-05T07:22:54.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[41609]: from='client.36164 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi184-81228-47"}]': finished 2024-02-05T07:22:54.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-29"}]': finished 2024-02-05T07:22:54.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[41609]: osdmap e239: 8 total, 8 up, 8 in 2024-02-05T07:22:54.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi184-81207-39"}]: dispatch 2024-02-05T07:22:54.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi184-81207-39"}]: dispatch 2024-02-05T07:22:54.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi184-81207-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:54.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi184-81228-48"}]: dispatch 2024-02-05T07:22:54.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi184-81228-48"}]: dispatch 2024-02-05T07:22:54.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:53 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi184-81228-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:22:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi184-81207-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi184-81228-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:54 smithi188 ceph-mon[33283]: osdmap e240: 8 total, 8 up, 8 in 2024-02-05T07:22:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi184-81207-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi184-81207-39"}]: dispatch 2024-02-05T07:22:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi184-81228-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi184-81228-48"}]: dispatch 2024-02-05T07:22:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:54 smithi188 ceph-mon[33283]: pgmap v321: 292 pgs: 292 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-02-05T07:22:55.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi184-81207-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:55.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi184-81228-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:55.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:54 smithi184 ceph-mon[29861]: osdmap e240: 8 total, 8 up, 8 in 2024-02-05T07:22:55.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi184-81207-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi184-81207-39"}]: dispatch 2024-02-05T07:22:55.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi184-81228-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi184-81228-48"}]: dispatch 2024-02-05T07:22:55.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:54 smithi184 ceph-mon[29861]: pgmap v321: 292 pgs: 292 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-02-05T07:22:55.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi184-81207-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:55.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi184-81228-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:22:55.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:54 smithi184 ceph-mon[41609]: osdmap e240: 8 total, 8 up, 8 in 2024-02-05T07:22:55.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi184-81207-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi184-81207-39"}]: dispatch 2024-02-05T07:22:55.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi184-81228-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi184-81228-48"}]: dispatch 2024-02-05T07:22:55.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:54 smithi184 ceph-mon[41609]: pgmap v321: 292 pgs: 292 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-02-05T07:22:56.149 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:55 smithi188 ceph-mon[33283]: osdmap e241: 8 total, 8 up, 8 in 2024-02-05T07:22:56.149 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:55 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:56.149 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:55 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:56.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:55 smithi184 ceph-mon[29861]: osdmap e241: 8 total, 8 up, 8 in 2024-02-05T07:22:56.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:55 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:56.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:55 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:56.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:55 smithi184 ceph-mon[41609]: osdmap e241: 8 total, 8 up, 8 in 2024-02-05T07:22:56.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:55 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:56.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:55 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:22:57.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:56 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi184-81207-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi184-81207-39"}]': finished 2024-02-05T07:22:57.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:56 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi184-81228-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi184-81228-48"}]': finished 2024-02-05T07:22:57.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:56 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:57.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:56 smithi188 ceph-mon[33283]: osdmap e242: 8 total, 8 up, 8 in 2024-02-05T07:22:57.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:56 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:57.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:56 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:57.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:56 smithi188 ceph-mon[33283]: pgmap v324: 340 pgs: 48 unknown, 292 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-02-05T07:22:57.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:56 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:57.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:56 smithi188 ceph-mon[33283]: osdmap e243: 8 total, 8 up, 8 in 2024-02-05T07:22:57.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi184-81207-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi184-81207-39"}]': finished 2024-02-05T07:22:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi184-81228-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi184-81228-48"}]': finished 2024-02-05T07:22:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[29861]: osdmap e242: 8 total, 8 up, 8 in 2024-02-05T07:22:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[29861]: pgmap v324: 340 pgs: 48 unknown, 292 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-02-05T07:22:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[29861]: osdmap e243: 8 total, 8 up, 8 in 2024-02-05T07:22:57.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi184-81207-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi184-81207-39"}]': finished 2024-02-05T07:22:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi184-81228-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi184-81228-48"}]': finished 2024-02-05T07:22:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:22:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[41609]: osdmap e242: 8 total, 8 up, 8 in 2024-02-05T07:22:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:22:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[41609]: pgmap v324: 340 pgs: 48 unknown, 292 active+clean; 4.6 MiB data, 564 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-02-05T07:22:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:22:57.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:56 smithi184 ceph-mon[41609]: osdmap e243: 8 total, 8 up, 8 in 2024-02-05T07:22:57.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:22:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:22:57.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:57 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:57.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-31"}]: dispatch 2024-02-05T07:22:57.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:57 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-31"}]: dispatch 2024-02-05T07:22:57.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:57 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-31"}]': finished 2024-02-05T07:22:58.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:57 smithi188 ceph-mon[33283]: osdmap e244: 8 total, 8 up, 8 in 2024-02-05T07:22:58.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-31", "mode": "writeback"}]: dispatch 2024-02-05T07:22:58.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:57 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-31", "mode": "writeback"}]: dispatch 2024-02-05T07:22:58.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi184-81228-48"}]: dispatch 2024-02-05T07:22:58.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi184-81207-39"}]: dispatch 2024-02-05T07:22:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-31"}]: dispatch 2024-02-05T07:22:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-31"}]: dispatch 2024-02-05T07:22:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-31"}]': finished 2024-02-05T07:22:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[29861]: osdmap e244: 8 total, 8 up, 8 in 2024-02-05T07:22:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-31", "mode": "writeback"}]: dispatch 2024-02-05T07:22:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-31", "mode": "writeback"}]: dispatch 2024-02-05T07:22:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi184-81228-48"}]: dispatch 2024-02-05T07:22:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi184-81207-39"}]: dispatch 2024-02-05T07:22:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:22:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-31"}]: dispatch 2024-02-05T07:22:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-31"}]: dispatch 2024-02-05T07:22:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-31"}]': finished 2024-02-05T07:22:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[41609]: osdmap e244: 8 total, 8 up, 8 in 2024-02-05T07:22:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-31", "mode": "writeback"}]: dispatch 2024-02-05T07:22:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-31", "mode": "writeback"}]: dispatch 2024-02-05T07:22:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi184-81228-48"}]: dispatch 2024-02-05T07:22:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi184-81207-39"}]: dispatch 2024-02-05T07:22:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:58 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:58 smithi188 ceph-mon[33283]: pgmap v327: 324 pgs: 324 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:22:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:22:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:58 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:58 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-31", "mode": "writeback"}]': finished 2024-02-05T07:22:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi184-81228-48"}]': finished 2024-02-05T07:22:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi184-81207-39"}]': finished 2024-02-05T07:22:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:58 smithi188 ceph-mon[33283]: osdmap e245: 8 total, 8 up, 8 in 2024-02-05T07:22:59.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi184-81207-39"}]: dispatch 2024-02-05T07:22:59.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi184-81228-48"}]: dispatch 2024-02-05T07:22:59.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[29861]: pgmap v327: 324 pgs: 324 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:22:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:22:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-31", "mode": "writeback"}]': finished 2024-02-05T07:22:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi184-81228-48"}]': finished 2024-02-05T07:22:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi184-81207-39"}]': finished 2024-02-05T07:22:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[29861]: osdmap e245: 8 total, 8 up, 8 in 2024-02-05T07:22:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi184-81207-39"}]: dispatch 2024-02-05T07:22:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi184-81228-48"}]: dispatch 2024-02-05T07:22:59.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:22:59.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[41609]: pgmap v327: 324 pgs: 324 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:22:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:22:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:22:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-31", "mode": "writeback"}]': finished 2024-02-05T07:22:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi184-81228-48"}]': finished 2024-02-05T07:22:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi184-81207-39"}]': finished 2024-02-05T07:22:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[41609]: osdmap e245: 8 total, 8 up, 8 in 2024-02-05T07:22:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi184-81207-39"}]: dispatch 2024-02-05T07:22:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi184-81228-48"}]: dispatch 2024-02-05T07:23:00.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:00.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:00.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi184-81207-39"}]': finished 2024-02-05T07:23:00.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi184-81228-48"}]': finished 2024-02-05T07:23:00.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: osdmap e246: 8 total, 8 up, 8 in 2024-02-05T07:23:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31"}]: dispatch 2024-02-05T07:23:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31"}]: dispatch 2024-02-05T07:23:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi184-81228-49"}]: dispatch 2024-02-05T07:23:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi184-81228-49"}]: dispatch 2024-02-05T07:23:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi184-81228-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi184-81207-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:22:59 smithi188 ceph-mon[33283]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi184-81207-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi184-81207-39"}]': finished 2024-02-05T07:23:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi184-81228-48"}]': finished 2024-02-05T07:23:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: osdmap e246: 8 total, 8 up, 8 in 2024-02-05T07:23:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31"}]: dispatch 2024-02-05T07:23:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31"}]: dispatch 2024-02-05T07:23:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi184-81228-49"}]: dispatch 2024-02-05T07:23:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:00.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi184-81228-49"}]: dispatch 2024-02-05T07:23:00.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:00.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi184-81228-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:00.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:00.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi184-81207-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:00.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[29861]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi184-81207-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:00.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:00.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:00.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3025537002' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi184-81207-39"}]': finished 2024-02-05T07:23:00.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1826565880' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi184-81228-48"}]': finished 2024-02-05T07:23:00.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: osdmap e246: 8 total, 8 up, 8 in 2024-02-05T07:23:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31"}]: dispatch 2024-02-05T07:23:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31"}]: dispatch 2024-02-05T07:23:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi184-81228-49"}]: dispatch 2024-02-05T07:23:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi184-81228-49"}]: dispatch 2024-02-05T07:23:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi184-81228-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi184-81207-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:22:59 smithi184 ceph-mon[41609]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi184-81207-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:00 smithi188 ceph-mon[33283]: pgmap v330: 324 pgs: 324 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:00 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:23:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:00 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31"}]': finished 2024-02-05T07:23:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi184-81228-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:00 smithi188 ceph-mon[33283]: from='client.36188 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi184-81207-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:00 smithi188 ceph-mon[33283]: osdmap e247: 8 total, 8 up, 8 in 2024-02-05T07:23:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi184-81228-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi184-81228-49"}]: dispatch 2024-02-05T07:23:01.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi184-81207-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:01.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:00 smithi188 ceph-mon[33283]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi184-81207-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:01.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[29861]: pgmap v330: 324 pgs: 324 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:01.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:23:01.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31"}]': finished 2024-02-05T07:23:01.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi184-81228-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:01.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[29861]: from='client.36188 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi184-81207-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:01.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[29861]: osdmap e247: 8 total, 8 up, 8 in 2024-02-05T07:23:01.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi184-81228-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi184-81228-49"}]: dispatch 2024-02-05T07:23:01.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi184-81207-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:01.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[29861]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi184-81207-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:01.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[41609]: pgmap v330: 324 pgs: 324 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:01.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:23:01.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-31"}]': finished 2024-02-05T07:23:01.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi184-81228-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:01.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[41609]: from='client.36188 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi184-81207-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:01.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[41609]: osdmap e247: 8 total, 8 up, 8 in 2024-02-05T07:23:01.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi184-81228-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi184-81228-49"}]: dispatch 2024-02-05T07:23:01.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi184-81207-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:01.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:00 smithi184 ceph-mon[41609]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi184-81207-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:02.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:23:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:23:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:23:03.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:02 smithi188 ceph-mon[33283]: pgmap v333: 292 pgs: 292 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:03.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:02 smithi188 ceph-mon[33283]: osdmap e248: 8 total, 8 up, 8 in 2024-02-05T07:23:03.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:02 smithi184 ceph-mon[29861]: pgmap v333: 292 pgs: 292 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:03.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:02 smithi184 ceph-mon[29861]: osdmap e248: 8 total, 8 up, 8 in 2024-02-05T07:23:03.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:02 smithi184 ceph-mon[41609]: pgmap v333: 292 pgs: 292 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:03.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:02 smithi184 ceph-mon[41609]: osdmap e248: 8 total, 8 up, 8 in 2024-02-05T07:23:04.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:03 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi184-81228-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi184-81228-49"}]': finished 2024-02-05T07:23:04.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:03 smithi188 ceph-mon[33283]: from='client.36188 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi184-81207-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi184-81207-40"}]': finished 2024-02-05T07:23:04.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:03 smithi188 ceph-mon[33283]: osdmap e249: 8 total, 8 up, 8 in 2024-02-05T07:23:04.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:03 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:04.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:03 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:04.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:03 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi184-81228-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi184-81228-49"}]': finished 2024-02-05T07:23:04.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:03 smithi184 ceph-mon[29861]: from='client.36188 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi184-81207-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi184-81207-40"}]': finished 2024-02-05T07:23:04.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:03 smithi184 ceph-mon[29861]: osdmap e249: 8 total, 8 up, 8 in 2024-02-05T07:23:04.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:03 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:04.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:03 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:04.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:03 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi184-81228-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi184-81228-49"}]': finished 2024-02-05T07:23:04.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:03 smithi184 ceph-mon[41609]: from='client.36188 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi184-81207-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi184-81207-40"}]': finished 2024-02-05T07:23:04.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:03 smithi184 ceph-mon[41609]: osdmap e249: 8 total, 8 up, 8 in 2024-02-05T07:23:04.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:03 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:04.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:03 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:05.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:04 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:05.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:04 smithi188 ceph-mon[33283]: osdmap e250: 8 total, 8 up, 8 in 2024-02-05T07:23:05.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:04 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:05.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:04 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:05.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:04 smithi188 ceph-mon[33283]: pgmap v336: 340 pgs: 48 unknown, 292 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:23:05.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:04 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:04 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:04 smithi184 ceph-mon[29861]: osdmap e250: 8 total, 8 up, 8 in 2024-02-05T07:23:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:04 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:04 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:04 smithi184 ceph-mon[29861]: pgmap v336: 340 pgs: 48 unknown, 292 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:23:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:04 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:05.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:04 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:04 smithi184 ceph-mon[41609]: osdmap e250: 8 total, 8 up, 8 in 2024-02-05T07:23:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:04 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:04 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:04 smithi184 ceph-mon[41609]: pgmap v336: 340 pgs: 48 unknown, 292 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:23:05.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:04 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:06.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:05 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:06.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:05 smithi188 ceph-mon[33283]: osdmap e251: 8 total, 8 up, 8 in 2024-02-05T07:23:06.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-33"}]: dispatch 2024-02-05T07:23:06.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:06.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:05 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-33"}]: dispatch 2024-02-05T07:23:06.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:05 smithi188 ceph-mon[33283]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:06.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi184-81228-49"}]: dispatch 2024-02-05T07:23:06.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:05 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:06.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:05 smithi184 ceph-mon[29861]: osdmap e251: 8 total, 8 up, 8 in 2024-02-05T07:23:06.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-33"}]: dispatch 2024-02-05T07:23:06.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:06.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:05 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-33"}]: dispatch 2024-02-05T07:23:06.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:05 smithi184 ceph-mon[29861]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:06.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi184-81228-49"}]: dispatch 2024-02-05T07:23:06.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:05 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:06.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:05 smithi184 ceph-mon[41609]: osdmap e251: 8 total, 8 up, 8 in 2024-02-05T07:23:06.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-33"}]: dispatch 2024-02-05T07:23:06.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:06.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:05 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-33"}]: dispatch 2024-02-05T07:23:06.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:05 smithi184 ceph-mon[41609]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:06.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi184-81228-49"}]: dispatch 2024-02-05T07:23:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:06 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-33"}]': finished 2024-02-05T07:23:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:06 smithi188 ceph-mon[33283]: from='client.36188 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi184-81207-40"}]': finished 2024-02-05T07:23:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi184-81228-49"}]': finished 2024-02-05T07:23:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:06 smithi188 ceph-mon[33283]: osdmap e252: 8 total, 8 up, 8 in 2024-02-05T07:23:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi184-81228-49"}]: dispatch 2024-02-05T07:23:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-33", "mode": "writeback"}]: dispatch 2024-02-05T07:23:07.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:06 smithi188 ceph-mon[33283]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:07.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:06 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-33", "mode": "writeback"}]: dispatch 2024-02-05T07:23:07.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:06 smithi188 ceph-mon[33283]: pgmap v339: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:23:07.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:06 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:23:07.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi184-81228-49"}]': finished 2024-02-05T07:23:07.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:06 smithi188 ceph-mon[33283]: from='client.36188 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi184-81207-40"}]': finished 2024-02-05T07:23:07.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:06 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-33", "mode": "writeback"}]': finished 2024-02-05T07:23:07.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:06 smithi188 ceph-mon[33283]: osdmap e253: 8 total, 8 up, 8 in 2024-02-05T07:23:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-33"}]': finished 2024-02-05T07:23:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[29861]: from='client.36188 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi184-81207-40"}]': finished 2024-02-05T07:23:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi184-81228-49"}]': finished 2024-02-05T07:23:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[29861]: osdmap e252: 8 total, 8 up, 8 in 2024-02-05T07:23:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi184-81228-49"}]: dispatch 2024-02-05T07:23:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-33", "mode": "writeback"}]: dispatch 2024-02-05T07:23:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[29861]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-33", "mode": "writeback"}]: dispatch 2024-02-05T07:23:07.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[29861]: pgmap v339: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:23:07.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:23:07.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi184-81228-49"}]': finished 2024-02-05T07:23:07.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[29861]: from='client.36188 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi184-81207-40"}]': finished 2024-02-05T07:23:07.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-33", "mode": "writeback"}]': finished 2024-02-05T07:23:07.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[29861]: osdmap e253: 8 total, 8 up, 8 in 2024-02-05T07:23:07.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-33"}]': finished 2024-02-05T07:23:07.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[41609]: from='client.36188 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi184-81207-40"}]': finished 2024-02-05T07:23:07.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi184-81228-49"}]': finished 2024-02-05T07:23:07.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[41609]: osdmap e252: 8 total, 8 up, 8 in 2024-02-05T07:23:07.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi184-81228-49"}]: dispatch 2024-02-05T07:23:07.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3705550670' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:07.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-33", "mode": "writeback"}]: dispatch 2024-02-05T07:23:07.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[41609]: from='client.36188 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi184-81207-40"}]: dispatch 2024-02-05T07:23:07.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-33", "mode": "writeback"}]: dispatch 2024-02-05T07:23:07.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[41609]: pgmap v339: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 565 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:23:07.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:23:07.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3832315786' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi184-81228-49"}]': finished 2024-02-05T07:23:07.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[41609]: from='client.36188 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi184-81207-40"}]': finished 2024-02-05T07:23:07.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-33", "mode": "writeback"}]': finished 2024-02-05T07:23:07.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:06 smithi184 ceph-mon[41609]: osdmap e253: 8 total, 8 up, 8 in 2024-02-05T07:23:07.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:23:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:23:07.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:07.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:07 smithi188 ceph-mon[33283]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:08.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:08.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:07 smithi188 ceph-mon[33283]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:08.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi184-81228-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:08.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:07 smithi188 ceph-mon[33283]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi184-81228-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:08.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:08.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:07 smithi188 ceph-mon[33283]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:08.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:08.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:07 smithi188 ceph-mon[33283]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:08.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi184-81207-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:08.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:07 smithi188 ceph-mon[33283]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi184-81207-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:08.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:08.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:07 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:08.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:08.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[29861]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:08.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:08.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[29861]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:08.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi184-81228-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:08.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[29861]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi184-81228-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:08.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:08.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[29861]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:08.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:08.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[29861]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:08.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi184-81207-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:08.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[29861]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi184-81207-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:08.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:08.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:08.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:08.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[41609]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:08.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:08.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[41609]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:08.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi184-81228-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:08.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[41609]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi184-81228-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:08.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:08.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[41609]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:08.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:08.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[41609]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:08.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi184-81207-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:08.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[41609]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi184-81207-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:08.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:08.176 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:07 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:09 smithi188 ceph-mon[33283]: from='client.26182 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi184-81228-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:09 smithi188 ceph-mon[33283]: from='client.26188 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi184-81207-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:09 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi184-81228-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi184-81207-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:09 smithi188 ceph-mon[33283]: osdmap e254: 8 total, 8 up, 8 in 2024-02-05T07:23:09.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33"}]: dispatch 2024-02-05T07:23:09.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:09 smithi188 ceph-mon[33283]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi184-81228-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:09.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:09 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33"}]: dispatch 2024-02-05T07:23:09.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:09 smithi188 ceph-mon[33283]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi184-81207-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:09.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:09 smithi188 ceph-mon[33283]: pgmap v342: 324 pgs: 324 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-05T07:23:09.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:09 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:23:09.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:09 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33"}]': finished 2024-02-05T07:23:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[29861]: from='client.26182 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi184-81228-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[29861]: from='client.26188 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi184-81207-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi184-81228-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi184-81207-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[29861]: osdmap e254: 8 total, 8 up, 8 in 2024-02-05T07:23:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33"}]: dispatch 2024-02-05T07:23:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[29861]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi184-81228-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:09.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33"}]: dispatch 2024-02-05T07:23:09.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[29861]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi184-81207-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:09.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[29861]: pgmap v342: 324 pgs: 324 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-05T07:23:09.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:23:09.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33"}]': finished 2024-02-05T07:23:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[41609]: from='client.26182 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi184-81228-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[41609]: from='client.26188 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi184-81207-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi184-81228-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi184-81207-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:09.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[41609]: osdmap e254: 8 total, 8 up, 8 in 2024-02-05T07:23:09.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33"}]: dispatch 2024-02-05T07:23:09.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[41609]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi184-81228-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:09.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33"}]: dispatch 2024-02-05T07:23:09.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[41609]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi184-81207-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:09.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[41609]: pgmap v342: 324 pgs: 324 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-05T07:23:09.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:23:09.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:09 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-33"}]': finished 2024-02-05T07:23:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:10 smithi188 ceph-mon[33283]: osdmap e255: 8 total, 8 up, 8 in 2024-02-05T07:23:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:10 smithi188 ceph-mon[33283]: from='client.26182 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi184-81228-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi184-81228-50"}]': finished 2024-02-05T07:23:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:10 smithi188 ceph-mon[33283]: from='client.26188 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi184-81207-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi184-81207-41"}]': finished 2024-02-05T07:23:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:10 smithi188 ceph-mon[33283]: osdmap e256: 8 total, 8 up, 8 in 2024-02-05T07:23:10.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:10 smithi184 ceph-mon[29861]: osdmap e255: 8 total, 8 up, 8 in 2024-02-05T07:23:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:10 smithi184 ceph-mon[29861]: from='client.26182 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi184-81228-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi184-81228-50"}]': finished 2024-02-05T07:23:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:10 smithi184 ceph-mon[29861]: from='client.26188 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi184-81207-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi184-81207-41"}]': finished 2024-02-05T07:23:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:10 smithi184 ceph-mon[29861]: osdmap e256: 8 total, 8 up, 8 in 2024-02-05T07:23:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:10 smithi184 ceph-mon[41609]: osdmap e255: 8 total, 8 up, 8 in 2024-02-05T07:23:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:10 smithi184 ceph-mon[41609]: from='client.26182 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi184-81228-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi184-81228-50"}]': finished 2024-02-05T07:23:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:10 smithi184 ceph-mon[41609]: from='client.26188 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi184-81207-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi184-81207-41"}]': finished 2024-02-05T07:23:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:10 smithi184 ceph-mon[41609]: osdmap e256: 8 total, 8 up, 8 in 2024-02-05T07:23:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:11 smithi188 ceph-mon[33283]: pgmap v345: 308 pgs: 16 unknown, 292 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:23:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:11 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:11 smithi188 ceph-mon[33283]: osdmap e257: 8 total, 8 up, 8 in 2024-02-05T07:23:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:11 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:11 smithi184 ceph-mon[29861]: pgmap v345: 308 pgs: 16 unknown, 292 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:23:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:11 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:11 smithi184 ceph-mon[29861]: osdmap e257: 8 total, 8 up, 8 in 2024-02-05T07:23:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:11 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:11.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:11 smithi184 ceph-mon[41609]: pgmap v345: 308 pgs: 16 unknown, 292 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:23:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:11 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:11 smithi184 ceph-mon[41609]: osdmap e257: 8 total, 8 up, 8 in 2024-02-05T07:23:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:11 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:12.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:23:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:23:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:23:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:12 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:12 smithi188 ceph-mon[33283]: osdmap e258: 8 total, 8 up, 8 in 2024-02-05T07:23:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:12 smithi188 ceph-mon[33283]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:12 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:12 smithi188 ceph-mon[33283]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:13.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:12 smithi188 ceph-mon[33283]: pgmap v348: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[29861]: osdmap e258: 8 total, 8 up, 8 in 2024-02-05T07:23:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[29861]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[29861]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:13.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[29861]: pgmap v348: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:13.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:13.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[41609]: osdmap e258: 8 total, 8 up, 8 in 2024-02-05T07:23:13.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:13.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:13.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:13.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[41609]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:13.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:13.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[41609]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:13.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:12 smithi184 ceph-mon[41609]: pgmap v348: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 566 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:14.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:13 smithi188 ceph-mon[33283]: from='client.26188 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi184-81207-41"}]': finished 2024-02-05T07:23:14.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:13 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:14.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:13 smithi188 ceph-mon[33283]: from='client.26182 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi184-81228-50"}]': finished 2024-02-05T07:23:14.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:13 smithi188 ceph-mon[33283]: osdmap e259: 8 total, 8 up, 8 in 2024-02-05T07:23:14.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:14.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:14.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:14.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:13 smithi188 ceph-mon[33283]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:14.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:13 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:14.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:13 smithi188 ceph-mon[33283]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:14.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:13 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:23:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[29861]: from='client.26188 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi184-81207-41"}]': finished 2024-02-05T07:23:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[29861]: from='client.26182 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi184-81228-50"}]': finished 2024-02-05T07:23:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[29861]: osdmap e259: 8 total, 8 up, 8 in 2024-02-05T07:23:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[29861]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:14.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[29861]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:14.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:23:14.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[41609]: from='client.26188 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi184-81207-41"}]': finished 2024-02-05T07:23:14.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:14.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[41609]: from='client.26182 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi184-81228-50"}]': finished 2024-02-05T07:23:14.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[41609]: osdmap e259: 8 total, 8 up, 8 in 2024-02-05T07:23:14.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:14.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4231548296' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:14.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2356569210' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:14.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[41609]: from='client.26182 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi184-81228-50"}]: dispatch 2024-02-05T07:23:14.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:14.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[41609]: from='client.26188 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi184-81207-41"}]: dispatch 2024-02-05T07:23:14.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:13 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:23:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:14 smithi188 ceph-mon[33283]: from='client.26182 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi184-81228-50"}]': finished 2024-02-05T07:23:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:14 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]': finished 2024-02-05T07:23:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:14 smithi188 ceph-mon[33283]: from='client.26188 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi184-81207-41"}]': finished 2024-02-05T07:23:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-35", "mode": "writeback"}]: dispatch 2024-02-05T07:23:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:14 smithi188 ceph-mon[33283]: osdmap e260: 8 total, 8 up, 8 in 2024-02-05T07:23:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:14 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-35", "mode": "writeback"}]: dispatch 2024-02-05T07:23:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi184-81207-42"}]: dispatch 2024-02-05T07:23:15.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:14 smithi188 ceph-mon[33283]: pgmap v351: 324 pgs: 324 active+clean; 4.6 MiB data, 575 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:15.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi184-81207-42"}]: dispatch 2024-02-05T07:23:15.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi184-81207-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:15.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[29861]: from='client.26182 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi184-81228-50"}]': finished 2024-02-05T07:23:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]': finished 2024-02-05T07:23:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[29861]: from='client.26188 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi184-81207-41"}]': finished 2024-02-05T07:23:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-35", "mode": "writeback"}]: dispatch 2024-02-05T07:23:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[29861]: osdmap e260: 8 total, 8 up, 8 in 2024-02-05T07:23:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-35", "mode": "writeback"}]: dispatch 2024-02-05T07:23:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi184-81207-42"}]: dispatch 2024-02-05T07:23:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[29861]: pgmap v351: 324 pgs: 324 active+clean; 4.6 MiB data, 575 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi184-81207-42"}]: dispatch 2024-02-05T07:23:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi184-81207-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[41609]: from='client.26182 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi184-81228-50"}]': finished 2024-02-05T07:23:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]': finished 2024-02-05T07:23:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[41609]: from='client.26188 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi184-81207-41"}]': finished 2024-02-05T07:23:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-35", "mode": "writeback"}]: dispatch 2024-02-05T07:23:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[41609]: osdmap e260: 8 total, 8 up, 8 in 2024-02-05T07:23:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-35", "mode": "writeback"}]: dispatch 2024-02-05T07:23:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi184-81207-42"}]: dispatch 2024-02-05T07:23:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[41609]: pgmap v351: 324 pgs: 324 active+clean; 4.6 MiB data, 575 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi184-81207-42"}]: dispatch 2024-02-05T07:23:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi184-81207-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:15 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:23:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:15 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-35", "mode": "writeback"}]': finished 2024-02-05T07:23:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi184-81207-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:15 smithi188 ceph-mon[33283]: osdmap e261: 8 total, 8 up, 8 in 2024-02-05T07:23:16.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi184-81207-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi184-81207-42"}]: dispatch 2024-02-05T07:23:16.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/841010783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi184-81228-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:16.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:15 smithi188 ceph-mon[33283]: from='client.26197 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi184-81228-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:15 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:23:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:15 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-35", "mode": "writeback"}]': finished 2024-02-05T07:23:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi184-81207-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:15 smithi184 ceph-mon[29861]: osdmap e261: 8 total, 8 up, 8 in 2024-02-05T07:23:16.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi184-81207-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi184-81207-42"}]: dispatch 2024-02-05T07:23:16.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/841010783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi184-81228-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:16.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:15 smithi184 ceph-mon[29861]: from='client.26197 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi184-81228-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:15 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:23:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:15 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-35", "mode": "writeback"}]': finished 2024-02-05T07:23:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi184-81207-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:15 smithi184 ceph-mon[41609]: osdmap e261: 8 total, 8 up, 8 in 2024-02-05T07:23:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi184-81207-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi184-81207-42"}]: dispatch 2024-02-05T07:23:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/841010783' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi184-81228-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:16.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:15 smithi184 ceph-mon[41609]: from='client.26197 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi184-81228-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:16 smithi188 ceph-mon[33283]: from='client.26197 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi184-81228-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:16 smithi188 ceph-mon[33283]: osdmap e262: 8 total, 8 up, 8 in 2024-02-05T07:23:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:16 smithi188 ceph-mon[33283]: pgmap v354: 356 pgs: 32 unknown, 324 active+clean; 4.6 MiB data, 575 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:16 smithi184 ceph-mon[29861]: from='client.26197 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi184-81228-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:16 smithi184 ceph-mon[29861]: osdmap e262: 8 total, 8 up, 8 in 2024-02-05T07:23:17.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:16 smithi184 ceph-mon[29861]: pgmap v354: 356 pgs: 32 unknown, 324 active+clean; 4.6 MiB data, 575 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:16 smithi184 ceph-mon[41609]: from='client.26197 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi184-81228-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:16 smithi184 ceph-mon[41609]: osdmap e262: 8 total, 8 up, 8 in 2024-02-05T07:23:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:16 smithi184 ceph-mon[41609]: pgmap v354: 356 pgs: 32 unknown, 324 active+clean; 4.6 MiB data, 575 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:17.905 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:23:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:23:18.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi184-81207-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi184-81207-42"}]': finished 2024-02-05T07:23:18.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:17 smithi188 ceph-mon[33283]: osdmap e263: 8 total, 8 up, 8 in 2024-02-05T07:23:18.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:18.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:17 smithi188 ceph-mon[33283]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:18.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:18.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:17 smithi188 ceph-mon[33283]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:18.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:18.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:17 smithi188 ceph-mon[33283]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:18.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:18.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:17 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:18.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi184-81207-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi184-81207-42"}]': finished 2024-02-05T07:23:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[29861]: osdmap e263: 8 total, 8 up, 8 in 2024-02-05T07:23:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[29861]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[29861]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[29861]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:18.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi184-81207-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi184-81207-42"}]': finished 2024-02-05T07:23:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[41609]: osdmap e263: 8 total, 8 up, 8 in 2024-02-05T07:23:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[41609]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[41609]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[41609]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:18.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:17 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:18 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:18 smithi188 ceph-mon[33283]: from='client.26206 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:18 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:18 smithi188 ceph-mon[33283]: osdmap e264: 8 total, 8 up, 8 in 2024-02-05T07:23:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi184-81228-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:18 smithi188 ceph-mon[33283]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi184-81228-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:18 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:19.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:18 smithi188 ceph-mon[33283]: pgmap v357: 332 pgs: 8 creating+peering, 324 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-05T07:23:19.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[29861]: from='client.26206 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[29861]: osdmap e264: 8 total, 8 up, 8 in 2024-02-05T07:23:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi184-81228-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[29861]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi184-81228-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[29861]: pgmap v357: 332 pgs: 8 creating+peering, 324 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-05T07:23:19.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[41609]: from='client.26206 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[41609]: osdmap e264: 8 total, 8 up, 8 in 2024-02-05T07:23:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi184-81228-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[41609]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi184-81228-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:19.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:18 smithi184 ceph-mon[41609]: pgmap v357: 332 pgs: 8 creating+peering, 324 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-05T07:23:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:19 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:19 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]': finished 2024-02-05T07:23:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:19 smithi188 ceph-mon[33283]: osdmap e265: 8 total, 8 up, 8 in 2024-02-05T07:23:20.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi184-81207-42"}]: dispatch 2024-02-05T07:23:20.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:19 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:20.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:19 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]': finished 2024-02-05T07:23:20.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:19 smithi184 ceph-mon[29861]: osdmap e265: 8 total, 8 up, 8 in 2024-02-05T07:23:20.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi184-81207-42"}]: dispatch 2024-02-05T07:23:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:19 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:19 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-35"}]': finished 2024-02-05T07:23:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:19 smithi184 ceph-mon[41609]: osdmap e265: 8 total, 8 up, 8 in 2024-02-05T07:23:20.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi184-81207-42"}]: dispatch 2024-02-05T07:23:20.942 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7047 ms) 2024-02-05T07:23:20.942 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2024-02-05T07:23:20.942 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6948 ms) 2024-02-05T07:23:20.942 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-02-05T07:23:20.942 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (6988 ms) 2024-02-05T07:23:20.942 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-02-05T07:23:20.942 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (7054 ms) 2024-02-05T07:23:20.942 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-02-05T07:23:20.942 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7023 ms) 2024-02-05T07:23:20.942 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-02-05T07:23:20.942 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7031 ms) 2024-02-05T07:23:20.942 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-02-05T07:23:20.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7036 ms) 2024-02-05T07:23:20.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-02-05T07:23:20.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7063 ms) 2024-02-05T07:23:20.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-02-05T07:23:20.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6819 ms) 2024-02-05T07:23:20.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-02-05T07:23:20.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7056 ms) 2024-02-05T07:23:20.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-02-05T07:23:20.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7039 ms) 2024-02-05T07:23:20.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-02-05T07:23:20.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6929 ms) 2024-02-05T07:23:20.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-02-05T07:23:20.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (6968 ms) 2024-02-05T07:23:20.943 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-02-05T07:23:20.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7039 ms) 2024-02-05T07:23:20.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-02-05T07:23:20.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7037 ms) 2024-02-05T07:23:20.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-02-05T07:23:20.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7050 ms) 2024-02-05T07:23:20.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112127 ms total) 2024-02-05T07:23:20.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: 2024-02-05T07:23:20.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [----------] Global test environment tear-down 2024-02-05T07:23:20.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (202291 ms total) 2024-02-05T07:23:20.944 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio: [ PASSED ] 42 tests. 2024-02-05T07:23:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:20 smithi188 ceph-mon[33283]: from='client.26206 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi184-81228-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]': finished 2024-02-05T07:23:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi184-81207-42"}]': finished 2024-02-05T07:23:21.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:20 smithi188 ceph-mon[33283]: osdmap e266: 8 total, 8 up, 8 in 2024-02-05T07:23:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi184-81207-42"}]: dispatch 2024-02-05T07:23:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:20 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:21.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:20 smithi188 ceph-mon[33283]: pgmap v360: 332 pgs: 8 unknown, 324 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-05T07:23:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:20 smithi184 ceph-mon[29861]: from='client.26206 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi184-81228-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]': finished 2024-02-05T07:23:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi184-81207-42"}]': finished 2024-02-05T07:23:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:20 smithi184 ceph-mon[29861]: osdmap e266: 8 total, 8 up, 8 in 2024-02-05T07:23:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi184-81207-42"}]: dispatch 2024-02-05T07:23:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:20 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:21.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:20 smithi184 ceph-mon[29861]: pgmap v360: 332 pgs: 8 unknown, 324 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-05T07:23:21.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:20 smithi184 ceph-mon[41609]: from='client.26206 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi184-81228-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]': finished 2024-02-05T07:23:21.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi184-81207-42"}]': finished 2024-02-05T07:23:21.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:20 smithi184 ceph-mon[41609]: osdmap e266: 8 total, 8 up, 8 in 2024-02-05T07:23:21.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi184-81207-42"}]: dispatch 2024-02-05T07:23:21.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:21.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:20 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:21.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:20 smithi184 ceph-mon[41609]: pgmap v360: 332 pgs: 8 unknown, 324 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-05T07:23:22.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi184-81207-42"}]': finished 2024-02-05T07:23:22.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:21 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:22.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:21 smithi188 ceph-mon[33283]: osdmap e267: 8 total, 8 up, 8 in 2024-02-05T07:23:22.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:22.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:21 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:22.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi184-81207-42"}]': finished 2024-02-05T07:23:22.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:21 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:21 smithi184 ceph-mon[29861]: osdmap e267: 8 total, 8 up, 8 in 2024-02-05T07:23:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:21 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:22.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:23:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:23:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:23:22.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3812202349' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi184-81207-42"}]': finished 2024-02-05T07:23:22.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:21 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:22.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:21 smithi184 ceph-mon[41609]: osdmap e267: 8 total, 8 up, 8 in 2024-02-05T07:23:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:21 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35"}]: dispatch 2024-02-05T07:23:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:22 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:23:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:22 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35"}]': finished 2024-02-05T07:23:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:22 smithi188 ceph-mon[33283]: osdmap e268: 8 total, 8 up, 8 in 2024-02-05T07:23:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:22 smithi188 ceph-mon[33283]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:22 smithi188 ceph-mon[33283]: pgmap v363: 324 pgs: 324 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:22 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:23:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:22 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35"}]': finished 2024-02-05T07:23:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:22 smithi184 ceph-mon[29861]: osdmap e268: 8 total, 8 up, 8 in 2024-02-05T07:23:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:23.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:22 smithi184 ceph-mon[29861]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:23.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:22 smithi184 ceph-mon[29861]: pgmap v363: 324 pgs: 324 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:23.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:22 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:23:23.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:22 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-35"}]': finished 2024-02-05T07:23:23.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:22 smithi184 ceph-mon[41609]: osdmap e268: 8 total, 8 up, 8 in 2024-02-05T07:23:23.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:23.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:22 smithi184 ceph-mon[41609]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:23.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:22 smithi184 ceph-mon[41609]: pgmap v363: 324 pgs: 324 active+clean; 4.6 MiB data, 576 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:24.258 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:23 smithi188 ceph-mon[33283]: from='client.26206 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]': finished 2024-02-05T07:23:24.258 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:24.259 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:23 smithi188 ceph-mon[33283]: osdmap e269: 8 total, 8 up, 8 in 2024-02-05T07:23:24.259 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:23 smithi188 ceph-mon[33283]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:23 smithi184 ceph-mon[29861]: from='client.26206 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]': finished 2024-02-05T07:23:24.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:24.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:23 smithi184 ceph-mon[29861]: osdmap e269: 8 total, 8 up, 8 in 2024-02-05T07:23:24.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:23 smithi184 ceph-mon[29861]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:24.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:23 smithi184 ceph-mon[41609]: from='client.26206 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi184-81228-52"}]': finished 2024-02-05T07:23:24.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3589681237' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:24.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:23 smithi184 ceph-mon[41609]: osdmap e269: 8 total, 8 up, 8 in 2024-02-05T07:23:24.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:23 smithi184 ceph-mon[41609]: from='client.26206 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi184-81228-52"}]: dispatch 2024-02-05T07:23:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:24 smithi188 ceph-mon[33283]: from='client.26206 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi184-81228-52"}]': finished 2024-02-05T07:23:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:24 smithi188 ceph-mon[33283]: osdmap e270: 8 total, 8 up, 8 in 2024-02-05T07:23:25.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:25.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:24 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:25.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:25.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:24 smithi188 ceph-mon[33283]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:25.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:25.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:24 smithi188 ceph-mon[33283]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:25.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:25.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:24 smithi188 ceph-mon[33283]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:25.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:24 smithi188 ceph-mon[33283]: pgmap v366: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:25.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:24 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:25.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:24 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:25.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:24 smithi188 ceph-mon[33283]: from='client.36224 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[29861]: from='client.26206 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi184-81228-52"}]': finished 2024-02-05T07:23:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[29861]: osdmap e270: 8 total, 8 up, 8 in 2024-02-05T07:23:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:25.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:25.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:25.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[29861]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:25.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:25.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[29861]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:25.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:25.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[29861]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:25.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[29861]: pgmap v366: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:25.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:25.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:25.274 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[29861]: from='client.36224 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:25.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[41609]: from='client.26206 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi184-81228-52"}]': finished 2024-02-05T07:23:25.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[41609]: osdmap e270: 8 total, 8 up, 8 in 2024-02-05T07:23:25.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:25.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:25.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:25.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[41609]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:25.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:25.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[41609]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:25.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:25.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[41609]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:25.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[41609]: pgmap v366: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:25.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:25.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:25.275 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:24 smithi184 ceph-mon[41609]: from='client.36224 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi184-81228-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:26 smithi188 ceph-mon[33283]: osdmap e271: 8 total, 8 up, 8 in 2024-02-05T07:23:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:26 smithi188 ceph-mon[33283]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi184-81228-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:26 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:26.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:26 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:26.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi184-81228-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:26.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:26 smithi184 ceph-mon[29861]: osdmap e271: 8 total, 8 up, 8 in 2024-02-05T07:23:26.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:26 smithi184 ceph-mon[29861]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi184-81228-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:26.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:26.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:26 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:26.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:26 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:26.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi184-81228-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:26.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:26 smithi184 ceph-mon[41609]: osdmap e271: 8 total, 8 up, 8 in 2024-02-05T07:23:26.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:26 smithi184 ceph-mon[41609]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi184-81228-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:26.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:26.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:26 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:26.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:26 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:27.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-37"}]: dispatch 2024-02-05T07:23:27.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:27 smithi188 ceph-mon[33283]: pgmap v369: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:27.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:27 smithi188 ceph-mon[33283]: osdmap e272: 8 total, 8 up, 8 in 2024-02-05T07:23:27.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:27 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-37"}]: dispatch 2024-02-05T07:23:27.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:27 smithi188 ceph-mon[33283]: from='client.36224 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi184-81228-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi184-81228-53"}]': finished 2024-02-05T07:23:27.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:27 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-37"}]': finished 2024-02-05T07:23:27.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:27 smithi188 ceph-mon[33283]: osdmap e273: 8 total, 8 up, 8 in 2024-02-05T07:23:27.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-37", "mode": "writeback"}]: dispatch 2024-02-05T07:23:27.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:27 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-37", "mode": "writeback"}]: dispatch 2024-02-05T07:23:27.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-37"}]: dispatch 2024-02-05T07:23:27.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[29861]: pgmap v369: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:27.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[29861]: osdmap e272: 8 total, 8 up, 8 in 2024-02-05T07:23:27.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-37"}]: dispatch 2024-02-05T07:23:27.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[29861]: from='client.36224 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi184-81228-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi184-81228-53"}]': finished 2024-02-05T07:23:27.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-37"}]': finished 2024-02-05T07:23:27.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[29861]: osdmap e273: 8 total, 8 up, 8 in 2024-02-05T07:23:27.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-37", "mode": "writeback"}]: dispatch 2024-02-05T07:23:27.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-37", "mode": "writeback"}]: dispatch 2024-02-05T07:23:27.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-37"}]: dispatch 2024-02-05T07:23:27.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[41609]: pgmap v369: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:27.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[41609]: osdmap e272: 8 total, 8 up, 8 in 2024-02-05T07:23:27.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-37"}]: dispatch 2024-02-05T07:23:27.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[41609]: from='client.36224 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi184-81228-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi184-81228-53"}]': finished 2024-02-05T07:23:27.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-37"}]': finished 2024-02-05T07:23:27.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[41609]: osdmap e273: 8 total, 8 up, 8 in 2024-02-05T07:23:27.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-37", "mode": "writeback"}]: dispatch 2024-02-05T07:23:27.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:27 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-37", "mode": "writeback"}]: dispatch 2024-02-05T07:23:27.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:23:27 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:23:28.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:28 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:23:28.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:28 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-37", "mode": "writeback"}]': finished 2024-02-05T07:23:28.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:28 smithi188 ceph-mon[33283]: osdmap e274: 8 total, 8 up, 8 in 2024-02-05T07:23:28.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:28.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:28 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:28.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:28 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:23:28.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:28 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-37", "mode": "writeback"}]': finished 2024-02-05T07:23:28.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:28 smithi184 ceph-mon[29861]: osdmap e274: 8 total, 8 up, 8 in 2024-02-05T07:23:28.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:28.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:28 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:28 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:23:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:28 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-37", "mode": "writeback"}]': finished 2024-02-05T07:23:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:28 smithi184 ceph-mon[41609]: osdmap e274: 8 total, 8 up, 8 in 2024-02-05T07:23:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:28.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:28 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:29 smithi188 ceph-mon[33283]: pgmap v372: 332 pgs: 8 creating+peering, 324 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:23:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:29.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:29 smithi188 ceph-mon[33283]: osdmap e275: 8 total, 8 up, 8 in 2024-02-05T07:23:29.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37"}]: dispatch 2024-02-05T07:23:29.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37"}]: dispatch 2024-02-05T07:23:29.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:29.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:29 smithi188 ceph-mon[33283]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[29861]: pgmap v372: 332 pgs: 8 creating+peering, 324 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:23:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[29861]: osdmap e275: 8 total, 8 up, 8 in 2024-02-05T07:23:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37"}]: dispatch 2024-02-05T07:23:29.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37"}]: dispatch 2024-02-05T07:23:29.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:29.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[29861]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:29.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:29.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[41609]: pgmap v372: 332 pgs: 8 creating+peering, 324 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:29.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:29.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:23:29.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:29.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[41609]: osdmap e275: 8 total, 8 up, 8 in 2024-02-05T07:23:29.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37"}]: dispatch 2024-02-05T07:23:29.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37"}]: dispatch 2024-02-05T07:23:29.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:29.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:29 smithi184 ceph-mon[41609]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:30 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:30 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:23:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:30 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37"}]': finished 2024-02-05T07:23:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:30 smithi188 ceph-mon[33283]: from='client.36224 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53"}]': finished 2024-02-05T07:23:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:30 smithi188 ceph-mon[33283]: osdmap e276: 8 total, 8 up, 8 in 2024-02-05T07:23:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:30 smithi188 ceph-mon[33283]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:30 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:30 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:23:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:30 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37"}]': finished 2024-02-05T07:23:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:30 smithi184 ceph-mon[41609]: from='client.36224 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53"}]': finished 2024-02-05T07:23:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:30 smithi184 ceph-mon[41609]: osdmap e276: 8 total, 8 up, 8 in 2024-02-05T07:23:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:30 smithi184 ceph-mon[41609]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:30 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:30 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:23:30.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:30 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-37"}]': finished 2024-02-05T07:23:30.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:30 smithi184 ceph-mon[29861]: from='client.36224 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi184-81228-53"}]': finished 2024-02-05T07:23:30.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:30 smithi184 ceph-mon[29861]: osdmap e276: 8 total, 8 up, 8 in 2024-02-05T07:23:30.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2520835049' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:30.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:30 smithi184 ceph-mon[29861]: from='client.36224 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi184-81228-53"}]: dispatch 2024-02-05T07:23:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:31 smithi188 ceph-mon[33283]: pgmap v375: 324 pgs: 324 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:31 smithi188 ceph-mon[33283]: from='client.36224 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi184-81228-53"}]': finished 2024-02-05T07:23:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:31 smithi188 ceph-mon[33283]: osdmap e277: 8 total, 8 up, 8 in 2024-02-05T07:23:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:31 smithi188 ceph-mon[33283]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:31.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:31.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:31 smithi188 ceph-mon[33283]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:31.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi184-81228-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:31.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:31 smithi188 ceph-mon[33283]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi184-81228-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[29861]: pgmap v375: 324 pgs: 324 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[29861]: from='client.36224 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi184-81228-53"}]': finished 2024-02-05T07:23:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[29861]: osdmap e277: 8 total, 8 up, 8 in 2024-02-05T07:23:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[29861]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[29861]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi184-81228-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[29861]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi184-81228-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:31.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[41609]: pgmap v375: 324 pgs: 324 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[41609]: from='client.36224 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi184-81228-53"}]': finished 2024-02-05T07:23:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[41609]: osdmap e277: 8 total, 8 up, 8 in 2024-02-05T07:23:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[41609]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[41609]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi184-81228-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-mon[41609]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi184-81228-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:32.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:23:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:23:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:23:33.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:32 smithi188 ceph-mon[33283]: from='client.36230 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi184-81228-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:33.280 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:32 smithi188 ceph-mon[33283]: osdmap e278: 8 total, 8 up, 8 in 2024-02-05T07:23:33.280 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi184-81228-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:33.280 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:33.281 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:32 smithi188 ceph-mon[33283]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi184-81228-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:33.281 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:32 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:33.281 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:32 smithi188 ceph-mon[33283]: pgmap v378: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:33.282 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:32 smithi184 ceph-mon[29861]: from='client.36230 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi184-81228-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:33.282 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:32 smithi184 ceph-mon[29861]: osdmap e278: 8 total, 8 up, 8 in 2024-02-05T07:23:33.282 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi184-81228-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:33.283 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:33.283 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:32 smithi184 ceph-mon[29861]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi184-81228-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:33.283 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:32 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:33.283 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:32 smithi184 ceph-mon[29861]: pgmap v378: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:33.283 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:32 smithi184 ceph-mon[41609]: from='client.36230 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi184-81228-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:33.284 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:32 smithi184 ceph-mon[41609]: osdmap e278: 8 total, 8 up, 8 in 2024-02-05T07:23:33.284 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi184-81228-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:33.284 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:33.284 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:32 smithi184 ceph-mon[41609]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi184-81228-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:33.284 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:32 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:33.284 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:32 smithi184 ceph-mon[41609]: pgmap v378: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 589 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:33 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:33 smithi188 ceph-mon[33283]: osdmap e279: 8 total, 8 up, 8 in 2024-02-05T07:23:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:33 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:33 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:23:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:33 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:33 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:34.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:33 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:34.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:33 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:34.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:34.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:34.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[29861]: osdmap e279: 8 total, 8 up, 8 in 2024-02-05T07:23:34.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:34.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:23:34.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:34.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:34.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:34.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:34.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:34.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:34.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[41609]: osdmap e279: 8 total, 8 up, 8 in 2024-02-05T07:23:34.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:34.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:23:34.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:34.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:34.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:34.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:33 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:34 smithi188 ceph-mon[33283]: from='client.36230 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi184-81228-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi184-81228-54"}]': finished 2024-02-05T07:23:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:34 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:34 smithi188 ceph-mon[33283]: osdmap e280: 8 total, 8 up, 8 in 2024-02-05T07:23:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-39"}]: dispatch 2024-02-05T07:23:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:34 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-39"}]: dispatch 2024-02-05T07:23:35.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:34 smithi188 ceph-mon[33283]: pgmap v381: 332 pgs: 8 unknown, 32 creating+peering, 292 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:23:35.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:34 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:23:35.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:34 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:23:35.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:34 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:35.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[29861]: from='client.36230 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi184-81228-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi184-81228-54"}]': finished 2024-02-05T07:23:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[29861]: osdmap e280: 8 total, 8 up, 8 in 2024-02-05T07:23:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-39"}]: dispatch 2024-02-05T07:23:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-39"}]: dispatch 2024-02-05T07:23:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[29861]: pgmap v381: 332 pgs: 8 unknown, 32 creating+peering, 292 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:23:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:23:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:23:35.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:35.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[41609]: from='client.36230 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi184-81228-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi184-81228-54"}]': finished 2024-02-05T07:23:35.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:35.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[41609]: osdmap e280: 8 total, 8 up, 8 in 2024-02-05T07:23:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-39"}]: dispatch 2024-02-05T07:23:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-39"}]: dispatch 2024-02-05T07:23:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[41609]: pgmap v381: 332 pgs: 8 unknown, 32 creating+peering, 292 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:23:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:23:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:23:35.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:34 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:35 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-39"}]': finished 2024-02-05T07:23:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:35 smithi188 ceph-mon[33283]: osdmap e281: 8 total, 8 up, 8 in 2024-02-05T07:23:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-39", "mode": "writeback"}]: dispatch 2024-02-05T07:23:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:35 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-39", "mode": "writeback"}]: dispatch 2024-02-05T07:23:36.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:35 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-39"}]': finished 2024-02-05T07:23:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:35 smithi184 ceph-mon[29861]: osdmap e281: 8 total, 8 up, 8 in 2024-02-05T07:23:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-39", "mode": "writeback"}]: dispatch 2024-02-05T07:23:36.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:35 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-39", "mode": "writeback"}]: dispatch 2024-02-05T07:23:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:35 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-39"}]': finished 2024-02-05T07:23:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:35 smithi184 ceph-mon[41609]: osdmap e281: 8 total, 8 up, 8 in 2024-02-05T07:23:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-39", "mode": "writeback"}]: dispatch 2024-02-05T07:23:36.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:35 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-39", "mode": "writeback"}]: dispatch 2024-02-05T07:23:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:36 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:23:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:36 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-39", "mode": "writeback"}]': finished 2024-02-05T07:23:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:36 smithi188 ceph-mon[33283]: osdmap e282: 8 total, 8 up, 8 in 2024-02-05T07:23:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:37.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:36 smithi188 ceph-mon[33283]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:36 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:37.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:36 smithi188 ceph-mon[33283]: pgmap v384: 324 pgs: 32 creating+peering, 292 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:23:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:23:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-39", "mode": "writeback"}]': finished 2024-02-05T07:23:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[29861]: osdmap e282: 8 total, 8 up, 8 in 2024-02-05T07:23:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[29861]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:37.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[29861]: pgmap v384: 324 pgs: 32 creating+peering, 292 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:23:37.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:23:37.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-39", "mode": "writeback"}]': finished 2024-02-05T07:23:37.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[41609]: osdmap e282: 8 total, 8 up, 8 in 2024-02-05T07:23:37.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:37.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[41609]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:37.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:37.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:37.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:36 smithi184 ceph-mon[41609]: pgmap v384: 324 pgs: 32 creating+peering, 292 active+clean; 4.6 MiB data, 594 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:23:37.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:23:37 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:23:37.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:37 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:37.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:37 smithi188 ceph-mon[33283]: from='client.36230 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi184-81228-54"}]': finished 2024-02-05T07:23:37.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:37 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:38.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:37 smithi188 ceph-mon[33283]: osdmap e283: 8 total, 8 up, 8 in 2024-02-05T07:23:38.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39"}]: dispatch 2024-02-05T07:23:38.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:38.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:37 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39"}]: dispatch 2024-02-05T07:23:38.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:37 smithi188 ceph-mon[33283]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[29861]: from='client.36230 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi184-81228-54"}]': finished 2024-02-05T07:23:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:38.173 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[29861]: osdmap e283: 8 total, 8 up, 8 in 2024-02-05T07:23:38.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39"}]: dispatch 2024-02-05T07:23:38.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:38.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39"}]: dispatch 2024-02-05T07:23:38.174 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[29861]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[41609]: from='client.36230 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi184-81228-54"}]': finished 2024-02-05T07:23:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:23:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[41609]: osdmap e283: 8 total, 8 up, 8 in 2024-02-05T07:23:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39"}]: dispatch 2024-02-05T07:23:38.174 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2963961650' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:38.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39"}]: dispatch 2024-02-05T07:23:38.175 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:37 smithi184 ceph-mon[41609]: from='client.36230 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi184-81228-54"}]: dispatch 2024-02-05T07:23:38.874 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-02-05T07:23:38.874 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-02-05T07:23:38.874 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-02-05T07:23:38.874 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: seed 81478 2024-02-05T07:23:38.874 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-02-05T07:23:38.874 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (324 ms) 2024-02-05T07:23:38.874 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-02-05T07:23:38.874 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (14232 ms) 2024-02-05T07:23:38.874 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-02-05T07:23:38.874 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (38 ms) 2024-02-05T07:23:38.875 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (14594 ms total) 2024-02-05T07:23:38.875 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: 2024-02-05T07:23:38.875 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-02-05T07:23:38.875 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-02-05T07:23:38.875 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (7037 ms) 2024-02-05T07:23:38.875 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-02-05T07:23:38.875 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (8039 ms) 2024-02-05T07:23:38.875 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-02-05T07:23:38.875 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (9925 ms) 2024-02-05T07:23:38.875 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-02-05T07:23:38.875 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: my_snaps [3] 2024-02-05T07:23:38.875 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: my_snaps [4,3] 2024-02-05T07:23:38.875 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: my_snaps [5,4,3] 2024-02-05T07:23:38.875 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: my_snaps [6,5,4,3] 2024-02-05T07:23:38.876 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: promoting some heads 2024-02-05T07:23:38.876 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: promoting from clones for snap 6 2024-02-05T07:23:38.876 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: promoting from clones for snap 5 2024-02-05T07:23:38.876 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: promoting from clones for snap 4 2024-02-05T07:23:38.876 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: promoting from clones for snap 3 2024-02-05T07:23:38.876 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: waiting for scrubs... 2024-02-05T07:23:38.876 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: done waiting 2024-02-05T07:23:38.876 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (46555 ms) 2024-02-05T07:23:38.876 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-02-05T07:23:38.876 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (9484 ms) 2024-02-05T07:23:38.876 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-02-05T07:23:38.876 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (8006 ms) 2024-02-05T07:23:38.876 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-02-05T07:23:38.877 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (8036 ms) 2024-02-05T07:23:38.877 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-02-05T07:23:38.877 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8040 ms) 2024-02-05T07:23:38.877 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-02-05T07:23:38.877 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10068 ms) 2024-02-05T07:23:38.877 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-02-05T07:23:38.877 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (8846 ms) 2024-02-05T07:23:38.877 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-02-05T07:23:38.877 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10541 ms) 2024-02-05T07:23:38.877 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-02-05T07:23:38.877 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (12482 ms) 2024-02-05T07:23:38.877 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-02-05T07:23:38.877 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (8457 ms) 2024-02-05T07:23:38.877 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-02-05T07:23:38.878 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (7563 ms) 2024-02-05T07:23:38.878 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-02-05T07:23:38.878 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13092 ms) 2024-02-05T07:23:38.878 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-02-05T07:23:38.878 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (7863 ms) 2024-02-05T07:23:38.878 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-02-05T07:23:38.878 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (8054 ms) 2024-02-05T07:23:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:38 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:38 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:23:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:38 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39"}]': finished 2024-02-05T07:23:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:38 smithi188 ceph-mon[33283]: from='client.36230 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi184-81228-54"}]': finished 2024-02-05T07:23:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:38 smithi188 ceph-mon[33283]: osdmap e284: 8 total, 8 up, 8 in 2024-02-05T07:23:39.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi184-81228-55"}]: dispatch 2024-02-05T07:23:39.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi184-81228-55"}]: dispatch 2024-02-05T07:23:39.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi184-81228-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:39.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:38 smithi188 ceph-mon[33283]: pgmap v387: 324 pgs: 324 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 93 op/s 2024-02-05T07:23:39.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:39.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:23:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39"}]': finished 2024-02-05T07:23:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[29861]: from='client.36230 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi184-81228-54"}]': finished 2024-02-05T07:23:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[29861]: osdmap e284: 8 total, 8 up, 8 in 2024-02-05T07:23:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi184-81228-55"}]: dispatch 2024-02-05T07:23:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi184-81228-55"}]: dispatch 2024-02-05T07:23:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi184-81228-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:39.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[29861]: pgmap v387: 324 pgs: 324 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 93 op/s 2024-02-05T07:23:39.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:39.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:23:39.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-39"}]': finished 2024-02-05T07:23:39.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[41609]: from='client.36230 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi184-81228-54"}]': finished 2024-02-05T07:23:39.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[41609]: osdmap e284: 8 total, 8 up, 8 in 2024-02-05T07:23:39.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi184-81228-55"}]: dispatch 2024-02-05T07:23:39.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi184-81228-55"}]: dispatch 2024-02-05T07:23:39.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi184-81228-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:39.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:38 smithi184 ceph-mon[41609]: pgmap v387: 324 pgs: 324 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 93 op/s 2024-02-05T07:23:40.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi184-81228-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:40.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:40 smithi188 ceph-mon[33283]: osdmap e285: 8 total, 8 up, 8 in 2024-02-05T07:23:40.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi184-81228-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi184-81228-55"}]: dispatch 2024-02-05T07:23:40.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi184-81228-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:40.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:40 smithi184 ceph-mon[29861]: osdmap e285: 8 total, 8 up, 8 in 2024-02-05T07:23:40.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi184-81228-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi184-81228-55"}]: dispatch 2024-02-05T07:23:40.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi184-81228-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:40.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:40 smithi184 ceph-mon[41609]: osdmap e285: 8 total, 8 up, 8 in 2024-02-05T07:23:40.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi184-81228-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi184-81228-55"}]: dispatch 2024-02-05T07:23:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:41 smithi188 ceph-mon[33283]: osdmap e286: 8 total, 8 up, 8 in 2024-02-05T07:23:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:41 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:41 smithi188 ceph-mon[33283]: pgmap v390: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-05T07:23:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi184-81228-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi184-81228-55"}]': finished 2024-02-05T07:23:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:41 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:41.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:41 smithi188 ceph-mon[33283]: osdmap e287: 8 total, 8 up, 8 in 2024-02-05T07:23:41.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:41.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:41 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[29861]: osdmap e286: 8 total, 8 up, 8 in 2024-02-05T07:23:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[29861]: pgmap v390: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-05T07:23:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi184-81228-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi184-81228-55"}]': finished 2024-02-05T07:23:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[29861]: osdmap e287: 8 total, 8 up, 8 in 2024-02-05T07:23:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:41.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:41.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[41609]: osdmap e286: 8 total, 8 up, 8 in 2024-02-05T07:23:41.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:41.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:41.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[41609]: pgmap v390: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-05T07:23:41.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi184-81228-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi184-81228-55"}]': finished 2024-02-05T07:23:41.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:41.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[41609]: osdmap e287: 8 total, 8 up, 8 in 2024-02-05T07:23:41.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:41.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:42.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:23:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:23:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:23:43.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:42 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:43.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:42 smithi188 ceph-mon[33283]: osdmap e288: 8 total, 8 up, 8 in 2024-02-05T07:23:43.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:23:43.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:42 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:23:43.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:42 smithi188 ceph-mon[33283]: pgmap v393: 332 pgs: 40 unknown, 292 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:43.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:42 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:43.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:42 smithi184 ceph-mon[29861]: osdmap e288: 8 total, 8 up, 8 in 2024-02-05T07:23:43.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:23:43.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:42 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:23:43.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:42 smithi184 ceph-mon[29861]: pgmap v393: 332 pgs: 40 unknown, 292 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:43.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:42 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:43.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:42 smithi184 ceph-mon[41609]: osdmap e288: 8 total, 8 up, 8 in 2024-02-05T07:23:43.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:23:43.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:42 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:23:43.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:42 smithi184 ceph-mon[41609]: pgmap v393: 332 pgs: 40 unknown, 292 active+clean; 8.4 MiB data, 606 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:43 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:23:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:43 smithi188 ceph-mon[33283]: osdmap e289: 8 total, 8 up, 8 in 2024-02-05T07:23:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:23:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:43 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:23:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi184-81228-55"}]: dispatch 2024-02-05T07:23:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:43 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:43 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:23:44.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:43 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:23:44.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi184-81228-55"}]': finished 2024-02-05T07:23:44.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:43 smithi188 ceph-mon[33283]: osdmap e290: 8 total, 8 up, 8 in 2024-02-05T07:23:44.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi184-81228-55"}]: dispatch 2024-02-05T07:23:44.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:23:44.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[29861]: osdmap e289: 8 total, 8 up, 8 in 2024-02-05T07:23:44.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:23:44.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:23:44.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi184-81228-55"}]: dispatch 2024-02-05T07:23:44.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:44.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:23:44.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:23:44.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi184-81228-55"}]': finished 2024-02-05T07:23:44.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[29861]: osdmap e290: 8 total, 8 up, 8 in 2024-02-05T07:23:44.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi184-81228-55"}]: dispatch 2024-02-05T07:23:44.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:23:44.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[41609]: osdmap e289: 8 total, 8 up, 8 in 2024-02-05T07:23:44.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:23:44.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:23:44.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi184-81228-55"}]: dispatch 2024-02-05T07:23:44.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:23:44.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:23:44.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:23:44.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi184-81228-55"}]': finished 2024-02-05T07:23:44.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[41609]: osdmap e290: 8 total, 8 up, 8 in 2024-02-05T07:23:44.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi184-81228-55"}]: dispatch 2024-02-05T07:23:45.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetrted 0x560254c28c80 2024-02-05T07:23:45.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c28db0 2024-02-05T07:23:45.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2d700 2024-02-05T07:23:45.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2d260 2024-02-05T07:23:45.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2d390 2024-02-05T07:23:45.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2d4c0 2024-02-05T07:23:45.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2d5f0 2024-02-05T07:23:45.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2dcd0 2024-02-05T07:23:45.065 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2d830 2024-02-05T07:23:45.065 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2d960 2024-02-05T07:23:45.065 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2da90 2024-02-05T07:23:45.065 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2dbc0 2024-02-05T07:23:45.065 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2e2c0 2024-02-05T07:23:45.066 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2de20 2024-02-05T07:23:45.066 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2df30 2024-02-05T07:23:45.066 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2e080 2024-02-05T07:23:45.066 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2e190 2024-02-05T07:23:45.066 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2e8b0 2024-02-05T07:23:45.066 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2e410 2024-02-05T07:23:45.067 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2e520 2024-02-05T07:23:45.067 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2e630 2024-02-05T07:23:45.067 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2e7a0 2024-02-05T07:23:45.067 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2eea0 2024-02-05T07:23:45.067 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2ea00 2024-02-05T07:23:45.067 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2eb30 2024-02-05T07:23:45.068 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2ec60 2024-02-05T07:23:45.068 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2ed70 2024-02-05T07:23:45.068 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2f450 2024-02-05T07:23:45.068 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2efb0 2024-02-05T07:23:45.068 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2f100 2024-02-05T07:23:45.068 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2f230 2024-02-05T07:23:45.069 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2f340 2024-02-05T07:23:45.069 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2fa40 2024-02-05T07:23:45.069 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2f5a0 2024-02-05T07:23:45.069 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2f6d0 2024-02-05T07:23:45.069 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2f7e0 2024-02-05T07:23:45.069 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2f910 2024-02-05T07:23:45.069 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2fff0 2024-02-05T07:23:45.069 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2fb50 2024-02-05T07:23:45.070 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2fc60 2024-02-05T07:23:45.070 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2fd90 2024-02-05T07:23:45.070 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2fea0 2024-02-05T07:23:45.070 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c305c0 2024-02-05T07:23:45.070 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c30120 2024-02-05T07:23:45.070 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c30250 2024-02-05T07:23:45.070 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c30360 2024-02-05T07:23:45.070 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c30470 2024-02-05T07:23:45.071 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c30bb0 2024-02-05T07:23:45.071 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c30710 2024-02-05T07:23:45.071 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c30820 2024-02-05T07:23:45.071 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c30950 2024-02-05T07:23:45.071 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c30a60 2024-02-05T07:23:45.071 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c311a0 2024-02-05T07:23:45.071 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c30d00 2024-02-05T07:23:45.071 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c30e10 2024-02-05T07:23:45.071 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c30f60 2024-02-05T07:23:45.072 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c31070 2024-02-05T07:23:45.072 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c31750 2024-02-05T07:23:45.072 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c312b0 2024-02-05T07:23:45.072 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c313c0 2024-02-05T07:23:45.072 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c31510 2024-02-05T07:23:45.072 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c31620 2024-02-05T07:23:45.072 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c31d40 2024-02-05T07:23:45.073 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c318a0 2024-02-05T07:23:45.073 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c319b0 2024-02-05T07:23:45.073 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c31ac0 2024-02-05T07:23:45.073 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c31bd0 2024-02-05T07:23:45.073 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c32310 2024-02-05T07:23:45.073 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c31e70 2024-02-05T07:23:45.073 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c31fa0 2024-02-05T07:23:45.074 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c320b0 2024-02-05T07:23:45.074 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c321c0 2024-02-05T07:23:45.074 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c328e0 2024-02-05T07:23:45.074 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c32440 2024-02-05T07:23:45.074 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c32550 2024-02-05T07:23:45.074 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c326a0 2024-02-05T07:23:45.074 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c327b0 2024-02-05T07:23:45.074 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c32eb0 2024-02-05T07:23:45.074 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c32a10 2024-02-05T07:23:45.074 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c32b60 2024-02-05T07:23:45.074 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c32c70 2024-02-05T07:23:45.074 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c32da0 2024-02-05T07:23:45.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:44 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:23:45.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:44 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:23:45.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:44 smithi188 ceph-mon[33283]: pgmap v396: 324 pgs: 324 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:45.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:44 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:45.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:44 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi184-81228-55"}]': finished 2024-02-05T07:23:45.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:44 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-05T07:23:45.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:44 smithi188 ceph-mon[33283]: osdmap e291: 8 total, 8 up, 8 in 2024-02-05T07:23:45.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:44 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:23:45.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:44 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:23:45.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:44 smithi184 ceph-mon[29861]: pgmap v396: 324 pgs: 324 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:45.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:44 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:45.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:44 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi184-81228-55"}]': finished 2024-02-05T07:23:45.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:44 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-05T07:23:45.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:44 smithi184 ceph-mon[29861]: osdmap e291: 8 total, 8 up, 8 in 2024-02-05T07:23:45.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:44 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:23:45.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:44 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:23:45.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:44 smithi184 ceph-mon[41609]: pgmap v396: 324 pgs: 324 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:45.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:44 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:45.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:44 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1415083948' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi184-81228-55"}]': finished 2024-02-05T07:23:45.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:44 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-05T07:23:45.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:44 smithi184 ceph-mon[41609]: osdmap e291: 8 total, 8 up, 8 in 2024-02-05T07:23:46.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:46.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:45 smithi188 ceph-mon[33283]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:46.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:46.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:45 smithi188 ceph-mon[33283]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:46.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi184-81228-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:46.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:45 smithi188 ceph-mon[33283]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi184-81228-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:46.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:46.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:45 smithi184 ceph-mon[41609]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:46.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:46.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:45 smithi184 ceph-mon[41609]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:46.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi184-81228-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:46.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:45 smithi184 ceph-mon[41609]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi184-81228-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:45 smithi184 ceph-mon[29861]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:45 smithi184 ceph-mon[29861]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi184-81228-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:46.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:45 smithi184 ceph-mon[29861]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi184-81228-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:46 smithi188 ceph-mon[33283]: from='client.36239 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi184-81228-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:46 smithi188 ceph-mon[33283]: osdmap e292: 8 total, 8 up, 8 in 2024-02-05T07:23:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi184-81228-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:46 smithi188 ceph-mon[33283]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi184-81228-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:46 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41"}]: dispatch 2024-02-05T07:23:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:46 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41"}]: dispatch 2024-02-05T07:23:47.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:46 smithi188 ceph-mon[33283]: pgmap v399: 324 pgs: 324 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[29861]: from='client.36239 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi184-81228-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[29861]: osdmap e292: 8 total, 8 up, 8 in 2024-02-05T07:23:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi184-81228-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[29861]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi184-81228-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41"}]: dispatch 2024-02-05T07:23:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41"}]: dispatch 2024-02-05T07:23:47.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[29861]: pgmap v399: 324 pgs: 324 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[41609]: from='client.36239 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi184-81228-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[41609]: osdmap e292: 8 total, 8 up, 8 in 2024-02-05T07:23:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi184-81228-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[41609]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi184-81228-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41"}]: dispatch 2024-02-05T07:23:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41"}]: dispatch 2024-02-05T07:23:47.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:46 smithi184 ceph-mon[41609]: pgmap v399: 324 pgs: 324 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:47.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:23:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:23:47.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:47 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41"}]': finished 2024-02-05T07:23:47.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:47 smithi188 ceph-mon[33283]: osdmap e293: 8 total, 8 up, 8 in 2024-02-05T07:23:48.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:47 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41"}]': finished 2024-02-05T07:23:48.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:47 smithi184 ceph-mon[29861]: osdmap e293: 8 total, 8 up, 8 in 2024-02-05T07:23:48.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:47 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-41"}]': finished 2024-02-05T07:23:48.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:47 smithi184 ceph-mon[41609]: osdmap e293: 8 total, 8 up, 8 in 2024-02-05T07:23:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:48 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:48 smithi188 ceph-mon[33283]: from='client.36239 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi184-81228-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi184-81228-56"}]': finished 2024-02-05T07:23:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:48 smithi188 ceph-mon[33283]: osdmap e294: 8 total, 8 up, 8 in 2024-02-05T07:23:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:48 smithi188 ceph-mon[33283]: pgmap v402: 300 pgs: 8 unknown, 292 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:49.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:48 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:49.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:48 smithi184 ceph-mon[29861]: from='client.36239 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi184-81228-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi184-81228-56"}]': finished 2024-02-05T07:23:49.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:48 smithi184 ceph-mon[29861]: osdmap e294: 8 total, 8 up, 8 in 2024-02-05T07:23:49.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:48 smithi184 ceph-mon[29861]: pgmap v402: 300 pgs: 8 unknown, 292 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:49.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:48 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:49.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:48 smithi184 ceph-mon[41609]: from='client.36239 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi184-81228-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi184-81228-56"}]': finished 2024-02-05T07:23:49.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:48 smithi184 ceph-mon[41609]: osdmap e294: 8 total, 8 up, 8 in 2024-02-05T07:23:49.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:48 smithi184 ceph-mon[41609]: pgmap v402: 300 pgs: 8 unknown, 292 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:49 smithi188 ceph-mon[33283]: osdmap e295: 8 total, 8 up, 8 in 2024-02-05T07:23:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:49 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:49 smithi184 ceph-mon[29861]: osdmap e295: 8 total, 8 up, 8 in 2024-02-05T07:23:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:49 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:50.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:49 smithi184 ceph-mon[41609]: osdmap e295: 8 total, 8 up, 8 in 2024-02-05T07:23:50.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:50.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:49 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:50 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:50 smithi188 ceph-mon[33283]: osdmap e296: 8 total, 8 up, 8 in 2024-02-05T07:23:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi184-81478-6","var": "pg_num","format": "json"}]: dispatch 2024-02-05T07:23:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:50 smithi188 ceph-mon[33283]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:50 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:51.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:50 smithi188 ceph-mon[33283]: pgmap v405: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:51.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:51.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[29861]: osdmap e296: 8 total, 8 up, 8 in 2024-02-05T07:23:51.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:51.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi184-81478-6","var": "pg_num","format": "json"}]: dispatch 2024-02-05T07:23:51.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[29861]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:51.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:51.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:51.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[29861]: pgmap v405: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:51.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[41609]: osdmap e296: 8 total, 8 up, 8 in 2024-02-05T07:23:51.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:51.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi184-81478-6","var": "pg_num","format": "json"}]: dispatch 2024-02-05T07:23:51.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[41609]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:51.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:51.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:51.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:50 smithi184 ceph-mon[41609]: pgmap v405: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:52.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:51 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:52.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:51 smithi188 ceph-mon[33283]: from='client.36239 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi184-81228-56"}]': finished 2024-02-05T07:23:52.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:51 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:52.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:51 smithi188 ceph-mon[33283]: osdmap e297: 8 total, 8 up, 8 in 2024-02-05T07:23:52.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:52.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_count","val": "8"}]: dispatch 2024-02-05T07:23:52.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:51 smithi188 ceph-mon[33283]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:52.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:51 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_count","val": "8"}]: dispatch 2024-02-05T07:23:52.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:23:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:23:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[41609]: from='client.36239 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi184-81228-56"}]': finished 2024-02-05T07:23:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[41609]: osdmap e297: 8 total, 8 up, 8 in 2024-02-05T07:23:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_count","val": "8"}]: dispatch 2024-02-05T07:23:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[41609]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_count","val": "8"}]: dispatch 2024-02-05T07:23:52.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:52.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[29861]: from='client.36239 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi184-81228-56"}]': finished 2024-02-05T07:23:52.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:23:52.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[29861]: osdmap e297: 8 total, 8 up, 8 in 2024-02-05T07:23:52.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1193214757' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:52.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_count","val": "8"}]: dispatch 2024-02-05T07:23:52.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[29861]: from='client.36239 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi184-81228-56"}]: dispatch 2024-02-05T07:23:52.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:51 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_count","val": "8"}]: dispatch 2024-02-05T07:23:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:52 smithi188 ceph-mon[33283]: from='client.36239 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi184-81228-56"}]': finished 2024-02-05T07:23:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:52 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_count","val": "8"}]': finished 2024-02-05T07:23:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:52 smithi188 ceph-mon[33283]: osdmap e298: 8 total, 8 up, 8 in 2024-02-05T07:23:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:23:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:52 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:23:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:52 smithi188 ceph-mon[33283]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:53.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:53.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:52 smithi188 ceph-mon[33283]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:53.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi184-81228-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:53.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:52 smithi188 ceph-mon[33283]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi184-81228-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:53.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:52 smithi188 ceph-mon[33283]: pgmap v408: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[29861]: from='client.36239 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi184-81228-56"}]': finished 2024-02-05T07:23:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_count","val": "8"}]': finished 2024-02-05T07:23:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[29861]: osdmap e298: 8 total, 8 up, 8 in 2024-02-05T07:23:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:23:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:23:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[29861]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:53.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[29861]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:53.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi184-81228-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:53.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[29861]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi184-81228-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:53.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[29861]: pgmap v408: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[41609]: from='client.36239 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi184-81228-56"}]': finished 2024-02-05T07:23:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_count","val": "8"}]': finished 2024-02-05T07:23:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[41609]: osdmap e298: 8 total, 8 up, 8 in 2024-02-05T07:23:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:23:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:23:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[41609]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:53.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[41609]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:53.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi184-81228-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:53.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[41609]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi184-81228-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:23:53.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:52 smithi184 ceph-mon[41609]: pgmap v408: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 607 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:23:54.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc:Read 2024-02-05T07:23:54.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: hmm, no HitSet yet 2024-02-05T07:23:54.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: ok, hit_set contains 263:602f83fe:::foo:head 2024-02-05T07:23:54.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9051 ms) 2024-02-05T07:23:54.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-02-05T07:23:54.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg_num = 32 2024-02-05T07:23:54.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 0 ls 1707117834,0 2024-02-05T07:23:54.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 1 ls 1707117834,0 2024-02-05T07:23:54.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 2 ls 1707117834,0 2024-02-05T07:23:54.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 3 ls 1707117834,0 2024-02-05T07:23:54.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 4 ls 1707117834,0 2024-02-05T07:23:54.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 5 ls 1707117834,0 2024-02-05T07:23:54.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 6 ls 1707117834,0 2024-02-05T07:23:54.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 7 ls 1707117834,0 2024-02-05T07:23:54.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 8 ls 1707117834,0 2024-02-05T07:23:54.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 9 ls 1707117834,0 2024-02-05T07:23:54.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 10 ls 1707117834,0 2024-02-05T07:23:54.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 11 ls 1707117834,0 2024-02-05T07:23:54.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 12 ls 1707117834,0 2024-02-05T07:23:54.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 13 ls 1707117834,0 2024-02-05T07:23:54.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 14 ls 1707117834,0 2024-02-05T07:23:54.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 15 ls 1707117834,0 2024-02-05T07:23:54.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 16 ls 1707117834,0 2024-02-05T07:23:54.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 17 ls 1707117834,0 2024-02-05T07:23:54.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 18 ls 1707117834,0 2024-02-05T07:23:54.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 19 ls 1707117834,0 2024-02-05T07:23:54.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 20 ls 1707117834,0 2024-02-05T07:23:54.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 21 ls 1707117834,0 2024-02-05T07:23:54.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 22 ls 1707117834,0 2024-02-05T07:23:54.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 23 ls 1707117834,0 2024-02-05T07:23:54.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 24 ls 1707117834,0 2024-02-05T07:23:54.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 25 ls 1707117834,0 2024-02-05T07:23:54.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 26 ls 1707117834,0 2024-02-05T07:23:54.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 27 ls 1707117834,0 2024-02-05T07:23:54.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 28 ls 1707117834,0 2024-02-05T07:23:54.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 29 ls 1707117834,0 2024-02-05T07:23:54.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 30 ls 1707117834,0 2024-02-05T07:23:54.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg 31 ls 1707117834,0 2024-02-05T07:23:54.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: pg_num = 32 2024-02-05T07:23:54.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:6cac518f:::0:head 2024-02-05T07:23:54.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:02547ec2:::1:head 2024-02-05T07:23:54.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:f905c69b:::2:head 2024-02-05T07:23:54.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:cfc208b3:::3:head 2024-02-05T07:23:54.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:d83876eb:::4:head 2024-02-05T07:23:54.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:b29083e3:::5:head 2024-02-05T07:23:54.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:c4fdafeb:::6:head 2024-02-05T07:23:54.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:5c6b0b28:::7:head 2024-02-05T07:23:54.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:bd63b0f1:::8:head 2024-02-05T07:23:54.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:e960b815:::9:head 2024-02-05T07:23:54.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:52ea6a34:::10:head 2024-02-05T07:23:54.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:89d3ae78:::11:head 2024-02-05T07:23:54.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:de5d7c5f:::12:head 2024-02-05T07:23:54.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:566253c9:::13:head 2024-02-05T07:23:54.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:62a1935d:::14:head 2024-02-05T07:23:54.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:863748b0:::15:head 2024-02-05T07:23:54.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:3958e169:::16:head 2024-02-05T07:23:54.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:4d4dabf9:::17:head 2024-02-05T07:23:54.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:8391935d:::18:head 2024-02-05T07:23:54.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:28883081:::19:head 2024-02-05T07:23:54.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:69259c59:::20:head 2024-02-05T07:23:54.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:4bdb80b7:::21:head 2024-02-05T07:23:54.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:a11c5d71:::22:head 2024-02-05T07:23:54.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:271af37b:::23:head 2024-02-05T07:23:54.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:95b121be:::24:head 2024-02-05T07:23:54.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:58d1031b:::25:head 2024-02-05T07:23:54.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:0a050783:::26:head 2024-02-05T07:23:54.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:c709704c:::27:head 2024-02-05T07:23:54.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:cbe56eaf:::28:head 2024-02-05T07:23:54.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:86b4b162:::29:head 2024-02-05T07:23:54.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:70d89383:::30:head 2024-02-05T07:23:54.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:dd450c7c:::31:head 2024-02-05T07:23:54.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:6d5729b1:::32:head 2024-02-05T07:23:54.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:c388f3fb:::33:head 2024-02-05T07:23:54.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:56cfea31:::34:head 2024-02-05T07:23:54.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:9dbc1bf7:::35:head 2024-02-05T07:23:54.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:40b74ccd:::36:head 2024-02-05T07:23:54.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:4d5aaf42:::37:head 2024-02-05T07:23:54.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:920f362c:::38:head 2024-02-05T07:23:54.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:6cc53222:::39:head 2024-02-05T07:23:54.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:9cad833f:::40:head 2024-02-05T07:23:54.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:1ea84d41:::41:head 2024-02-05T07:23:54.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:c4480ef6:::42:head 2024-02-05T07:23:54.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:a694361e:::43:head 2024-02-05T07:23:54.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:d1bd33e9:::44:head 2024-02-05T07:23:54.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:ddc2cd5d:::45:head 2024-02-05T07:23:54.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:2b782207:::46:head 2024-02-05T07:23:54.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:7b187fca:::47:head 2024-02-05T07:23:54.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:90ecdf6f:::48:head 2024-02-05T07:23:54.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:a5ed95fe:::49:head 2024-02-05T07:23:54.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:ea0eaa55:::50:head 2024-02-05T07:23:54.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:f33ef17b:::51:head 2024-02-05T07:23:54.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:a0d1b2f6:::52:head 2024-02-05T07:23:54.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:60c5229e:::53:head 2024-02-05T07:23:54.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:edcbc575:::54:head 2024-02-05T07:23:54.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:102cf253:::55:head 2024-02-05T07:23:54.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:efb7fb0b:::56:head 2024-02-05T07:23:54.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:50d0a326:::57:head 2024-02-05T07:23:54.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:d4dc5daf:::58:head 2024-02-05T07:23:54.194 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:3a130462:::59:head 2024-02-05T07:23:54.194 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:ec87ed71:::60:head 2024-02-05T07:23:54.194 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:d5bc9454:::61:head 2024-02-05T07:23:54.194 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:3ddfe313:::62:head 2024-02-05T07:23:54.194 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:7c2816b9:::63:head 2024-02-05T07:23:54.194 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:47e00e4d:::64:head 2024-02-05T07:23:54.194 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:c6410c18:::65:head 2024-02-05T07:23:54.194 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:b48ed237:::66:head 2024-02-05T07:23:54.194 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:cd63ad31:::67:head 2024-02-05T07:23:54.194 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:b179e92b:::68:head 2024-02-05T07:23:54.194 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:0d9f741a:::69:head 2024-02-05T07:23:54.194 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:6d3352ae:::70:head 2024-02-05T07:23:54.194 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:c6d5c19e:::71:head 2024-02-05T07:23:54.194 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:bc4729c3:::72:head 2024-02-05T07:23:54.194 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:77e930b9:::73:head 2024-02-05T07:23:54.195 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:0abeecfd:::74:head 2024-02-05T07:23:54.195 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:b7c37e15:::75:head 2024-02-05T07:23:54.195 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:b6378398:::76:head 2024-02-05T07:23:54.195 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:02bd68de:::77:head 2024-02-05T07:23:54.195 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:cc795d2d:::78:head 2024-02-05T07:23:54.195 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:630d4fea:::79:head 2024-02-05T07:23:54.195 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:e0d29ef5:::80:head 2024-02-05T07:23:54.195 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:fd6f13d2:::81:head 2024-02-05T07:23:54.195 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:606461d5:::82:head 2024-02-05T07:23:54.195 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:eadbdc43:::83:head 2024-02-05T07:23:54.195 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:8761d0bb:::84:head 2024-02-05T07:23:54.195 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:9ef0186f:::85:head 2024-02-05T07:23:54.195 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:e0d41294:::86:head 2024-02-05T07:23:54.195 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:961de695:::87:head 2024-02-05T07:23:54.195 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:1423148f:::88:head 2024-02-05T07:23:54.196 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:633a8fa2:::89:head 2024-02-05T07:23:54.196 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:a8653809:::90:head 2024-02-05T07:23:54.196 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:3dac8b33:::91:head 2024-02-05T07:23:54.196 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:35aad435:::92:head 2024-02-05T07:23:54.196 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:f6dcc343:::93:head 2024-02-05T07:23:54.196 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:dbbdad87:::94:head 2024-02-05T07:23:54.196 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:1cb48ce0:::95:head 2024-02-05T07:23:54.196 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:03cd461c:::96:head 2024-02-05T07:23:54.196 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:17a4ea99:::97:head 2024-02-05T07:23:54.196 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:9993c9a7:::98:head 2024-02-05T07:23:54.196 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:6394211c:::99:head 2024-02-05T07:23:54.196 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:94c7ae57:::100:head 2024-02-05T07:23:54.196 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:6fdee5bb:::101:head 2024-02-05T07:23:54.196 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:9a477fd1:::102:head 2024-02-05T07:23:54.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:eb850916:::103:head 2024-02-05T07:23:54.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:affc56b9:::104:head 2024-02-05T07:23:54.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:b42dc814:::105:head 2024-02-05T07:23:54.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:f319f8f0:::106:head 2024-02-05T07:23:54.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:9a40b9de:::107:head 2024-02-05T07:23:54.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:8b524f28:::108:head 2024-02-05T07:23:54.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:e3de589f:::109:head 2024-02-05T07:23:54.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:90f90a5b:::110:head 2024-02-05T07:23:54.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:a7b4f1d7:::111:head 2024-02-05T07:23:54.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:af51766e:::112:head 2024-02-05T07:23:54.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:b6f90bd1:::113:head 2024-02-05T07:23:54.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:e0261208:::114:head 2024-02-05T07:23:54.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:c9569ef7:::115:head 2024-02-05T07:23:54.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:61bebe50:::116:head 2024-02-05T07:23:54.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:fe93412b:::117:head 2024-02-05T07:23:54.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:d3d38bee:::118:head 2024-02-05T07:23:54.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:3100ba0c:::119:head 2024-02-05T07:23:54.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:d0560ada:::120:head 2024-02-05T07:23:54.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:f0ea8b35:::121:head 2024-02-05T07:23:54.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:766f231a:::122:head 2024-02-05T07:23:54.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:a07a2582:::123:head 2024-02-05T07:23:54.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:bd7c6b3a:::124:head 2024-02-05T07:23:54.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:fb2ddaff:::125:head 2024-02-05T07:23:54.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:4408e1fe:::126:head 2024-02-05T07:23:54.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:ee1df7a7:::127:head 2024-02-05T07:23:54.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:c3002909:::128:head 2024-02-05T07:23:54.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:4f48ffa9:::129:head 2024-02-05T07:23:54.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:edf38733:::130:head 2024-02-05T07:23:54.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:c08425c0:::131:head 2024-02-05T07:23:54.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:5f902d98:::132:head 2024-02-05T07:23:54.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:41ea2c93:::133:head 2024-02-05T07:23:54.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:813cee13:::134:head 2024-02-05T07:23:54.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:0131818d:::135:head 2024-02-05T07:23:54.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:26ba5a85:::136:head 2024-02-05T07:23:54.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:381b8a5a:::137:head 2024-02-05T07:23:54.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:28797e47:::138:head 2024-02-05T07:23:54.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:bfca7f22:::139:head 2024-02-05T07:23:54.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:36807075:::140:head 2024-02-05T07:23:54.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:80b03975:::141:head 2024-02-05T07:23:54.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:5c15709b:::142:head 2024-02-05T07:23:54.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:f39ea15e:::143:head 2024-02-05T07:23:54.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:ea992956:::144:head 2024-02-05T07:23:54.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:48887b1c:::145:head 2024-02-05T07:23:54.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:9f24a9dd:::146:head 2024-02-05T07:23:54.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:987f100b:::147:head 2024-02-05T07:23:54.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:d2dd3581:::148:head 2024-02-05T07:23:54.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:7fed1808:::149:head 2024-02-05T07:23:54.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:c80b70e9:::150:head 2024-02-05T07:23:54.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:85ed90f9:::151:head 2024-02-05T07:23:54.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:36428b24:::152:head 2024-02-05T07:23:54.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:d044c34a:::153:head 2024-02-05T07:23:54.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:7c18bf58:::154:head 2024-02-05T07:23:54.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:d1c21232:::155:head 2024-02-05T07:23:54.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:a7a3c575:::156:head 2024-02-05T07:23:54.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:87da0633:::157:head 2024-02-05T07:23:54.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:d5ac3822:::158:head 2024-02-05T07:23:54.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:3f20522d:::159:head 2024-02-05T07:23:54.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:6ca26563:::160:head 2024-02-05T07:23:54.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:532ce135:::161:head 2024-02-05T07:23:54.201 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:c78863e6:::162:head 2024-02-05T07:23:54.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:54 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:23:54.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:54 smithi188 ceph-mon[33283]: from='client.36245 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi184-81228-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:54.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:54 smithi188 ceph-mon[33283]: osdmap e299: 8 total, 8 up, 8 in 2024-02-05T07:23:54.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-02-05T07:23:54.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi184-81228-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:54.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:54 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-02-05T07:23:54.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:54 smithi188 ceph-mon[33283]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi184-81228-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:54.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:54 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:23:54.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:54 smithi184 ceph-mon[29861]: from='client.36245 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi184-81228-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:54.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:54 smithi184 ceph-mon[29861]: osdmap e299: 8 total, 8 up, 8 in 2024-02-05T07:23:54.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-02-05T07:23:54.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi184-81228-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:54.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:54 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-02-05T07:23:54.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:54 smithi184 ceph-mon[29861]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi184-81228-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:54.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:54 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:23:54.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:54 smithi184 ceph-mon[41609]: from='client.36245 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi184-81228-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:23:54.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:54 smithi184 ceph-mon[41609]: osdmap e299: 8 total, 8 up, 8 in 2024-02-05T07:23:54.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-02-05T07:23:54.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi184-81228-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:54.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:54 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-02-05T07:23:54.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:54 smithi184 ceph-mon[41609]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi184-81228-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:55.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:55 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-02-05T07:23:55.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:55 smithi188 ceph-mon[33283]: pgmap v411: 324 pgs: 324 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:55.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:55 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi184-81478-43","var": "pg_num","format": "json"}]: dispatch 2024-02-05T07:23:55.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:55 smithi188 ceph-mon[33283]: osdmap e300: 8 total, 8 up, 8 in 2024-02-05T07:23:55.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:55 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:55.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:55 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:55.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:55 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43"}]: dispatch 2024-02-05T07:23:55.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:55 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43"}]: dispatch 2024-02-05T07:23:55.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:55 smithi188 ceph-mon[33283]: from='client.36245 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi184-81228-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi184-81228-57"}]': finished 2024-02-05T07:23:55.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:55 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43"}]': finished 2024-02-05T07:23:55.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:55 smithi188 ceph-mon[33283]: osdmap e301: 8 total, 8 up, 8 in 2024-02-05T07:23:55.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-02-05T07:23:55.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[29861]: pgmap v411: 324 pgs: 324 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:55.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi184-81478-43","var": "pg_num","format": "json"}]: dispatch 2024-02-05T07:23:55.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[29861]: osdmap e300: 8 total, 8 up, 8 in 2024-02-05T07:23:55.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:55.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:55.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43"}]: dispatch 2024-02-05T07:23:55.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43"}]: dispatch 2024-02-05T07:23:55.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[29861]: from='client.36245 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi184-81228-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi184-81228-57"}]': finished 2024-02-05T07:23:55.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43"}]': finished 2024-02-05T07:23:55.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[29861]: osdmap e301: 8 total, 8 up, 8 in 2024-02-05T07:23:55.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-02-05T07:23:55.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[41609]: pgmap v411: 324 pgs: 324 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:55.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi184-81478-43","var": "pg_num","format": "json"}]: dispatch 2024-02-05T07:23:55.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[41609]: osdmap e300: 8 total, 8 up, 8 in 2024-02-05T07:23:55.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:55.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:23:55.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43"}]: dispatch 2024-02-05T07:23:55.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43"}]: dispatch 2024-02-05T07:23:55.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[41609]: from='client.36245 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi184-81228-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi184-81228-57"}]': finished 2024-02-05T07:23:55.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-43"}]': finished 2024-02-05T07:23:55.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:55 smithi184 ceph-mon[41609]: osdmap e301: 8 total, 8 up, 8 in 2024-02-05T07:23:57.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:56 smithi188 ceph-mon[33283]: osdmap e302: 8 total, 8 up, 8 in 2024-02-05T07:23:57.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:56 smithi188 ceph-mon[33283]: pgmap v414: 300 pgs: 8 unknown, 292 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:57.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:56 smithi184 ceph-mon[29861]: osdmap e302: 8 total, 8 up, 8 in 2024-02-05T07:23:57.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:56 smithi184 ceph-mon[29861]: pgmap v414: 300 pgs: 8 unknown, 292 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:57.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:56 smithi184 ceph-mon[41609]: osdmap e302: 8 total, 8 up, 8 in 2024-02-05T07:23:57.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:56 smithi184 ceph-mon[41609]: pgmap v414: 300 pgs: 8 unknown, 292 active+clean; 8.4 MiB data, 612 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:57.974 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:23:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:23:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:57 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:57 smithi188 ceph-mon[33283]: osdmap e303: 8 total, 8 up, 8 in 2024-02-05T07:23:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:57 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:57 smithi188 ceph-mon[33283]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:57 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:57 smithi184 ceph-mon[29861]: osdmap e303: 8 total, 8 up, 8 in 2024-02-05T07:23:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:57 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:58.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:57 smithi184 ceph-mon[29861]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:58.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:57 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:23:58.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:57 smithi184 ceph-mon[41609]: osdmap e303: 8 total, 8 up, 8 in 2024-02-05T07:23:58.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:58.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:57 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:23:58.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:57 smithi184 ceph-mon[41609]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:58 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:58 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:58 smithi188 ceph-mon[33283]: from='client.36245 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi184-81228-57"}]': finished 2024-02-05T07:23:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:58 smithi188 ceph-mon[33283]: osdmap e304: 8 total, 8 up, 8 in 2024-02-05T07:23:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:58 smithi188 ceph-mon[33283]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:59.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:58 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:59.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:58 smithi188 ceph-mon[33283]: pgmap v417: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:59.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:23:59.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[29861]: from='client.36245 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi184-81228-57"}]': finished 2024-02-05T07:23:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[29861]: osdmap e304: 8 total, 8 up, 8 in 2024-02-05T07:23:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[29861]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[29861]: pgmap v417: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:23:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:23:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:23:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[41609]: from='client.36245 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi184-81228-57"}]': finished 2024-02-05T07:23:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[41609]: osdmap e304: 8 total, 8 up, 8 in 2024-02-05T07:23:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/294872809' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[41609]: from='client.36245 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi184-81228-57"}]: dispatch 2024-02-05T07:23:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:23:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[41609]: pgmap v417: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:23:59.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:24:00.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:59 smithi188 ceph-mon[33283]: from='client.36245 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi184-81228-57"}]': finished 2024-02-05T07:24:00.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:24:00.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:59 smithi188 ceph-mon[33283]: osdmap e305: 8 total, 8 up, 8 in 2024-02-05T07:24:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_count","val": "3"}]: dispatch 2024-02-05T07:24:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_count","val": "3"}]: dispatch 2024-02-05T07:24:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:59 smithi188 ceph-mon[33283]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:59 smithi188 ceph-mon[33283]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi184-81228-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:00.250 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:23:59 smithi188 ceph-mon[33283]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi184-81228-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[29861]: from='client.36245 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi184-81228-57"}]': finished 2024-02-05T07:24:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:24:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[29861]: osdmap e305: 8 total, 8 up, 8 in 2024-02-05T07:24:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_count","val": "3"}]: dispatch 2024-02-05T07:24:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_count","val": "3"}]: dispatch 2024-02-05T07:24:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[29861]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:00.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[29861]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:00.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi184-81228-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:00.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[29861]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi184-81228-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:00.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[41609]: from='client.36245 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi184-81228-57"}]': finished 2024-02-05T07:24:00.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:24:00.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[41609]: osdmap e305: 8 total, 8 up, 8 in 2024-02-05T07:24:00.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_count","val": "3"}]: dispatch 2024-02-05T07:24:00.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_count","val": "3"}]: dispatch 2024-02-05T07:24:00.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[41609]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[41609]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi184-81228-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:00.274 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:23:59 smithi184 ceph-mon[41609]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi184-81228-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:01.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:01 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_count","val": "3"}]': finished 2024-02-05T07:24:01.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:01 smithi188 ceph-mon[33283]: from='client.36251 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi184-81228-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:01.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:01 smithi188 ceph-mon[33283]: osdmap e306: 8 total, 8 up, 8 in 2024-02-05T07:24:01.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_period","val": "3"}]: dispatch 2024-02-05T07:24:01.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi184-81228-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:01.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:01 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_period","val": "3"}]: dispatch 2024-02-05T07:24:01.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:01 smithi188 ceph-mon[33283]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi184-81228-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:01.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:01 smithi188 ceph-mon[33283]: pgmap v420: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:01.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:01 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_period","val": "3"}]': finished 2024-02-05T07:24:01.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_count","val": "3"}]': finished 2024-02-05T07:24:01.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[29861]: from='client.36251 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi184-81228-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:01.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[29861]: osdmap e306: 8 total, 8 up, 8 in 2024-02-05T07:24:01.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_period","val": "3"}]: dispatch 2024-02-05T07:24:01.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi184-81228-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:01.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_period","val": "3"}]: dispatch 2024-02-05T07:24:01.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[29861]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi184-81228-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:01.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[29861]: pgmap v420: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:01.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_period","val": "3"}]': finished 2024-02-05T07:24:01.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_count","val": "3"}]': finished 2024-02-05T07:24:01.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[41609]: from='client.36251 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi184-81228-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:01.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[41609]: osdmap e306: 8 total, 8 up, 8 in 2024-02-05T07:24:01.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_period","val": "3"}]: dispatch 2024-02-05T07:24:01.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi184-81228-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:01.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_period","val": "3"}]: dispatch 2024-02-05T07:24:01.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[41609]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi184-81228-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:01.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[41609]: pgmap v420: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:01.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_period","val": "3"}]': finished 2024-02-05T07:24:02.248 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:24:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:24:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:24:02.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:02.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[29861]: osdmap e307: 8 total, 8 up, 8 in 2024-02-05T07:24:02.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:02.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[29861]: from='client.36251 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi184-81228-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi184-81228-58"}]': finished 2024-02-05T07:24:02.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:24:02.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[29861]: osdmap e308: 8 total, 8 up, 8 in 2024-02-05T07:24:02.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-05T07:24:02.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-05T07:24:02.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:02.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[41609]: osdmap e307: 8 total, 8 up, 8 in 2024-02-05T07:24:02.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:02.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[41609]: from='client.36251 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi184-81228-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi184-81228-58"}]': finished 2024-02-05T07:24:02.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:24:02.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[41609]: osdmap e308: 8 total, 8 up, 8 in 2024-02-05T07:24:02.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-05T07:24:02.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:02 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-05T07:24:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:02 smithi188 ceph-mon[33283]: osdmap e307: 8 total, 8 up, 8 in 2024-02-05T07:24:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:02 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:02 smithi188 ceph-mon[33283]: from='client.36251 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi184-81228-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi184-81228-58"}]': finished 2024-02-05T07:24:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:02 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:24:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:02 smithi188 ceph-mon[33283]: osdmap e308: 8 total, 8 up, 8 in 2024-02-05T07:24:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-05T07:24:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:02 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-05T07:24:03.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:03 smithi184 ceph-mon[41609]: pgmap v423: 332 pgs: 8 unknown, 32 creating+peering, 292 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:03.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:03 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:03.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:03 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-05T07:24:03.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:03 smithi184 ceph-mon[41609]: osdmap e309: 8 total, 8 up, 8 in 2024-02-05T07:24:03.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:03 smithi184 ceph-mon[29861]: pgmap v423: 332 pgs: 8 unknown, 32 creating+peering, 292 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:03.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:03 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:03.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:03 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-05T07:24:03.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:03 smithi184 ceph-mon[29861]: osdmap e309: 8 total, 8 up, 8 in 2024-02-05T07:24:03.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:03 smithi188 ceph-mon[33283]: pgmap v423: 332 pgs: 8 unknown, 32 creating+peering, 292 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:03.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:03 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:03.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:03 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-05T07:24:03.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:03 smithi188 ceph-mon[33283]: osdmap e309: 8 total, 8 up, 8 in 2024-02-05T07:24:05.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:05 smithi184 ceph-mon[41609]: osdmap e310: 8 total, 8 up, 8 in 2024-02-05T07:24:05.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:05.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:05 smithi184 ceph-mon[41609]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:05.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:05 smithi184 ceph-mon[41609]: pgmap v426: 324 pgs: 324 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:05 smithi184 ceph-mon[29861]: osdmap e310: 8 total, 8 up, 8 in 2024-02-05T07:24:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:05 smithi184 ceph-mon[29861]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:05.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:05 smithi184 ceph-mon[29861]: pgmap v426: 324 pgs: 324 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:05.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:05 smithi188 ceph-mon[33283]: osdmap e310: 8 total, 8 up, 8 in 2024-02-05T07:24:05.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:05.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:05 smithi188 ceph-mon[33283]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:05.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:05 smithi188 ceph-mon[33283]: pgmap v426: 324 pgs: 324 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:06.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:06 smithi184 ceph-mon[29861]: from='client.36251 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi184-81228-58"}]': finished 2024-02-05T07:24:06.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:06 smithi184 ceph-mon[29861]: osdmap e311: 8 total, 8 up, 8 in 2024-02-05T07:24:06.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:06.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:06 smithi184 ceph-mon[29861]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:06.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:06 smithi184 ceph-mon[41609]: from='client.36251 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi184-81228-58"}]': finished 2024-02-05T07:24:06.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:06 smithi184 ceph-mon[41609]: osdmap e311: 8 total, 8 up, 8 in 2024-02-05T07:24:06.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:06.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:06 smithi184 ceph-mon[41609]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:06.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:06 smithi188 ceph-mon[33283]: from='client.36251 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi184-81228-58"}]': finished 2024-02-05T07:24:06.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:06 smithi188 ceph-mon[33283]: osdmap e311: 8 total, 8 up, 8 in 2024-02-05T07:24:06.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/769412738' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:06.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:06 smithi188 ceph-mon[33283]: from='client.36251 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi184-81228-58"}]: dispatch 2024-02-05T07:24:07.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:07 smithi188 ceph-mon[33283]: from='client.36251 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi184-81228-58"}]': finished 2024-02-05T07:24:07.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:07 smithi188 ceph-mon[33283]: osdmap e312: 8 total, 8 up, 8 in 2024-02-05T07:24:07.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi184-81228-59"}]: dispatch 2024-02-05T07:24:07.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi184-81228-59"}]: dispatch 2024-02-05T07:24:07.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi184-81228-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:07.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:07 smithi188 ceph-mon[33283]: pgmap v429: 324 pgs: 324 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:07.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:07 smithi184 ceph-mon[29861]: from='client.36251 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi184-81228-58"}]': finished 2024-02-05T07:24:07.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:07 smithi184 ceph-mon[29861]: osdmap e312: 8 total, 8 up, 8 in 2024-02-05T07:24:07.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi184-81228-59"}]: dispatch 2024-02-05T07:24:07.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi184-81228-59"}]: dispatch 2024-02-05T07:24:07.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi184-81228-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:07.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:07 smithi184 ceph-mon[29861]: pgmap v429: 324 pgs: 324 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:07 smithi184 ceph-mon[41609]: from='client.36251 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi184-81228-58"}]': finished 2024-02-05T07:24:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:07 smithi184 ceph-mon[41609]: osdmap e312: 8 total, 8 up, 8 in 2024-02-05T07:24:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi184-81228-59"}]: dispatch 2024-02-05T07:24:07.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi184-81228-59"}]: dispatch 2024-02-05T07:24:07.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi184-81228-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:07.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:07 smithi184 ceph-mon[41609]: pgmap v429: 324 pgs: 324 active+clean; 8.4 MiB data, 617 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:07.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:24:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:24:08.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi184-81228-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:08.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:08 smithi188 ceph-mon[33283]: osdmap e313: 8 total, 8 up, 8 in 2024-02-05T07:24:08.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi184-81228-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi184-81228-59"}]: dispatch 2024-02-05T07:24:08.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi184-81228-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:08.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:08 smithi184 ceph-mon[29861]: osdmap e313: 8 total, 8 up, 8 in 2024-02-05T07:24:08.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi184-81228-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi184-81228-59"}]: dispatch 2024-02-05T07:24:08.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi184-81228-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:08.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:08 smithi184 ceph-mon[41609]: osdmap e313: 8 total, 8 up, 8 in 2024-02-05T07:24:08.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi184-81228-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi184-81228-59"}]: dispatch 2024-02-05T07:24:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:09 smithi188 ceph-mon[33283]: pgmap v432: 324 pgs: 324 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-05T07:24:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:09 smithi188 ceph-mon[33283]: osdmap e314: 8 total, 8 up, 8 in 2024-02-05T07:24:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi184-81228-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi184-81228-59"}]': finished 2024-02-05T07:24:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:09 smithi188 ceph-mon[33283]: osdmap e315: 8 total, 8 up, 8 in 2024-02-05T07:24:09.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:09 smithi184 ceph-mon[29861]: pgmap v432: 324 pgs: 324 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-05T07:24:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:09 smithi184 ceph-mon[29861]: osdmap e314: 8 total, 8 up, 8 in 2024-02-05T07:24:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi184-81228-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi184-81228-59"}]': finished 2024-02-05T07:24:09.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:09 smithi184 ceph-mon[29861]: osdmap e315: 8 total, 8 up, 8 in 2024-02-05T07:24:09.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:09.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:09 smithi184 ceph-mon[41609]: pgmap v432: 324 pgs: 324 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-05T07:24:09.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:09 smithi184 ceph-mon[41609]: osdmap e314: 8 total, 8 up, 8 in 2024-02-05T07:24:09.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi184-81228-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi184-81228-59"}]': finished 2024-02-05T07:24:09.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:09 smithi184 ceph-mon[41609]: osdmap e315: 8 total, 8 up, 8 in 2024-02-05T07:24:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:10 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:10 smithi188 ceph-mon[33283]: osdmap e316: 8 total, 8 up, 8 in 2024-02-05T07:24:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:10 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:10 smithi184 ceph-mon[41609]: osdmap e316: 8 total, 8 up, 8 in 2024-02-05T07:24:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:10 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:10.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:10 smithi184 ceph-mon[29861]: osdmap e316: 8 total, 8 up, 8 in 2024-02-05T07:24:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:11 smithi188 ceph-mon[33283]: pgmap v435: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-05T07:24:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:11 smithi188 ceph-mon[33283]: osdmap e317: 8 total, 8 up, 8 in 2024-02-05T07:24:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi184-81228-59"}]: dispatch 2024-02-05T07:24:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:11 smithi184 ceph-mon[29861]: pgmap v435: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-05T07:24:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:11 smithi184 ceph-mon[29861]: osdmap e317: 8 total, 8 up, 8 in 2024-02-05T07:24:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi184-81228-59"}]: dispatch 2024-02-05T07:24:11.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:11 smithi184 ceph-mon[41609]: pgmap v435: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-05T07:24:11.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:11 smithi184 ceph-mon[41609]: osdmap e317: 8 total, 8 up, 8 in 2024-02-05T07:24:11.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi184-81228-59"}]: dispatch 2024-02-05T07:24:12.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:24:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:24:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:24:13.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:7462ddf6:::1o.RoundTripAppendPP (2985 ms) 2024-02-05T07:24:13.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-02-05T07:24:13.060 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (3011 ms) 2024-02-05T07:24:13.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-02-05T07:24:13.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3012 ms) 2024-02-05T07:24:13.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-02-05T07:24:13.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3260 ms) 2024-02-05T07:24:13.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-02-05T07:24:13.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: setting pool EIO 2024-02-05T07:24:13.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: max_success 101, min_failed 102 2024-02-05T07:24:13.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (3771 ms) 2024-02-05T07:24:13.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-02-05T07:24:13.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3256 ms) 2024-02-05T07:24:13.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (127474 ms total) 2024-02-05T07:24:13.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: 2024-02-05T07:24:13.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-02-05T07:24:13.061 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-02-05T07:24:13.062 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (2763 ms) 2024-02-05T07:24:13.062 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-02-05T07:24:13.062 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9053 ms) 2024-02-05T07:24:13.062 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-02-05T07:24:13.062 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14887 ms) 2024-02-05T07:24:13.062 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-02-05T07:24:13.062 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3028 ms) 2024-02-05T07:24:13.062 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (29731 ms total) 2024-02-05T07:24:13.062 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: 2024-02-05T07:24:13.062 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-02-05T07:24:13.062 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-02-05T07:24:13.062 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3018 ms) 2024-02-05T07:24:13.062 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3018 ms total) 2024-02-05T07:24:13.062 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: 2024-02-05T07:24:13.062 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-02-05T07:24:13.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-02-05T07:24:13.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13972 ms) 2024-02-05T07:24:13.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-02-05T07:24:13.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (6967 ms) 2024-02-05T07:24:13.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-02-05T07:24:13.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (7032 ms) 2024-02-05T07:24:13.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-02-05T07:24:13.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7043 ms) 2024-02-05T07:24:13.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-02-05T07:24:13.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3025 ms) 2024-02-05T07:24:13.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-02-05T07:24:13.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7046 ms) 2024-02-05T07:24:13.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-02-05T07:24:13.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (6864 ms) 2024-02-05T07:24:13.063 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-02-05T07:24:13.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (7037 ms) 2024-02-05T07:24:13.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-02-05T07:24:13.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7026 ms) 2024-02-05T07:24:13.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-02-05T07:24:13.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7076 ms) 2024-02-05T07:24:13.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-02-05T07:24:13.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7037 ms) 2024-02-05T07:24:13.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-02-05T07:24:13.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7028 ms) 2024-02-05T07:24:13.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-02-05T07:24:13.064 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7034 ms) 2024-02-05T07:24:13.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi184-81228-59"}]': finished 2024-02-05T07:24:13.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:13 smithi188 ceph-mon[33283]: osdmap e318: 8 total, 8 up, 8 in 2024-02-05T07:24:13.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi184-81228-59"}]: dispatch 2024-02-05T07:24:13.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:13 smithi188 ceph-mon[33283]: pgmap v438: 324 pgs: 324 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:13.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi184-81228-59"}]': finished 2024-02-05T07:24:13.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:13 smithi184 ceph-mon[29861]: osdmap e318: 8 total, 8 up, 8 in 2024-02-05T07:24:13.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi184-81228-59"}]: dispatch 2024-02-05T07:24:13.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:13 smithi184 ceph-mon[29861]: pgmap v438: 324 pgs: 324 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:13.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi184-81228-59"}]': finished 2024-02-05T07:24:13.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:13 smithi184 ceph-mon[41609]: osdmap e318: 8 total, 8 up, 8 in 2024-02-05T07:24:13.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi184-81228-59"}]: dispatch 2024-02-05T07:24:13.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:13 smithi184 ceph-mon[41609]: pgmap v438: 324 pgs: 324 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:14.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi184-81228-59"}]': finished 2024-02-05T07:24:14.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:14 smithi188 ceph-mon[33283]: osdmap e319: 8 total, 8 up, 8 in 2024-02-05T07:24:14.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:14 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:24:14.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi184-81228-59"}]': finished 2024-02-05T07:24:14.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:14 smithi184 ceph-mon[29861]: osdmap e319: 8 total, 8 up, 8 in 2024-02-05T07:24:14.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:14 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:24:14.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1579180436' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi184-81228-59"}]': finished 2024-02-05T07:24:14.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:14 smithi184 ceph-mon[41609]: osdmap e319: 8 total, 8 up, 8 in 2024-02-05T07:24:14.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:14 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:24:15.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:15 smithi188 ceph-mon[33283]: osdmap e320: 8 total, 8 up, 8 in 2024-02-05T07:24:15.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1970413656' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi184-81228-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:15.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:15 smithi188 ceph-mon[33283]: from='client.36263 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi184-81228-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:15.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:15 smithi188 ceph-mon[33283]: pgmap v441: 356 pgs: 32 unknown, 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-05T07:24:15.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:15 smithi184 ceph-mon[29861]: osdmap e320: 8 total, 8 up, 8 in 2024-02-05T07:24:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1970413656' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi184-81228-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:15 smithi184 ceph-mon[29861]: from='client.36263 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi184-81228-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:15.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:15 smithi184 ceph-mon[29861]: pgmap v441: 356 pgs: 32 unknown, 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-05T07:24:15.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:15 smithi184 ceph-mon[41609]: osdmap e320: 8 total, 8 up, 8 in 2024-02-05T07:24:15.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1970413656' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi184-81228-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:15.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:15 smithi184 ceph-mon[41609]: from='client.36263 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi184-81228-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:15.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:15 smithi184 ceph-mon[41609]: pgmap v441: 356 pgs: 32 unknown, 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-05T07:24:16.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:16 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:16.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:16.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:16 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:16 smithi188 ceph-mon[33283]: from='client.36263 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi184-81228-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:24:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:16 smithi188 ceph-mon[33283]: osdmap e321: 8 total, 8 up, 8 in 2024-02-05T07:24:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45"}]: dispatch 2024-02-05T07:24:16.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:16 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45"}]: dispatch 2024-02-05T07:24:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:16 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:16 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:16 smithi184 ceph-mon[29861]: from='client.36263 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi184-81228-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:24:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:16 smithi184 ceph-mon[29861]: osdmap e321: 8 total, 8 up, 8 in 2024-02-05T07:24:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45"}]: dispatch 2024-02-05T07:24:16.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:16 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45"}]: dispatch 2024-02-05T07:24:16.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:16 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:16 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:16 smithi184 ceph-mon[41609]: from='client.36263 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi184-81228-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:24:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:16 smithi184 ceph-mon[41609]: osdmap e321: 8 total, 8 up, 8 in 2024-02-05T07:24:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45"}]: dispatch 2024-02-05T07:24:16.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:16 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45"}]: dispatch 2024-02-05T07:24:17.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:17 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45"}]': finished 2024-02-05T07:24:17.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:17 smithi188 ceph-mon[33283]: osdmap e322: 8 total, 8 up, 8 in 2024-02-05T07:24:17.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:17.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:17 smithi188 ceph-mon[33283]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:17.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:17.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:17 smithi188 ceph-mon[33283]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:17.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi184-81228-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:17.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:17 smithi188 ceph-mon[33283]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi184-81228-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:17.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:17 smithi188 ceph-mon[33283]: pgmap v444: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-05T07:24:17.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45"}]': finished 2024-02-05T07:24:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[29861]: osdmap e322: 8 total, 8 up, 8 in 2024-02-05T07:24:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[29861]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[29861]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi184-81228-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[29861]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi184-81228-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:17.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[29861]: pgmap v444: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-05T07:24:17.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-45"}]': finished 2024-02-05T07:24:17.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[41609]: osdmap e322: 8 total, 8 up, 8 in 2024-02-05T07:24:17.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:17.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[41609]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:17.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:17.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[41609]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:17.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi184-81228-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:17.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[41609]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi184-81228-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:17.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:17 smithi184 ceph-mon[41609]: pgmap v444: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-05T07:24:17.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:24:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:24:18.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:18 smithi188 ceph-mon[33283]: from='client.36269 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi184-81228-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:18.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:18 smithi188 ceph-mon[33283]: osdmap e323: 8 total, 8 up, 8 in 2024-02-05T07:24:18.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi184-81228-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:18.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:18 smithi188 ceph-mon[33283]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi184-81228-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:18.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:18 smithi184 ceph-mon[41609]: from='client.36269 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi184-81228-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:18.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:18 smithi184 ceph-mon[41609]: osdmap e323: 8 total, 8 up, 8 in 2024-02-05T07:24:18.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi184-81228-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:18.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:18 smithi184 ceph-mon[41609]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi184-81228-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:18.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:18 smithi184 ceph-mon[29861]: from='client.36269 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi184-81228-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:18.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:18 smithi184 ceph-mon[29861]: osdmap e323: 8 total, 8 up, 8 in 2024-02-05T07:24:18.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi184-81228-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:18.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:18 smithi184 ceph-mon[29861]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi184-81228-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:19 smithi188 ceph-mon[33283]: pgmap v447: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:19 smithi188 ceph-mon[33283]: osdmap e324: 8 total, 8 up, 8 in 2024-02-05T07:24:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:19 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:19.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:19.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:19 smithi184 ceph-mon[29861]: pgmap v447: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:19.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:19 smithi184 ceph-mon[29861]: osdmap e324: 8 total, 8 up, 8 in 2024-02-05T07:24:19.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:19.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:19 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:19 smithi184 ceph-mon[41609]: pgmap v447: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:19 smithi184 ceph-mon[41609]: osdmap e324: 8 total, 8 up, 8 in 2024-02-05T07:24:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:19 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:20 smithi188 ceph-mon[33283]: from='client.36269 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi184-81228-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi184-81228-61"}]': finished 2024-02-05T07:24:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:20 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:24:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:20 smithi188 ceph-mon[33283]: osdmap e325: 8 total, 8 up, 8 in 2024-02-05T07:24:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:20 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:20.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:20 smithi184 ceph-mon[29861]: from='client.36269 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi184-81228-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi184-81228-61"}]': finished 2024-02-05T07:24:20.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:20 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:24:20.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:20 smithi184 ceph-mon[29861]: osdmap e325: 8 total, 8 up, 8 in 2024-02-05T07:24:20.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:20.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:20 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:20.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:20 smithi184 ceph-mon[41609]: from='client.36269 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi184-81228-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi184-81228-61"}]': finished 2024-02-05T07:24:20.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:20 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:24:20.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:20 smithi184 ceph-mon[41609]: osdmap e325: 8 total, 8 up, 8 in 2024-02-05T07:24:20.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:20.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:20 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:21 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:24:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:21 smithi188 ceph-mon[33283]: osdmap e326: 8 total, 8 up, 8 in 2024-02-05T07:24:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:21 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:21 smithi188 ceph-mon[33283]: pgmap v450: 332 pgs: 40 unknown, 292 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:21.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:21 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:24:21.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:21 smithi184 ceph-mon[29861]: osdmap e326: 8 total, 8 up, 8 in 2024-02-05T07:24:21.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:21.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:21 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:21.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:21 smithi184 ceph-mon[29861]: pgmap v450: 332 pgs: 40 unknown, 292 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:21.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:21 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:24:21.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:21 smithi184 ceph-mon[41609]: osdmap e326: 8 total, 8 up, 8 in 2024-02-05T07:24:21.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:21.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:21 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:21.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:21 smithi184 ceph-mon[41609]: pgmap v450: 332 pgs: 40 unknown, 292 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:22.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:24:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:24:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:24:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:22 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-47"}]': finished 2024-02-05T07:24:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:22 smithi184 ceph-mon[29861]: osdmap e327: 8 total, 8 up, 8 in 2024-02-05T07:24:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-47", "mode": "writeback"}]: dispatch 2024-02-05T07:24:22.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:22.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:22 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-47", "mode": "writeback"}]: dispatch 2024-02-05T07:24:22.273 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:22 smithi184 ceph-mon[29861]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:22 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-47"}]': finished 2024-02-05T07:24:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:22 smithi184 ceph-mon[41609]: osdmap e327: 8 total, 8 up, 8 in 2024-02-05T07:24:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-47", "mode": "writeback"}]: dispatch 2024-02-05T07:24:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:22 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-47", "mode": "writeback"}]: dispatch 2024-02-05T07:24:22.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:22 smithi184 ceph-mon[41609]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:22.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:22 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-47"}]': finished 2024-02-05T07:24:22.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:22 smithi188 ceph-mon[33283]: osdmap e327: 8 total, 8 up, 8 in 2024-02-05T07:24:22.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-47", "mode": "writeback"}]: dispatch 2024-02-05T07:24:22.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:22.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:22 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-47", "mode": "writeback"}]: dispatch 2024-02-05T07:24:22.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:22 smithi188 ceph-mon[33283]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:23 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:24:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:23 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-47", "mode": "writeback"}]': finished 2024-02-05T07:24:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:23 smithi188 ceph-mon[33283]: from='client.36269 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi184-81228-61"}]': finished 2024-02-05T07:24:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:23 smithi188 ceph-mon[33283]: osdmap e328: 8 total, 8 up, 8 in 2024-02-05T07:24:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:24:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:23 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:24:23.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:23 smithi188 ceph-mon[33283]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:23.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:23 smithi188 ceph-mon[33283]: pgmap v453: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:23.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:23 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:24:23.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:24:23.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-47", "mode": "writeback"}]': finished 2024-02-05T07:24:23.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[29861]: from='client.36269 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi184-81228-61"}]': finished 2024-02-05T07:24:23.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[29861]: osdmap e328: 8 total, 8 up, 8 in 2024-02-05T07:24:23.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:24:23.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:23.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:24:23.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[29861]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:23.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[29861]: pgmap v453: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:23.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:24:23.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:24:23.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-47", "mode": "writeback"}]': finished 2024-02-05T07:24:23.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[41609]: from='client.36269 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi184-81228-61"}]': finished 2024-02-05T07:24:23.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[41609]: osdmap e328: 8 total, 8 up, 8 in 2024-02-05T07:24:23.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:24:23.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/676035187' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:23.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:24:23.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[41609]: from='client.36269 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi184-81228-61"}]: dispatch 2024-02-05T07:24:23.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[41609]: pgmap v453: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:23.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:23 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:24:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: from='client.36269 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi184-81228-61"}]': finished 2024-02-05T07:24:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: osdmap e329: 8 total, 8 up, 8 in 2024-02-05T07:24:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:24:24.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:24:24.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:24.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:24.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:24:24.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: from='client.36275 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:24.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: osdmap e330: 8 total, 8 up, 8 in 2024-02-05T07:24:24.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:24.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi184-81228-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:24.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:24 smithi188 ceph-mon[33283]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi184-81228-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: from='client.36269 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi184-81228-61"}]': finished 2024-02-05T07:24:24.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: osdmap e329: 8 total, 8 up, 8 in 2024-02-05T07:24:24.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:24.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:24:24.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:24:24.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:24.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:24.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:24:24.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: from='client.36275 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:24.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: osdmap e330: 8 total, 8 up, 8 in 2024-02-05T07:24:24.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:24.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi184-81228-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:24.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[29861]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi184-81228-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: from='client.36269 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi184-81228-61"}]': finished 2024-02-05T07:24:24.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: osdmap e329: 8 total, 8 up, 8 in 2024-02-05T07:24:24.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:24.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:24:24.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:24:24.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:24.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:24.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:24:24.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: from='client.36275 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:24.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: osdmap e330: 8 total, 8 up, 8 in 2024-02-05T07:24:24.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:24.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi184-81228-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:24.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:24.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:24 smithi184 ceph-mon[41609]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi184-81228-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:25.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:25 smithi188 ceph-mon[33283]: pgmap v456: 324 pgs: 324 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-05T07:24:25.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:25 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:24:25.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:25 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:24:25.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:25 smithi184 ceph-mon[29861]: pgmap v456: 324 pgs: 324 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-05T07:24:25.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:25 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:24:25.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:25 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:24:25.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:25 smithi184 ceph-mon[41609]: pgmap v456: 324 pgs: 324 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-05T07:24:25.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:25 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:24:25.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:25 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:24:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:24:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:26 smithi188 ceph-mon[33283]: osdmap e331: 8 total, 8 up, 8 in 2024-02-05T07:24:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:26 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:24:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:26 smithi188 ceph-mon[33283]: from='client.36275 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi184-81228-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi184-81228-62"}]': finished 2024-02-05T07:24:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:26 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-05T07:24:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:26 smithi188 ceph-mon[33283]: osdmap e332: 8 total, 8 up, 8 in 2024-02-05T07:24:26.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-05T07:24:26.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:26 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-05T07:24:26.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:24:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[29861]: osdmap e331: 8 total, 8 up, 8 in 2024-02-05T07:24:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:24:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[29861]: from='client.36275 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi184-81228-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi184-81228-62"}]': finished 2024-02-05T07:24:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-05T07:24:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[29861]: osdmap e332: 8 total, 8 up, 8 in 2024-02-05T07:24:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-05T07:24:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-05T07:24:26.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:24:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[41609]: osdmap e331: 8 total, 8 up, 8 in 2024-02-05T07:24:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:24:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[41609]: from='client.36275 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi184-81228-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi184-81228-62"}]': finished 2024-02-05T07:24:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-05T07:24:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[41609]: osdmap e332: 8 total, 8 up, 8 in 2024-02-05T07:24:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-05T07:24:26.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:26 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-05T07:24:27.650 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:27 smithi188 ceph-mon[33283]: pgmap v459: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-05T07:24:27.650 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:27 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-05T07:24:27.651 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:27 smithi188 ceph-mon[33283]: osdmap e333: 8 total, 8 up, 8 in 2024-02-05T07:24:27.651 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-05T07:24:27.651 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:27 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-05T07:24:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:27 smithi184 ceph-mon[29861]: pgmap v459: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-05T07:24:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:27 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-05T07:24:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:27 smithi184 ceph-mon[29861]: osdmap e333: 8 total, 8 up, 8 in 2024-02-05T07:24:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-05T07:24:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:27 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-05T07:24:27.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:27 smithi184 ceph-mon[41609]: pgmap v459: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-05T07:24:27.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:27 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-05T07:24:27.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:27 smithi184 ceph-mon[41609]: osdmap e333: 8 total, 8 up, 8 in 2024-02-05T07:24:27.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-05T07:24:27.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:27 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-05T07:24:27.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:24:27 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:24:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-05T07:24:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:29 smithi188 ceph-mon[33283]: osdmap e334: 8 total, 8 up, 8 in 2024-02-05T07:24:29.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:29.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:29 smithi188 ceph-mon[33283]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:29.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:29 smithi188 ceph-mon[33283]: pgmap v462: 324 pgs: 324 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:29.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:29.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:29.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:24:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-05T07:24:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[29861]: osdmap e334: 8 total, 8 up, 8 in 2024-02-05T07:24:29.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:29.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[29861]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:29.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[29861]: pgmap v462: 324 pgs: 324 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:29.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:29.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:29.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:24:29.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:29.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-05T07:24:29.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[41609]: osdmap e334: 8 total, 8 up, 8 in 2024-02-05T07:24:29.524 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:29.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[41609]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:29.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[41609]: pgmap v462: 324 pgs: 324 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:29.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:29.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:29.525 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:24:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:30 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:30 smithi188 ceph-mon[33283]: from='client.36275 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62"}]': finished 2024-02-05T07:24:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:30 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:24:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:30 smithi188 ceph-mon[33283]: osdmap e335: 8 total, 8 up, 8 in 2024-02-05T07:24:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:30.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:30 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:30.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:30 smithi188 ceph-mon[33283]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:30.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[29861]: from='client.36275 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62"}]': finished 2024-02-05T07:24:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:24:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[29861]: osdmap e335: 8 total, 8 up, 8 in 2024-02-05T07:24:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:30.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[29861]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[41609]: from='client.36275 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi184-81228-62"}]': finished 2024-02-05T07:24:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:24:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[41609]: osdmap e335: 8 total, 8 up, 8 in 2024-02-05T07:24:30.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:30.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2226425211' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:30.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:30.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:30 smithi184 ceph-mon[41609]: from='client.36275 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi184-81228-62"}]: dispatch 2024-02-05T07:24:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:31 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47"}]': finished 2024-02-05T07:24:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:31 smithi188 ceph-mon[33283]: from='client.36275 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi184-81228-62"}]': finished 2024-02-05T07:24:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:31 smithi188 ceph-mon[33283]: osdmap e336: 8 total, 8 up, 8 in 2024-02-05T07:24:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:31 smithi188 ceph-mon[33283]: pgmap v465: 324 pgs: 324 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi184-81228-63"}]: dispatch 2024-02-05T07:24:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi184-81228-63"}]: dispatch 2024-02-05T07:24:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi184-81228-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:31.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:31.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:31 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:31.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:31.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:31 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:31.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47"}]': finished 2024-02-05T07:24:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[29861]: from='client.36275 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi184-81228-62"}]': finished 2024-02-05T07:24:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[29861]: osdmap e336: 8 total, 8 up, 8 in 2024-02-05T07:24:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[29861]: pgmap v465: 324 pgs: 324 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi184-81228-63"}]: dispatch 2024-02-05T07:24:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi184-81228-63"}]: dispatch 2024-02-05T07:24:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi184-81228-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:31.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:31.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47"}]': finished 2024-02-05T07:24:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[41609]: from='client.36275 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi184-81228-62"}]': finished 2024-02-05T07:24:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[41609]: osdmap e336: 8 total, 8 up, 8 in 2024-02-05T07:24:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[41609]: pgmap v465: 324 pgs: 324 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi184-81228-63"}]: dispatch 2024-02-05T07:24:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi184-81228-63"}]: dispatch 2024-02-05T07:24:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi184-81228-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:31.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-47"}]: dispatch 2024-02-05T07:24:32.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:24:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:24:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:24:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi184-81228-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:32 smithi188 ceph-mon[33283]: osdmap e337: 8 total, 8 up, 8 in 2024-02-05T07:24:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi184-81228-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi184-81228-63"}]: dispatch 2024-02-05T07:24:32.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi184-81228-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:32.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:32 smithi184 ceph-mon[29861]: osdmap e337: 8 total, 8 up, 8 in 2024-02-05T07:24:32.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi184-81228-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi184-81228-63"}]: dispatch 2024-02-05T07:24:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi184-81228-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:32 smithi184 ceph-mon[41609]: osdmap e337: 8 total, 8 up, 8 in 2024-02-05T07:24:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi184-81228-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi184-81228-63"}]: dispatch 2024-02-05T07:24:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:33 smithi188 ceph-mon[33283]: pgmap v468: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:33.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:33 smithi188 ceph-mon[33283]: osdmap e338: 8 total, 8 up, 8 in 2024-02-05T07:24:33.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:33.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:33 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:33.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi184-81228-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi184-81228-63"}]': finished 2024-02-05T07:24:33.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:33 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:24:33.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:33 smithi188 ceph-mon[33283]: osdmap e339: 8 total, 8 up, 8 in 2024-02-05T07:24:33.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:33.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:33 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[29861]: pgmap v468: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[29861]: osdmap e338: 8 total, 8 up, 8 in 2024-02-05T07:24:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi184-81228-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi184-81228-63"}]': finished 2024-02-05T07:24:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:24:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[29861]: osdmap e339: 8 total, 8 up, 8 in 2024-02-05T07:24:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:33.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:33.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[41609]: pgmap v468: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:33.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[41609]: osdmap e338: 8 total, 8 up, 8 in 2024-02-05T07:24:33.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:33.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:33.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi184-81228-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi184-81228-63"}]': finished 2024-02-05T07:24:33.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:24:33.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[41609]: osdmap e339: 8 total, 8 up, 8 in 2024-02-05T07:24:33.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:33.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:33 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:35.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:35 smithi188 ceph-mon[33283]: pgmap v470: 332 pgs: 8 unknown, 32 creating+peering, 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-05T07:24:35.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:35 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:24:35.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:35 smithi188 ceph-mon[33283]: osdmap e340: 8 total, 8 up, 8 in 2024-02-05T07:24:35.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:35.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:35 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:35.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:35 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:24:35.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:35 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:35.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:35 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:24:35.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:35 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:24:35.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:35 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:24:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[41609]: pgmap v470: 332 pgs: 8 unknown, 32 creating+peering, 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-05T07:24:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:24:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[41609]: osdmap e340: 8 total, 8 up, 8 in 2024-02-05T07:24:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:24:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:24:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:24:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:24:35.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[29861]: pgmap v470: 332 pgs: 8 unknown, 32 creating+peering, 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-05T07:24:35.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:24:35.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[29861]: osdmap e340: 8 total, 8 up, 8 in 2024-02-05T07:24:35.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:35.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:35.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:24:35.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:35.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:24:35.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:24:35.524 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:35 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:24:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:36 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-49"}]': finished 2024-02-05T07:24:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:36 smithi188 ceph-mon[33283]: osdmap e341: 8 total, 8 up, 8 in 2024-02-05T07:24:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-49", "mode": "readproxy"}]: dispatch 2024-02-05T07:24:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:36 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-49", "mode": "readproxy"}]: dispatch 2024-02-05T07:24:36.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi184-81228-63"}]: dispatch 2024-02-05T07:24:36.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:36 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-49"}]': finished 2024-02-05T07:24:36.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:36 smithi184 ceph-mon[29861]: osdmap e341: 8 total, 8 up, 8 in 2024-02-05T07:24:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-49", "mode": "readproxy"}]: dispatch 2024-02-05T07:24:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:36 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-49", "mode": "readproxy"}]: dispatch 2024-02-05T07:24:36.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi184-81228-63"}]: dispatch 2024-02-05T07:24:36.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:36 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-49"}]': finished 2024-02-05T07:24:36.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:36 smithi184 ceph-mon[41609]: osdmap e341: 8 total, 8 up, 8 in 2024-02-05T07:24:36.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-49", "mode": "readproxy"}]: dispatch 2024-02-05T07:24:36.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:36 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-49", "mode": "readproxy"}]: dispatch 2024-02-05T07:24:36.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi184-81228-63"}]: dispatch 2024-02-05T07:24:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:37 smithi188 ceph-mon[33283]: pgmap v473: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-05T07:24:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:37 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:24:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:37 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-49", "mode": "readproxy"}]': finished 2024-02-05T07:24:37.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi184-81228-63"}]': finished 2024-02-05T07:24:37.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:37 smithi188 ceph-mon[33283]: osdmap e342: 8 total, 8 up, 8 in 2024-02-05T07:24:37.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi184-81228-63"}]: dispatch 2024-02-05T07:24:37.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:37 smithi184 ceph-mon[29861]: pgmap v473: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-05T07:24:37.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:37 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:24:37.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:37 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-49", "mode": "readproxy"}]': finished 2024-02-05T07:24:37.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi184-81228-63"}]': finished 2024-02-05T07:24:37.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:37 smithi184 ceph-mon[29861]: osdmap e342: 8 total, 8 up, 8 in 2024-02-05T07:24:37.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi184-81228-63"}]: dispatch 2024-02-05T07:24:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:37 smithi184 ceph-mon[41609]: pgmap v473: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-05T07:24:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:37 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:24:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:37 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-49", "mode": "readproxy"}]': finished 2024-02-05T07:24:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi184-81228-63"}]': finished 2024-02-05T07:24:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:37 smithi184 ceph-mon[41609]: osdmap e342: 8 total, 8 up, 8 in 2024-02-05T07:24:37.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi184-81228-63"}]: dispatch 2024-02-05T07:24:37.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:24:37 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:24:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi184-81228-63"}]': finished 2024-02-05T07:24:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:38 smithi188 ceph-mon[33283]: osdmap e343: 8 total, 8 up, 8 in 2024-02-05T07:24:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:38 smithi188 ceph-mon[33283]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:38 smithi188 ceph-mon[33283]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:38.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi184-81228-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:38.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:38 smithi188 ceph-mon[33283]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi184-81228-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:38.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi184-81228-63"}]': finished 2024-02-05T07:24:38.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[29861]: osdmap e343: 8 total, 8 up, 8 in 2024-02-05T07:24:38.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:38.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[29861]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:38.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:38.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[29861]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:38.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi184-81228-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:38.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[29861]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi184-81228-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/420632769' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi184-81228-63"}]': finished 2024-02-05T07:24:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[41609]: osdmap e343: 8 total, 8 up, 8 in 2024-02-05T07:24:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[41609]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[41609]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi184-81228-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:38 smithi184 ceph-mon[41609]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi184-81228-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:39.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:39.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:39 smithi188 ceph-mon[33283]: pgmap v476: 324 pgs: 324 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:24:39.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:39 smithi188 ceph-mon[33283]: from='client.36287 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi184-81228-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:39.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:39 smithi188 ceph-mon[33283]: osdmap e344: 8 total, 8 up, 8 in 2024-02-05T07:24:39.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi184-81228-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:39.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:39 smithi188 ceph-mon[33283]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi184-81228-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:39.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:39.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:39 smithi184 ceph-mon[29861]: pgmap v476: 324 pgs: 324 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:24:39.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:39 smithi184 ceph-mon[29861]: from='client.36287 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi184-81228-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:39.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:39 smithi184 ceph-mon[29861]: osdmap e344: 8 total, 8 up, 8 in 2024-02-05T07:24:39.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi184-81228-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:39.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:39 smithi184 ceph-mon[29861]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi184-81228-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:39.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:39.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:39 smithi184 ceph-mon[41609]: pgmap v476: 324 pgs: 324 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:24:39.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:39 smithi184 ceph-mon[41609]: from='client.36287 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi184-81228-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:39.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:39 smithi184 ceph-mon[41609]: osdmap e344: 8 total, 8 up, 8 in 2024-02-05T07:24:39.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi184-81228-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:39.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:39 smithi184 ceph-mon[41609]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi184-81228-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:40.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:40 smithi188 ceph-mon[33283]: osdmap e345: 8 total, 8 up, 8 in 2024-02-05T07:24:40.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:40 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:40.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:40 smithi188 ceph-mon[33283]: pgmap v479: 324 pgs: 324 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:24:40.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:40 smithi188 ceph-mon[33283]: from='client.36287 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi184-81228-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi184-81228-64"}]': finished 2024-02-05T07:24:40.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:40 smithi188 ceph-mon[33283]: osdmap e346: 8 total, 8 up, 8 in 2024-02-05T07:24:40.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:40 smithi184 ceph-mon[29861]: osdmap e345: 8 total, 8 up, 8 in 2024-02-05T07:24:40.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:40 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:40.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:40 smithi184 ceph-mon[29861]: pgmap v479: 324 pgs: 324 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:24:40.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:40 smithi184 ceph-mon[29861]: from='client.36287 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi184-81228-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi184-81228-64"}]': finished 2024-02-05T07:24:40.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:40 smithi184 ceph-mon[29861]: osdmap e346: 8 total, 8 up, 8 in 2024-02-05T07:24:40.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:40 smithi184 ceph-mon[41609]: osdmap e345: 8 total, 8 up, 8 in 2024-02-05T07:24:40.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:40 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:40.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:40 smithi184 ceph-mon[41609]: pgmap v479: 324 pgs: 324 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:24:40.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:40 smithi184 ceph-mon[41609]: from='client.36287 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi184-81228-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi184-81228-64"}]': finished 2024-02-05T07:24:40.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:40 smithi184 ceph-mon[41609]: osdmap e346: 8 total, 8 up, 8 in 2024-02-05T07:24:42.215 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:24:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:24:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:24:42.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:42 smithi188 ceph-mon[33283]: osdmap e347: 8 total, 8 up, 8 in 2024-02-05T07:24:42.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:42 smithi184 ceph-mon[29861]: osdmap e347: 8 total, 8 up, 8 in 2024-02-05T07:24:42.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:42 smithi184 ceph-mon[41609]: osdmap e347: 8 total, 8 up, 8 in 2024-02-05T07:24:43.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:43 smithi188 ceph-mon[33283]: pgmap v482: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:43.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:43 smithi188 ceph-mon[33283]: osdmap e348: 8 total, 8 up, 8 in 2024-02-05T07:24:43.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:43.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:43 smithi188 ceph-mon[33283]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:43.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:43 smithi184 ceph-mon[29861]: pgmap v482: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:43.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:43 smithi184 ceph-mon[29861]: osdmap e348: 8 total, 8 up, 8 in 2024-02-05T07:24:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:43 smithi184 ceph-mon[29861]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:43.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:43 smithi184 ceph-mon[41609]: pgmap v482: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 622 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:43.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:43 smithi184 ceph-mon[41609]: osdmap e348: 8 total, 8 up, 8 in 2024-02-05T07:24:43.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:43.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:43 smithi184 ceph-mon[41609]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:44.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:44 smithi188 ceph-mon[33283]: from='client.36287 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi184-81228-64"}]': finished 2024-02-05T07:24:44.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:44 smithi188 ceph-mon[33283]: osdmap e349: 8 total, 8 up, 8 in 2024-02-05T07:24:44.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:44 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:44.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:44 smithi188 ceph-mon[33283]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:44.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:24:44.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:24:44.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:44 smithi184 ceph-mon[29861]: from='client.36287 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi184-81228-64"}]': finished 2024-02-05T07:24:44.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:44 smithi184 ceph-mon[29861]: osdmap e349: 8 total, 8 up, 8 in 2024-02-05T07:24:44.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:44 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:44.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:44 smithi184 ceph-mon[29861]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:44.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:24:44.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:24:44.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:44 smithi184 ceph-mon[41609]: from='client.36287 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi184-81228-64"}]': finished 2024-02-05T07:24:44.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:44 smithi184 ceph-mon[41609]: osdmap e349: 8 total, 8 up, 8 in 2024-02-05T07:24:44.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:44 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3551035416' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:44.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:44 smithi184 ceph-mon[41609]: from='client.36287 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi184-81228-64"}]: dispatch 2024-02-05T07:24:44.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:24:44.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:24:45.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:45 smithi188 ceph-mon[33283]: pgmap v485: 324 pgs: 324 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:45.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:45 smithi188 ceph-mon[33283]: from='client.36287 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi184-81228-64"}]': finished 2024-02-05T07:24:45.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:45 smithi188 ceph-mon[33283]: osdmap e350: 8 total, 8 up, 8 in 2024-02-05T07:24:45.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi184-81228-65"}]: dispatch 2024-02-05T07:24:45.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi184-81228-65"}]: dispatch 2024-02-05T07:24:45.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi184-81228-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:45.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:45 smithi184 ceph-mon[29861]: pgmap v485: 324 pgs: 324 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:45 smithi184 ceph-mon[29861]: from='client.36287 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi184-81228-64"}]': finished 2024-02-05T07:24:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:45 smithi184 ceph-mon[29861]: osdmap e350: 8 total, 8 up, 8 in 2024-02-05T07:24:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi184-81228-65"}]: dispatch 2024-02-05T07:24:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi184-81228-65"}]: dispatch 2024-02-05T07:24:45.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi184-81228-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:45 smithi184 ceph-mon[41609]: pgmap v485: 324 pgs: 324 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:45 smithi184 ceph-mon[41609]: from='client.36287 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi184-81228-64"}]': finished 2024-02-05T07:24:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:45 smithi184 ceph-mon[41609]: osdmap e350: 8 total, 8 up, 8 in 2024-02-05T07:24:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi184-81228-65"}]: dispatch 2024-02-05T07:24:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi184-81228-65"}]: dispatch 2024-02-05T07:24:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi184-81228-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:46.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi184-81228-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:46.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:46 smithi188 ceph-mon[33283]: osdmap e351: 8 total, 8 up, 8 in 2024-02-05T07:24:46.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi184-81228-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi184-81228-65"}]: dispatch 2024-02-05T07:24:46.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi184-81228-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:46.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:46 smithi184 ceph-mon[29861]: osdmap e351: 8 total, 8 up, 8 in 2024-02-05T07:24:46.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi184-81228-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi184-81228-65"}]: dispatch 2024-02-05T07:24:46.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi184-81228-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:46.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:46 smithi184 ceph-mon[41609]: osdmap e351: 8 total, 8 up, 8 in 2024-02-05T07:24:46.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi184-81228-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi184-81228-65"}]: dispatch 2024-02-05T07:24:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:47 smithi188 ceph-mon[33283]: pgmap v488: 324 pgs: 324 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:47 smithi188 ceph-mon[33283]: osdmap e352: 8 total, 8 up, 8 in 2024-02-05T07:24:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:47 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:47.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:47 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:47.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:47 smithi184 ceph-mon[29861]: pgmap v488: 324 pgs: 324 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:47.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:47 smithi184 ceph-mon[29861]: osdmap e352: 8 total, 8 up, 8 in 2024-02-05T07:24:47.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:47 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:47.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:47 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:47.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:47 smithi184 ceph-mon[41609]: pgmap v488: 324 pgs: 324 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:47.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:47 smithi184 ceph-mon[41609]: osdmap e352: 8 total, 8 up, 8 in 2024-02-05T07:24:47.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:47 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:47.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:47 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:47.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:24:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:24:48.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:48 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi184-81228-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi184-81228-65"}]': finished 2024-02-05T07:24:48.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:48 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:24:48.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:48 smithi184 ceph-mon[29861]: osdmap e353: 8 total, 8 up, 8 in 2024-02-05T07:24:48.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:48 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:48.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:48 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:48.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:48 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi184-81228-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi184-81228-65"}]': finished 2024-02-05T07:24:48.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:48 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:24:48.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:48 smithi184 ceph-mon[41609]: osdmap e353: 8 total, 8 up, 8 in 2024-02-05T07:24:48.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:48 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:48.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:48 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:48.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:48 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi184-81228-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi184-81228-65"}]': finished 2024-02-05T07:24:48.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:48 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:24:48.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:48 smithi188 ceph-mon[33283]: osdmap e353: 8 total, 8 up, 8 in 2024-02-05T07:24:48.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:48 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:48.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:48 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:49.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP63:head 2024-02-05T07:24:49.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:5d165639:::164:head 2024-02-05T07:24:49.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:f43765fc:::165:head 2024-02-05T07:24:49.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:b4c720e9:::166:head 2024-02-05T07:24:49.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:e694b040:::167:head 2024-02-05T07:24:49.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:afa38db2:::168:head 2024-02-05T07:24:49.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:77ba9f53:::169:head 2024-02-05T07:24:49.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:87495034:::170:head 2024-02-05T07:24:49.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:7c96bf0e:::171:head 2024-02-05T07:24:49.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:dbe346cc:::172:head 2024-02-05T07:24:49.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:e943ec24:::173:head 2024-02-05T07:24:49.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:f97a9c0c:::174:head 2024-02-05T07:24:49.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:6f26e74d:::175:head 2024-02-05T07:24:49.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:4f95e106:::176:head 2024-02-05T07:24:49.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:0e6f2f8f:::177:head 2024-02-05T07:24:49.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:05db05f1:::178:head 2024-02-05T07:24:49.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:38a78d66:::179:head 2024-02-05T07:24:49.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:d095610b:::180:head 2024-02-05T07:24:49.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:a1a9d709:::181:head 2024-02-05T07:24:49.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:1e5d39db:::182:head 2024-02-05T07:24:49.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:f7df4fb9:::183:head 2024-02-05T07:24:49.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:03a7f161:::184:head 2024-02-05T07:24:49.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:ba70721e:::185:head 2024-02-05T07:24:49.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:28e5662d:::186:head 2024-02-05T07:24:49.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:973d52de:::187:head 2024-02-05T07:24:49.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:4303eb1c:::188:head 2024-02-05T07:24:49.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:b990b48e:::189:head 2024-02-05T07:24:49.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:29b8165b:::190:head 2024-02-05T07:24:49.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:3547f197:::191:head 2024-02-05T07:24:49.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:7e260936:::192:head 2024-02-05T07:24:49.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:1abec7b1:::193:head 2024-02-05T07:24:49.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:10fdda93:::194:head 2024-02-05T07:24:49.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:15817eea:::195:head 2024-02-05T07:24:49.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:770bab57:::196:head 2024-02-05T07:24:49.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:ed9e13e7:::197:head 2024-02-05T07:24:49.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:71471a8f:::198:head 2024-02-05T07:24:49.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: checking for 266:10fb1d02:::199:head 2024-02-05T07:24:49.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (8053 ms) 2024-02-05T07:24:49.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-02-05T07:24:49.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707117844,0 2024-02-05T07:24:49.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: first is 1707117844 2024-02-05T07:24:49.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707117844,0 2024-02-05T07:24:49.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707117844,0 2024-02-05T07:24:49.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707117844,1707117846,1707117847,0 2024-02-05T07:24:49.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707117844,1707117846,1707117847,0 2024-02-05T07:24:49.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707117844,1707117846,1707117847,0 2024-02-05T07:24:49.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707117844,1707117846,1707117847,1707117849,1707117850,0 2024-02-05T07:24:49.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707117844,1707117846,1707117847,1707117849,1707117850,0 2024-02-05T07:24:49.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707117844,1707117846,1707117847,1707117849,1707117850,0 2024-02-05T07:24:49.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707117844,1707117846,1707117847,1707117849,1707117850,1707117852,1707117853,0 2024-02-05T07:24:49.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707117844,1707117846,1707117847,1707117849,1707117850,1707117852,1707117853,0 2024-02-05T07:24:49.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707117844,1707117846,1707117847,1707117849,1707117850,1707117852,1707117853,0 2024-02-05T07:24:49.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707117847,1707117849,1707117850,1707117852,1707117853,1707117855,1707117856,0 2024-02-05T07:24:49.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: first now 1707117847, trimmed 2024-02-05T07:24:49.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (21116 ms) 2024-02-05T07:24:49.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-02-05T07:24:49.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: foo0 2024-02-05T07:24:49.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-02-05T07:24:49.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (14073 ms) 2024-02-05T07:24:49.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-02-05T07:24:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[29861]: pgmap v491: 332 pgs: 4 creating+peering, 4 unknown, 324 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:24:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49"}]': finished 2024-02-05T07:24:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[29861]: osdmap e354: 8 total, 8 up, 8 in 2024-02-05T07:24:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[41609]: pgmap v491: 332 pgs: 4 creating+peering, 4 unknown, 324 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:24:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49"}]': finished 2024-02-05T07:24:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[41609]: osdmap e354: 8 total, 8 up, 8 in 2024-02-05T07:24:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:49.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:49 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:49 smithi188 ceph-mon[33283]: pgmap v491: 332 pgs: 4 creating+peering, 4 unknown, 324 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:49 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:49 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:24:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:49 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49"}]': finished 2024-02-05T07:24:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:49 smithi188 ceph-mon[33283]: osdmap e354: 8 total, 8 up, 8 in 2024-02-05T07:24:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:49.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:49 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:24:49.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:49.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:49 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-49"}]: dispatch 2024-02-05T07:24:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:50 smithi184 ceph-mon[29861]: osdmap e355: 8 total, 8 up, 8 in 2024-02-05T07:24:50.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi184-81228-65"}]: dispatch 2024-02-05T07:24:50.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:50 smithi184 ceph-mon[41609]: osdmap e355: 8 total, 8 up, 8 in 2024-02-05T07:24:50.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi184-81228-65"}]: dispatch 2024-02-05T07:24:50.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:50 smithi188 ceph-mon[33283]: osdmap e355: 8 total, 8 up, 8 in 2024-02-05T07:24:50.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi184-81228-65"}]: dispatch 2024-02-05T07:24:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[29861]: pgmap v494: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi184-81228-65"}]': finished 2024-02-05T07:24:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[29861]: osdmap e356: 8 total, 8 up, 8 in 2024-02-05T07:24:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi184-81228-65"}]: dispatch 2024-02-05T07:24:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi184-81228-65"}]': finished 2024-02-05T07:24:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:24:51.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[29861]: osdmap e357: 8 total, 8 up, 8 in 2024-02-05T07:24:51.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[41609]: pgmap v494: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi184-81228-65"}]': finished 2024-02-05T07:24:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[41609]: osdmap e356: 8 total, 8 up, 8 in 2024-02-05T07:24:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi184-81228-65"}]: dispatch 2024-02-05T07:24:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi184-81228-65"}]': finished 2024-02-05T07:24:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:24:51.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-mon[41609]: osdmap e357: 8 total, 8 up, 8 in 2024-02-05T07:24:51.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:51 smithi188 ceph-mon[33283]: pgmap v494: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:24:51.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi184-81228-65"}]': finished 2024-02-05T07:24:51.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:51 smithi188 ceph-mon[33283]: osdmap e356: 8 total, 8 up, 8 in 2024-02-05T07:24:51.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:51.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi184-81228-65"}]: dispatch 2024-02-05T07:24:51.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:51 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:24:51.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1401693209' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi184-81228-65"}]': finished 2024-02-05T07:24:51.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:51 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:24:51.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:51 smithi188 ceph-mon[33283]: osdmap e357: 8 total, 8 up, 8 in 2024-02-05T07:24:52.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:24:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:24:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:24:52.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:52.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:52 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:52.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:52 smithi188 ceph-mon[33283]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:52 smithi188 ceph-mon[33283]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi184-81228-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:52.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:52 smithi188 ceph-mon[33283]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi184-81228-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:52.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:52 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:24:52.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:52 smithi188 ceph-mon[33283]: from='client.36299 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi184-81228-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:52.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:52 smithi188 ceph-mon[33283]: osdmap e358: 8 total, 8 up, 8 in 2024-02-05T07:24:52.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:24:52.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi184-81228-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:52 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:24:52.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:52 smithi188 ceph-mon[33283]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi184-81228-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:52.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:52.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[41609]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[41609]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi184-81228-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:52.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[41609]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi184-81228-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:52.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:24:52.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[41609]: from='client.36299 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi184-81228-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:52.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[41609]: osdmap e358: 8 total, 8 up, 8 in 2024-02-05T07:24:52.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:24:52.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi184-81228-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:24:52.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[41609]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi184-81228-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:52.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:24:52.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[29861]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[29861]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi184-81228-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:52.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[29861]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi184-81228-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:24:52.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:24:52.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[29861]: from='client.36299 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi184-81228-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:24:52.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[29861]: osdmap e358: 8 total, 8 up, 8 in 2024-02-05T07:24:52.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:24:52.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi184-81228-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:52.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:24:52.774 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:52 smithi184 ceph-mon[29861]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi184-81228-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:53.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:53 smithi184 ceph-mon[29861]: pgmap v497: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:53.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:53 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-51"}]': finished 2024-02-05T07:24:53.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:53 smithi184 ceph-mon[41609]: pgmap v497: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:53.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:53 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-51"}]': finished 2024-02-05T07:24:53.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:53 smithi188 ceph-mon[33283]: pgmap v497: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:24:53.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:53 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-51"}]': finished 2024-02-05T07:24:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-51", "mode": "writeback"}]: dispatch 2024-02-05T07:24:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[29861]: osdmap e359: 8 total, 8 up, 8 in 2024-02-05T07:24:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-51", "mode": "writeback"}]: dispatch 2024-02-05T07:24:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[29861]: pgmap v500: 324 pgs: 324 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:24:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:24:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[29861]: from='client.36299 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi184-81228-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi184-81228-66"}]': finished 2024-02-05T07:24:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-51", "mode": "writeback"}]': finished 2024-02-05T07:24:54.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[29861]: osdmap e360: 8 total, 8 up, 8 in 2024-02-05T07:24:54.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:24:54.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:24:54.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-51", "mode": "writeback"}]: dispatch 2024-02-05T07:24:54.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[41609]: osdmap e359: 8 total, 8 up, 8 in 2024-02-05T07:24:54.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-51", "mode": "writeback"}]: dispatch 2024-02-05T07:24:54.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[41609]: pgmap v500: 324 pgs: 324 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:24:54.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:24:54.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[41609]: from='client.36299 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi184-81228-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi184-81228-66"}]': finished 2024-02-05T07:24:54.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-51", "mode": "writeback"}]': finished 2024-02-05T07:24:54.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[41609]: osdmap e360: 8 total, 8 up, 8 in 2024-02-05T07:24:54.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:24:54.774 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:54 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:24:54.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-51", "mode": "writeback"}]: dispatch 2024-02-05T07:24:54.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:54 smithi188 ceph-mon[33283]: osdmap e359: 8 total, 8 up, 8 in 2024-02-05T07:24:54.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:54 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-51", "mode": "writeback"}]: dispatch 2024-02-05T07:24:54.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:54 smithi188 ceph-mon[33283]: pgmap v500: 324 pgs: 324 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:24:54.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:54 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:24:54.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:54 smithi188 ceph-mon[33283]: from='client.36299 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi184-81228-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi184-81228-66"}]': finished 2024-02-05T07:24:54.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:54 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-51", "mode": "writeback"}]': finished 2024-02-05T07:24:54.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:54 smithi188 ceph-mon[33283]: osdmap e360: 8 total, 8 up, 8 in 2024-02-05T07:24:55.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:24:55.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:54 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:24:55.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:55 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:55.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:55 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:24:55.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:55 smithi184 ceph-mon[29861]: osdmap e361: 8 total, 8 up, 8 in 2024-02-05T07:24:55.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:55 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:24:55.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:55 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:24:55.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:55 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:55.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:55 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:24:55.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:55 smithi184 ceph-mon[41609]: osdmap e361: 8 total, 8 up, 8 in 2024-02-05T07:24:55.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:55 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:24:55.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:55 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:24:55.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:55 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:24:55.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:55 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:24:55.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:55 smithi188 ceph-mon[33283]: osdmap e361: 8 total, 8 up, 8 in 2024-02-05T07:24:55.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:55 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:24:55.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:55 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:24:57.739 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:57 smithi188 ceph-mon[33283]: pgmap v503: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:24:57.739 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:57 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:24:57.739 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:57 smithi188 ceph-mon[33283]: osdmap e362: 8 total, 8 up, 8 in 2024-02-05T07:24:57.739 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:57.739 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:57 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:57.740 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:57.740 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:57 smithi188 ceph-mon[33283]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:57.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:57 smithi184 ceph-mon[29861]: pgmap v503: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:24:57.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:57 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:24:57.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:57 smithi184 ceph-mon[29861]: osdmap e362: 8 total, 8 up, 8 in 2024-02-05T07:24:57.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:57.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:57 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:57.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:57.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:57 smithi184 ceph-mon[29861]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:57.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:57 smithi184 ceph-mon[41609]: pgmap v503: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:24:57.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:57 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:24:57.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:57 smithi184 ceph-mon[41609]: osdmap e362: 8 total, 8 up, 8 in 2024-02-05T07:24:57.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:57.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:57 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:24:57.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:57.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:57 smithi184 ceph-mon[41609]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:57.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:24:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:24:58.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ 2 2024-02-05T07:24:58.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3025 ms) 2024-02-05T07:24:58.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-02-05T07:24:58.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7044 ms) 2024-02-05T07:24:58.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-02-05T07:24:58.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7029 ms) 2024-02-05T07:24:58.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-02-05T07:24:58.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7040 ms) 2024-02-05T07:24:58.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-02-05T07:24:58.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7038 ms) 2024-02-05T07:24:58.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-02-05T07:24:58.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7030 ms) 2024-02-05T07:24:58.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-02-05T07:24:58.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7022 ms) 2024-02-05T07:24:58.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139416 ms total) 2024-02-05T07:24:58.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: 2024-02-05T07:24:58.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-02-05T07:24:58.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (299639 ms total) 2024-02-05T07:24:58.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-02-05T07:24:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:58 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:24:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:58 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:24:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:58 smithi188 ceph-mon[33283]: from='client.36299 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi184-81228-66"}]': finished 2024-02-05T07:24:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:58 smithi188 ceph-mon[33283]: osdmap e363: 8 total, 8 up, 8 in 2024-02-05T07:24:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:58.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:24:58.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:58 smithi188 ceph-mon[33283]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:58.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:58 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:24:58.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:58 smithi188 ceph-mon[33283]: from='client.36299 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi184-81228-66"}]': finished 2024-02-05T07:24:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:24:58.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:24:58.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[29861]: from='client.36299 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi184-81228-66"}]': finished 2024-02-05T07:24:58.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[29861]: osdmap e363: 8 total, 8 up, 8 in 2024-02-05T07:24:58.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:58.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:24:58.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[29861]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:58.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:24:58.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[29861]: from='client.36299 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi184-81228-66"}]': finished 2024-02-05T07:24:58.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:24:58.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:24:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[41609]: from='client.36299 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi184-81228-66"}]': finished 2024-02-05T07:24:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[41609]: osdmap e363: 8 total, 8 up, 8 in 2024-02-05T07:24:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2803090450' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:24:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[41609]: from='client.36299 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi184-81228-66"}]: dispatch 2024-02-05T07:24:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:24:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:58 smithi184 ceph-mon[41609]: from='client.36299 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi184-81228-66"}]': finished 2024-02-05T07:24:59.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:59.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:59 smithi188 ceph-mon[33283]: pgmap v506: 324 pgs: 324 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-05T07:24:59.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-05T07:24:59.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:59 smithi188 ceph-mon[33283]: osdmap e364: 8 total, 8 up, 8 in 2024-02-05T07:24:59.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "target_max_objects","val": "1"}]: dispatch 2024-02-05T07:24:59.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "target_max_objects","val": "1"}]: dispatch 2024-02-05T07:24:59.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:24:59.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:24:59.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "target_max_objects","val": "1"}]': finished 2024-02-05T07:24:59.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:24:59 smithi188 ceph-mon[33283]: osdmap e365: 8 total, 8 up, 8 in 2024-02-05T07:24:59.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:59.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[29861]: pgmap v506: 324 pgs: 324 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-05T07:24:59.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-05T07:24:59.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[29861]: osdmap e364: 8 total, 8 up, 8 in 2024-02-05T07:24:59.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "target_max_objects","val": "1"}]: dispatch 2024-02-05T07:24:59.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "target_max_objects","val": "1"}]: dispatch 2024-02-05T07:24:59.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:24:59.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:24:59.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "target_max_objects","val": "1"}]': finished 2024-02-05T07:24:59.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[29861]: osdmap e365: 8 total, 8 up, 8 in 2024-02-05T07:24:59.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:24:59.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[41609]: pgmap v506: 324 pgs: 324 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-05T07:24:59.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-05T07:24:59.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[41609]: osdmap e364: 8 total, 8 up, 8 in 2024-02-05T07:24:59.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "target_max_objects","val": "1"}]: dispatch 2024-02-05T07:24:59.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "target_max_objects","val": "1"}]: dispatch 2024-02-05T07:24:59.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:24:59.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:24:59.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-51","var": "target_max_objects","val": "1"}]': finished 2024-02-05T07:24:59.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:24:59 smithi184 ceph-mon[41609]: osdmap e365: 8 total, 8 up, 8 in 2024-02-05T07:25:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:00 smithi188 ceph-mon[33283]: pgmap v509: 324 pgs: 324 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-05T07:25:01.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:00 smithi184 ceph-mon[29861]: pgmap v509: 324 pgs: 324 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-05T07:25:01.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:00 smithi184 ceph-mon[41609]: pgmap v509: 324 pgs: 324 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-05T07:25:02.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:01 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-05T07:25:02.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:01 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-05T07:25:02.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:01 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-05T07:25:02.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:25:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:25:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:25:03.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:02 smithi188 ceph-mon[33283]: pgmap v510: 324 pgs: 324 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-05T07:25:03.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:02 smithi184 ceph-mon[29861]: pgmap v510: 324 pgs: 324 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-05T07:25:03.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:02 smithi184 ceph-mon[41609]: pgmap v510: 324 pgs: 324 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-05T07:25:05.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:05 smithi188 ceph-mon[33283]: pgmap v511: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-05T07:25:05.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:05 smithi184 ceph-mon[29861]: pgmap v511: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-05T07:25:05.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:05 smithi184 ceph-mon[41609]: pgmap v511: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-05T07:25:07.079 INFO:tasks.workunit.client.0.smithi184.stdout: started 0x560254c33460 2024-02-05T07:25:07.079 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c32fc0 2024-02-05T07:25:07.080 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c330d0 2024-02-05T07:25:07.080 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c33200 2024-02-05T07:25:07.080 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c33310 2024-02-05T07:25:07.080 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c33a50 2024-02-05T07:25:07.080 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c335b0 2024-02-05T07:25:07.080 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c336c0 2024-02-05T07:25:07.080 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c337f0 2024-02-05T07:25:07.080 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c33920 2024-02-05T07:25:07.080 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c34020 2024-02-05T07:25:07.080 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c33b80 2024-02-05T07:25:07.080 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c33c90 2024-02-05T07:25:07.080 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c33dc0 2024-02-05T07:25:07.080 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c33ed0 2024-02-05T07:25:07.081 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c34610 2024-02-05T07:25:07.081 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c34170 2024-02-05T07:25:07.081 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c342a0 2024-02-05T07:25:07.081 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c343b0 2024-02-05T07:25:07.081 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c344e0 2024-02-05T07:25:07.081 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c34bc0 2024-02-05T07:25:07.081 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c34720 2024-02-05T07:25:07.081 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c34850 2024-02-05T07:25:07.081 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c34980 2024-02-05T07:25:07.081 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c34cf0 2024-02-05T07:25:07.081 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c34e40 2024-02-05T07:25:07.081 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c35430 2024-02-05T07:25:07.081 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c34f90 2024-02-05T07:25:07.081 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c350e0 2024-02-05T07:25:07.082 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c351f0 2024-02-05T07:25:07.082 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c35320 2024-02-05T07:25:07.082 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c359e0 2024-02-05T07:25:07.082 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c35540 2024-02-05T07:25:07.082 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c35690 2024-02-05T07:25:07.082 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c357c0 2024-02-05T07:25:07.082 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c35af0 2024-02-05T07:25:07.082 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c35fa0 2024-02-05T07:25:07.082 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c360b0 2024-02-05T07:25:07.082 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2cca0 2024-02-05T07:25:07.082 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2cdd0 2024-02-05T07:25:07.082 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c36680 2024-02-05T07:25:07.082 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c361e0 2024-02-05T07:25:07.082 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c36310 2024-02-05T07:25:07.083 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c36440 2024-02-05T07:25:07.083 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c36570 2024-02-05T07:25:07.083 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c36c50 2024-02-05T07:25:07.083 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c367b0 2024-02-05T07:25:07.083 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c368e0 2024-02-05T07:25:07.083 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c36a30 2024-02-05T07:25:07.083 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c36b40 2024-02-05T07:25:07.083 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c37220 2024-02-05T07:25:07.083 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c36d80 2024-02-05T07:25:07.083 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c36ed0 2024-02-05T07:25:07.083 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c37020 2024-02-05T07:25:07.083 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c37330 2024-02-05T07:25:07.083 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c377c0 2024-02-05T07:25:07.083 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c37910 2024-02-05T07:25:07.083 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c35c40 2024-02-05T07:25:07.084 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c35d50 2024-02-05T07:25:07.084 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c35e80 2024-02-05T07:25:07.084 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c37a60 2024-02-05T07:25:07.084 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c37ef0 2024-02-05T07:25:07.084 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c38020 2024-02-05T07:25:07.084 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c37460 2024-02-05T07:25:07.084 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c37590 2024-02-05T07:25:07.084 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c385f0 2024-02-05T07:25:07.084 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c38150 2024-02-05T07:25:07.084 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c382a0 2024-02-05T07:25:07.084 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c2cee0 2024-02-05T07:25:07.084 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c383d0 2024-02-05T07:25:07.084 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c38bc0 2024-02-05T07:25:07.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c38720 2024-02-05T07:25:07.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c38830 2024-02-05T07:25:07.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c376a0 2024-02-05T07:25:07.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c38980 2024-02-05T07:25:07.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c38ab0 2024-02-05T07:25:07.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c38d10 2024-02-05T07:25:07.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c391c0 2024-02-05T07:25:07.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c39310 2024-02-05T07:25:07.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c37b70 2024-02-05T07:25:07.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c37ca0 2024-02-05T07:25:07.085 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c39900 2024-02-05T07:25:07.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:07 smithi188 ceph-mon[33283]: pgmap v512: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-02-05T07:25:07.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:07 smithi184 ceph-mon[29861]: pgmap v512: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-02-05T07:25:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:07 smithi184 ceph-mon[41609]: pgmap v512: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-02-05T07:25:07.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:25:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:25:09.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:09.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:09 smithi188 ceph-mon[33283]: pgmap v513: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:09.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:09.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:09 smithi184 ceph-mon[29861]: pgmap v513: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:09.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:09.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:09 smithi184 ceph-mon[41609]: pgmap v513: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:10.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:10.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:10 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:10.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:10.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:10 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:10.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:10.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:10 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:11.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:11 smithi184 ceph-mon[29861]: pgmap v514: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:11.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:11 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:25:11.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:11 smithi184 ceph-mon[29861]: osdmap e366: 8 total, 8 up, 8 in 2024-02-05T07:25:11.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:25:11.529 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:11 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:25:11.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:11 smithi184 ceph-mon[41609]: pgmap v514: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:11.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:11 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:25:11.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:11 smithi184 ceph-mon[41609]: osdmap e366: 8 total, 8 up, 8 in 2024-02-05T07:25:11.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:25:11.530 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:11 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:25:11.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:11 smithi188 ceph-mon[33283]: pgmap v514: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:11.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:11 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:25:11.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:11 smithi188 ceph-mon[33283]: osdmap e366: 8 total, 8 up, 8 in 2024-02-05T07:25:11.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:25:11.753 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:11 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:25:12.260 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:25:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:25:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:25:12.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:12 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51"}]': finished 2024-02-05T07:25:12.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:12 smithi184 ceph-mon[29861]: osdmap e367: 8 total, 8 up, 8 in 2024-02-05T07:25:12.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:12.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:12 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:12.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:25:12.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:12 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:25:12.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:12 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51"}]': finished 2024-02-05T07:25:12.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:12 smithi184 ceph-mon[41609]: osdmap e367: 8 total, 8 up, 8 in 2024-02-05T07:25:12.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:12.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:12 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:12.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:25:12.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:12 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:25:12.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:12 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51"}]': finished 2024-02-05T07:25:12.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:12 smithi188 ceph-mon[33283]: osdmap e367: 8 total, 8 up, 8 in 2024-02-05T07:25:12.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:12.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:12 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:12.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:25:12.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:12 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-51"}]: dispatch 2024-02-05T07:25:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:13 smithi188 ceph-mon[33283]: pgmap v517: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-05T07:25:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:13 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-05T07:25:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:13 smithi188 ceph-mon[33283]: osdmap e368: 8 total, 8 up, 8 in 2024-02-05T07:25:13.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:13 smithi184 ceph-mon[29861]: pgmap v517: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-05T07:25:13.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:13 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-05T07:25:13.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:13 smithi184 ceph-mon[29861]: osdmap e368: 8 total, 8 up, 8 in 2024-02-05T07:25:13.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:13 smithi184 ceph-mon[41609]: pgmap v517: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-05T07:25:13.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:13 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-05T07:25:13.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:13 smithi184 ceph-mon[41609]: osdmap e368: 8 total, 8 up, 8 in 2024-02-05T07:25:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:14 smithi188 ceph-mon[33283]: osdmap e369: 8 total, 8 up, 8 in 2024-02-05T07:25:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:14 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:14 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:25:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:14 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:14 smithi188 ceph-mon[33283]: osdmap e370: 8 total, 8 up, 8 in 2024-02-05T07:25:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:14 smithi184 ceph-mon[29861]: osdmap e369: 8 total, 8 up, 8 in 2024-02-05T07:25:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:14 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:14 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:25:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:14 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:14.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:14 smithi184 ceph-mon[29861]: osdmap e370: 8 total, 8 up, 8 in 2024-02-05T07:25:14.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:14 smithi184 ceph-mon[41609]: osdmap e369: 8 total, 8 up, 8 in 2024-02-05T07:25:14.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:14.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:14 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:14.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:14 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:25:14.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:14 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:14.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:14 smithi184 ceph-mon[41609]: osdmap e370: 8 total, 8 up, 8 in 2024-02-05T07:25:15.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:15 smithi188 ceph-mon[33283]: pgmap v520: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-05T07:25:15.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:15 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:25:15.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:15.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:15 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:15.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-53"}]: dispatch 2024-02-05T07:25:16.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:15 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-53"}]: dispatch 2024-02-05T07:25:16.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:15 smithi188 ceph-mon[33283]: osdmap e371: 8 total, 8 up, 8 in 2024-02-05T07:25:16.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:15 smithi184 ceph-mon[29861]: pgmap v520: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-05T07:25:16.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:15 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:25:16.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:16.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:15 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:16.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-53"}]: dispatch 2024-02-05T07:25:16.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:15 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-53"}]: dispatch 2024-02-05T07:25:16.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:15 smithi184 ceph-mon[29861]: osdmap e371: 8 total, 8 up, 8 in 2024-02-05T07:25:16.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:15 smithi184 ceph-mon[41609]: pgmap v520: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-05T07:25:16.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:15 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:25:16.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:16.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:15 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:16.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-53"}]: dispatch 2024-02-05T07:25:16.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:15 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-53"}]: dispatch 2024-02-05T07:25:16.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:15 smithi184 ceph-mon[41609]: osdmap e371: 8 total, 8 up, 8 in 2024-02-05T07:25:17.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:17 smithi188 ceph-mon[33283]: pgmap v523: 292 pgs: 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-05T07:25:17.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:17 smithi188 ceph-mon[33283]: osdmap e372: 8 total, 8 up, 8 in 2024-02-05T07:25:17.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:17.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:17 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:17.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:17 smithi184 ceph-mon[29861]: pgmap v523: 292 pgs: 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-05T07:25:17.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:17 smithi184 ceph-mon[29861]: osdmap e372: 8 total, 8 up, 8 in 2024-02-05T07:25:17.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:17.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:17 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:17.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:17 smithi184 ceph-mon[41609]: pgmap v523: 292 pgs: 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-05T07:25:17.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:17 smithi184 ceph-mon[41609]: osdmap e372: 8 total, 8 up, 8 in 2024-02-05T07:25:17.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:17.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:17 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:18.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:25:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:25:18.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:18 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:18.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:18 smithi188 ceph-mon[33283]: osdmap e373: 8 total, 8 up, 8 in 2024-02-05T07:25:18.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:25:18.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:18.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:18 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:18.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-55"}]: dispatch 2024-02-05T07:25:18.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:18 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-55"}]: dispatch 2024-02-05T07:25:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:18 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:18.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:18 smithi184 ceph-mon[29861]: osdmap e373: 8 total, 8 up, 8 in 2024-02-05T07:25:18.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:25:18.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:18.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:18 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:18.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-55"}]: dispatch 2024-02-05T07:25:18.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:18 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-55"}]: dispatch 2024-02-05T07:25:18.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:18 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:18.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:18 smithi184 ceph-mon[41609]: osdmap e373: 8 total, 8 up, 8 in 2024-02-05T07:25:18.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:25:18.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:18.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:18 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:18.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-55"}]: dispatch 2024-02-05T07:25:18.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:18 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-55"}]: dispatch 2024-02-05T07:25:19.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:19.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:19 smithi188 ceph-mon[33283]: pgmap v526: 324 pgs: 324 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-02-05T07:25:19.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:19 smithi188 ceph-mon[33283]: osdmap e374: 8 total, 8 up, 8 in 2024-02-05T07:25:19.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:19.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:19 smithi184 ceph-mon[29861]: pgmap v526: 324 pgs: 324 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-02-05T07:25:19.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:19 smithi184 ceph-mon[29861]: osdmap e374: 8 total, 8 up, 8 in 2024-02-05T07:25:19.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:19.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:19 smithi184 ceph-mon[41609]: pgmap v526: 324 pgs: 324 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-02-05T07:25:19.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:19 smithi184 ceph-mon[41609]: osdmap e374: 8 total, 8 up, 8 in 2024-02-05T07:25:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:20 smithi188 ceph-mon[33283]: osdmap e375: 8 total, 8 up, 8 in 2024-02-05T07:25:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:20 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:20 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:25:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:20 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:20 smithi188 ceph-mon[33283]: osdmap e376: 8 total, 8 up, 8 in 2024-02-05T07:25:20.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:20 smithi184 ceph-mon[29861]: osdmap e375: 8 total, 8 up, 8 in 2024-02-05T07:25:20.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:20.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:20 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:20.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:20 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:25:20.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:20 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:20.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:20 smithi184 ceph-mon[29861]: osdmap e376: 8 total, 8 up, 8 in 2024-02-05T07:25:20.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:20 smithi184 ceph-mon[41609]: osdmap e375: 8 total, 8 up, 8 in 2024-02-05T07:25:20.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:20.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:20 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:20.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:20 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:25:20.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:20 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:20.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:20 smithi184 ceph-mon[41609]: osdmap e376: 8 total, 8 up, 8 in 2024-02-05T07:25:21.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:21 smithi188 ceph-mon[33283]: pgmap v529: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-05T07:25:21.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:21.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:21 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:21.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-57"}]: dispatch 2024-02-05T07:25:21.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:21 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-57"}]: dispatch 2024-02-05T07:25:21.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:21 smithi184 ceph-mon[29861]: pgmap v529: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-05T07:25:21.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:21.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:21 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:21.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-57"}]: dispatch 2024-02-05T07:25:21.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:21 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-57"}]: dispatch 2024-02-05T07:25:21.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:21 smithi184 ceph-mon[41609]: pgmap v529: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-05T07:25:21.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:21.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:21 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:21.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-57"}]: dispatch 2024-02-05T07:25:21.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:21 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-57"}]: dispatch 2024-02-05T07:25:22.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:25:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:25:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:25:22.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:22 smithi188 ceph-mon[33283]: osdmap e377: 8 total, 8 up, 8 in 2024-02-05T07:25:22.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:22 smithi184 ceph-mon[29861]: osdmap e377: 8 total, 8 up, 8 in 2024-02-05T07:25:22.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:22 smithi184 ceph-mon[41609]: osdmap e377: 8 total, 8 up, 8 in 2024-02-05T07:25:23.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:23 smithi188 ceph-mon[33283]: pgmap v532: 292 pgs: 292 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:25:23.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:23 smithi188 ceph-mon[33283]: osdmap e378: 8 total, 8 up, 8 in 2024-02-05T07:25:23.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:23.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:23 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:23.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:23 smithi184 ceph-mon[29861]: pgmap v532: 292 pgs: 292 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:25:23.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:23 smithi184 ceph-mon[29861]: osdmap e378: 8 total, 8 up, 8 in 2024-02-05T07:25:23.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:23.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:23 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:23.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:23 smithi184 ceph-mon[41609]: pgmap v532: 292 pgs: 292 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:25:23.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:23 smithi184 ceph-mon[41609]: osdmap e378: 8 total, 8 up, 8 in 2024-02-05T07:25:23.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:23.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:23 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:24 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:24 smithi188 ceph-mon[33283]: osdmap e379: 8 total, 8 up, 8 in 2024-02-05T07:25:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:25:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:24 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-59"}]: dispatch 2024-02-05T07:25:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:24 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-59"}]: dispatch 2024-02-05T07:25:24.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:24 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:24 smithi184 ceph-mon[41609]: osdmap e379: 8 total, 8 up, 8 in 2024-02-05T07:25:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:25:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:24 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-59"}]: dispatch 2024-02-05T07:25:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:24 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-59"}]: dispatch 2024-02-05T07:25:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:24 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:24 smithi184 ceph-mon[29861]: osdmap e379: 8 total, 8 up, 8 in 2024-02-05T07:25:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:25:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:24.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:24 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:24.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-59"}]: dispatch 2024-02-05T07:25:24.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:24 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-59"}]: dispatch 2024-02-05T07:25:25.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:25 smithi188 ceph-mon[33283]: pgmap v535: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-05T07:25:25.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:25 smithi188 ceph-mon[33283]: osdmap e380: 8 total, 8 up, 8 in 2024-02-05T07:25:25.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:25 smithi184 ceph-mon[29861]: pgmap v535: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-05T07:25:25.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:25 smithi184 ceph-mon[29861]: osdmap e380: 8 total, 8 up, 8 in 2024-02-05T07:25:25.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:25 smithi184 ceph-mon[41609]: pgmap v535: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-05T07:25:25.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:25 smithi184 ceph-mon[41609]: osdmap e380: 8 total, 8 up, 8 in 2024-02-05T07:25:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:26 smithi188 ceph-mon[33283]: osdmap e381: 8 total, 8 up, 8 in 2024-02-05T07:25:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:26 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:26.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:26 smithi184 ceph-mon[29861]: osdmap e381: 8 total, 8 up, 8 in 2024-02-05T07:25:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:26.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:26 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:26.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:26 smithi184 ceph-mon[41609]: osdmap e381: 8 total, 8 up, 8 in 2024-02-05T07:25:26.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:26.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:26 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:27.650 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:27 smithi188 ceph-mon[33283]: pgmap v538: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-05T07:25:27.651 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:27 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:25:27.651 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:27 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:27.651 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:27 smithi188 ceph-mon[33283]: osdmap e382: 8 total, 8 up, 8 in 2024-02-05T07:25:27.651 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:25:27.651 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:25:27.651 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:27 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:25:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:27 smithi184 ceph-mon[29861]: pgmap v538: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-05T07:25:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:27 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:25:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:27 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:27 smithi184 ceph-mon[29861]: osdmap e382: 8 total, 8 up, 8 in 2024-02-05T07:25:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:25:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:25:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:27 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:25:27.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:27 smithi184 ceph-mon[41609]: pgmap v538: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 1 op/s 2024-02-05T07:25:27.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:27 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:25:27.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:27 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:27.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:27 smithi184 ceph-mon[41609]: osdmap e382: 8 total, 8 up, 8 in 2024-02-05T07:25:27.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:25:27.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:25:27.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:27 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:25:27.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:25:27 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:25:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:28 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:25:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:28 smithi188 ceph-mon[33283]: osdmap e383: 8 total, 8 up, 8 in 2024-02-05T07:25:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:28 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-61"}]: dispatch 2024-02-05T07:25:28.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:28 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-61"}]: dispatch 2024-02-05T07:25:28.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:28 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:25:28.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:28 smithi184 ceph-mon[29861]: osdmap e383: 8 total, 8 up, 8 in 2024-02-05T07:25:28.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:28.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:28 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:28.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-61"}]: dispatch 2024-02-05T07:25:28.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:28 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-61"}]: dispatch 2024-02-05T07:25:28.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:28 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:25:28.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:28 smithi184 ceph-mon[41609]: osdmap e383: 8 total, 8 up, 8 in 2024-02-05T07:25:28.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:28.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:28 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:25:28.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-61"}]: dispatch 2024-02-05T07:25:28.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:28 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-61"}]: dispatch 2024-02-05T07:25:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:29 smithi188 ceph-mon[33283]: pgmap v541: 324 pgs: 324 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-05T07:25:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:29 smithi188 ceph-mon[33283]: osdmap e384: 8 total, 8 up, 8 in 2024-02-05T07:25:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:25:29.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:29.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:29 smithi184 ceph-mon[29861]: pgmap v541: 324 pgs: 324 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-05T07:25:29.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:29 smithi184 ceph-mon[29861]: osdmap e384: 8 total, 8 up, 8 in 2024-02-05T07:25:29.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:25:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:29 smithi184 ceph-mon[41609]: pgmap v541: 324 pgs: 324 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-05T07:25:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:29 smithi184 ceph-mon[41609]: osdmap e384: 8 total, 8 up, 8 in 2024-02-05T07:25:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:25:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:30 smithi188 ceph-mon[33283]: osdmap e385: 8 total, 8 up, 8 in 2024-02-05T07:25:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:30 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:30.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:30 smithi184 ceph-mon[29861]: osdmap e385: 8 total, 8 up, 8 in 2024-02-05T07:25:30.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:30.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:30 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:30.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:30 smithi184 ceph-mon[41609]: osdmap e385: 8 total, 8 up, 8 in 2024-02-05T07:25:30.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:30.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:30 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:25:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:31 smithi188 ceph-mon[33283]: pgmap v544: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:25:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:31 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:31 smithi188 ceph-mon[33283]: osdmap e386: 8 total, 8 up, 8 in 2024-02-05T07:25:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:25:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:25:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:31 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:25:31.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:31 smithi184 ceph-mon[29861]: pgmap v544: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:25:31.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:31 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:31.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:31 smithi184 ceph-mon[29861]: osdmap e386: 8 total, 8 up, 8 in 2024-02-05T07:25:31.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:25:31.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:25:31.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:31 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:25:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:31 smithi184 ceph-mon[41609]: pgmap v544: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:25:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:31 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:25:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:31 smithi184 ceph-mon[41609]: osdmap e386: 8 total, 8 up, 8 in 2024-02-05T07:25:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:25:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:25:31.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:31 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:25:32.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:25:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:25:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:25:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:32 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:25:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:32 smithi188 ceph-mon[33283]: osdmap e387: 8 total, 8 up, 8 in 2024-02-05T07:25:32.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:32 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:25:32.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:32 smithi184 ceph-mon[29861]: osdmap e387: 8 total, 8 up, 8 in 2024-02-05T07:25:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:32 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:25:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:32 smithi184 ceph-mon[41609]: osdmap e387: 8 total, 8 up, 8 in 2024-02-05T07:25:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:33 smithi188 ceph-mon[33283]: pgmap v547: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:25:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:33 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:25:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:33 smithi188 ceph-mon[33283]: osdmap e388: 8 total, 8 up, 8 in 2024-02-05T07:25:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:33 smithi184 ceph-mon[29861]: pgmap v547: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:25:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:33 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:25:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:33 smithi184 ceph-mon[29861]: osdmap e388: 8 total, 8 up, 8 in 2024-02-05T07:25:33.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:33 smithi184 ceph-mon[41609]: pgmap v547: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:25:33.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:33 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:25:33.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:33 smithi184 ceph-mon[41609]: osdmap e388: 8 total, 8 up, 8 in 2024-02-05T07:25:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:34 smithi188 ceph-mon[33283]: osdmap e389: 8 total, 8 up, 8 in 2024-02-05T07:25:34.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:34 smithi184 ceph-mon[29861]: osdmap e389: 8 total, 8 up, 8 in 2024-02-05T07:25:34.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:34 smithi184 ceph-mon[41609]: osdmap e389: 8 total, 8 up, 8 in 2024-02-05T07:25:35.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:35 smithi188 ceph-mon[33283]: pgmap v550: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-05T07:25:35.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:35 smithi188 ceph-mon[33283]: osdmap e390: 8 total, 8 up, 8 in 2024-02-05T07:25:35.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:35 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:25:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:35 smithi184 ceph-mon[29861]: pgmap v550: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-05T07:25:35.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:35 smithi184 ceph-mon[29861]: osdmap e390: 8 total, 8 up, 8 in 2024-02-05T07:25:35.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:35 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:25:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:35 smithi184 ceph-mon[41609]: pgmap v550: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-05T07:25:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:35 smithi184 ceph-mon[41609]: osdmap e390: 8 total, 8 up, 8 in 2024-02-05T07:25:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:35 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:25:36.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:36 smithi188 ceph-mon[33283]: osdmap e391: 8 total, 8 up, 8 in 2024-02-05T07:25:36.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:36 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:25:36.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:36 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:25:36.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:36 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:25:36.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:36 smithi184 ceph-mon[29861]: osdmap e391: 8 total, 8 up, 8 in 2024-02-05T07:25:36.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:36 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:25:36.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:36 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:25:36.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:36 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:25:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:36 smithi184 ceph-mon[41609]: osdmap e391: 8 total, 8 up, 8 in 2024-02-05T07:25:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:36 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:25:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:36 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:25:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:36 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:25:37.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:37 smithi188 ceph-mon[33283]: pgmap v553: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-05T07:25:37.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:37 smithi184 ceph-mon[29861]: pgmap v553: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-05T07:25:37.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:37 smithi184 ceph-mon[41609]: pgmap v553: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-05T07:25:38.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:25:37 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:25:39.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:39.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:39 smithi188 ceph-mon[33283]: pgmap v554: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-02-05T07:25:39.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:39.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:39 smithi184 ceph-mon[41609]: pgmap v554: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-02-05T07:25:39.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:39.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:39 smithi184 ceph-mon[29861]: pgmap v554: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 2.9 KiB/s rd, 1.9 KiB/s wr, 6 op/s 2024-02-05T07:25:41.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:40 smithi188 ceph-mon[33283]: osdmap e392: 8 total, 8 up, 8 in 2024-02-05T07:25:41.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:40 smithi188 ceph-mon[33283]: pgmap v556: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2024-02-05T07:25:41.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:40 smithi184 ceph-mon[29861]: osdmap e392: 8 total, 8 up, 8 in 2024-02-05T07:25:41.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:40 smithi184 ceph-mon[29861]: pgmap v556: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2024-02-05T07:25:41.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:40 smithi184 ceph-mon[41609]: osdmap e392: 8 total, 8 up, 8 in 2024-02-05T07:25:41.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:40 smithi184 ceph-mon[41609]: pgmap v556: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 682 B/s wr, 2 op/s 2024-02-05T07:25:42.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:25:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:25:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:25:43.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:43 smithi188 ceph-mon[33283]: pgmap v557: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 526 B/s wr, 2 op/s 2024-02-05T07:25:43.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:43 smithi184 ceph-mon[29861]: pgmap v557: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 526 B/s wr, 2 op/s 2024-02-05T07:25:43.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:43 smithi184 ceph-mon[41609]: pgmap v557: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 526 B/s wr, 2 op/s 2024-02-05T07:25:44.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:25:44.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:25:44.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:25:45.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:45 smithi184 ceph-mon[29861]: pgmap v558: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 466 B/s wr, 2 op/s 2024-02-05T07:25:45.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:45 smithi184 ceph-mon[41609]: pgmap v558: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 466 B/s wr, 2 op/s 2024-02-05T07:25:45.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:45 smithi188 ceph-mon[33283]: pgmap v558: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 466 B/s wr, 2 op/s 2024-02-05T07:25:47.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:47 smithi184 ceph-mon[29861]: pgmap v559: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 409 B/s wr, 2 op/s 2024-02-05T07:25:47.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:47 smithi184 ceph-mon[29861]: osdmap e393: 8 total, 8 up, 8 in 2024-02-05T07:25:47.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:47 smithi184 ceph-mon[41609]: pgmap v559: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 409 B/s wr, 2 op/s 2024-02-05T07:25:47.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:47 smithi184 ceph-mon[41609]: osdmap e393: 8 total, 8 up, 8 in 2024-02-05T07:25:47.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:47 smithi188 ceph-mon[33283]: pgmap v559: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 409 B/s wr, 2 op/s 2024-02-05T07:25:47.752 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:47 smithi188 ceph-mon[33283]: osdmap e393: 8 total, 8 up, 8 in 2024-02-05T07:25:48.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:25:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:25:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:49.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:49 smithi184 ceph-mon[29861]: pgmap v561: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:49.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:49.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:49 smithi184 ceph-mon[41609]: pgmap v561: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:49 smithi188 ceph-mon[33283]: pgmap v561: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:50 smithi188 ceph-mon[33283]: osdmap e394: 8 total, 8 up, 8 in 2024-02-05T07:25:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:50 smithi188 ceph-mon[33283]: pgmap v563: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:50 smithi184 ceph-mon[29861]: osdmap e394: 8 total, 8 up, 8 in 2024-02-05T07:25:51.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:50 smithi184 ceph-mon[29861]: pgmap v563: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:50 smithi184 ceph-mon[41609]: osdmap e394: 8 total, 8 up, 8 in 2024-02-05T07:25:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:50 smithi184 ceph-mon[41609]: pgmap v563: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:52.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:25:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:25:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:25:53.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:53 smithi184 ceph-mon[29861]: pgmap v564: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:53.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:53 smithi184 ceph-mon[41609]: pgmap v564: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:53.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:53 smithi188 ceph-mon[33283]: pgmap v564: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:55.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:55 smithi184 ceph-mon[29861]: pgmap v565: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:55.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:55 smithi184 ceph-mon[41609]: pgmap v565: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:55.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:55 smithi188 ceph-mon[33283]: pgmap v565: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:57.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:57 smithi184 ceph-mon[29861]: pgmap v566: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:57.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:57 smithi184 ceph-mon[41609]: pgmap v566: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:57.551 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:57 smithi188 ceph-mon[33283]: pgmap v566: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:25:57.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:25:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:25:58.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:58 smithi184 ceph-mon[29861]: osdmap e395: 8 total, 8 up, 8 in 2024-02-05T07:25:58.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:58 smithi184 ceph-mon[41609]: osdmap e395: 8 total, 8 up, 8 in 2024-02-05T07:25:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:58 smithi188 ceph-mon[33283]: osdmap e395: 8 total, 8 up, 8 in 2024-02-05T07:25:59.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:59.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:59 smithi188 ceph-mon[33283]: pgmap v568: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-05T07:25:59.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:25:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:25:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:59.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:59 smithi184 ceph-mon[29861]: pgmap v568: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-05T07:25:59.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:25:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:25:59.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:25:59.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:59 smithi184 ceph-mon[41609]: pgmap v568: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-05T07:25:59.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:25:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:26:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:00 smithi188 ceph-mon[33283]: pgmap v569: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-05T07:26:01.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:00 smithi184 ceph-mon[29861]: pgmap v569: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-05T07:26:01.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:00 smithi184 ceph-mon[41609]: pgmap v569: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-05T07:26:02.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:26:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:26:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:26:03.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:03 smithi184 ceph-mon[29861]: pgmap v570: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-05T07:26:03.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:03 smithi184 ceph-mon[41609]: pgmap v570: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-05T07:26:03.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:03 smithi188 ceph-mon[33283]: pgmap v570: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-05T07:26:05.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:05 smithi184 ceph-mon[29861]: pgmap v571: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-05T07:26:05.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:05 smithi184 ceph-mon[29861]: osdmap e396: 8 total, 8 up, 8 in 2024-02-05T07:26:05.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:05 smithi184 ceph-mon[41609]: pgmap v571: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-05T07:26:05.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:05 smithi184 ceph-mon[41609]: osdmap e396: 8 total, 8 up, 8 in 2024-02-05T07:26:05.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:05 smithi188 ceph-mon[33283]: pgmap v571: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-05T07:26:05.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:05 smithi188 ceph-mon[33283]: osdmap e396: 8 total, 8 up, 8 in 2024-02-05T07:26:07.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:07 smithi184 ceph-mon[29861]: pgmap v573: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:26:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:07 smithi184 ceph-mon[41609]: pgmap v573: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:26:07.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:07 smithi188 ceph-mon[33283]: pgmap v573: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:26:08.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:26:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:26:08.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:08.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:08 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:08.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-63"}]: dispatch 2024-02-05T07:26:08.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:08 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-63"}]: dispatch 2024-02-05T07:26:08.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:08.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:08 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:08.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-63"}]: dispatch 2024-02-05T07:26:08.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:08 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-63"}]: dispatch 2024-02-05T07:26:08.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:08.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:08 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:08.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-63"}]: dispatch 2024-02-05T07:26:08.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:08 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-63"}]: dispatch 2024-02-05T07:26:09.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:09.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:09 smithi184 ceph-mon[29861]: pgmap v574: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:26:09.673 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:09 smithi184 ceph-mon[29861]: osdmap e397: 8 total, 8 up, 8 in 2024-02-05T07:26:09.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:09.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:09 smithi184 ceph-mon[41609]: pgmap v574: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:26:09.673 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:09 smithi184 ceph-mon[41609]: osdmap e397: 8 total, 8 up, 8 in 2024-02-05T07:26:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:09 smithi188 ceph-mon[33283]: pgmap v574: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:26:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:09 smithi188 ceph-mon[33283]: osdmap e397: 8 total, 8 up, 8 in 2024-02-05T07:26:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:10 smithi188 ceph-mon[33283]: osdmap e398: 8 total, 8 up, 8 in 2024-02-05T07:26:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:10.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:10 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:10.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:10 smithi184 ceph-mon[29861]: osdmap e398: 8 total, 8 up, 8 in 2024-02-05T07:26:10.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:10.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:10 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:10 smithi184 ceph-mon[41609]: osdmap e398: 8 total, 8 up, 8 in 2024-02-05T07:26:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:10.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:10 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:11 smithi188 ceph-mon[33283]: pgmap v577: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:11 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:26:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:11 smithi188 ceph-mon[33283]: osdmap e399: 8 total, 8 up, 8 in 2024-02-05T07:26:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:26:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:26:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:11 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:26:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:11 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:26:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:11 smithi184 ceph-mon[29861]: pgmap v577: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:11 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:26:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:11 smithi184 ceph-mon[29861]: osdmap e399: 8 total, 8 up, 8 in 2024-02-05T07:26:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:26:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:26:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:11 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:26:11.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:11 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:26:11.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:11 smithi184 ceph-mon[41609]: pgmap v577: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:11 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:26:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:11 smithi184 ceph-mon[41609]: osdmap e399: 8 total, 8 up, 8 in 2024-02-05T07:26:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:26:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:26:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:11 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:26:11.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:11 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:26:12.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:26:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:26:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:26:12.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:12 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:26:12.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:12 smithi188 ceph-mon[33283]: osdmap e400: 8 total, 8 up, 8 in 2024-02-05T07:26:12.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:12 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:26:12.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:12 smithi184 ceph-mon[29861]: osdmap e400: 8 total, 8 up, 8 in 2024-02-05T07:26:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:12 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:26:12.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:12 smithi184 ceph-mon[41609]: osdmap e400: 8 total, 8 up, 8 in 2024-02-05T07:26:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:13 smithi188 ceph-mon[33283]: pgmap v580: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:13 smithi188 ceph-mon[33283]: osdmap e401: 8 total, 8 up, 8 in 2024-02-05T07:26:13.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:13 smithi184 ceph-mon[29861]: pgmap v580: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:13.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:13 smithi184 ceph-mon[29861]: osdmap e401: 8 total, 8 up, 8 in 2024-02-05T07:26:13.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:13 smithi184 ceph-mon[41609]: pgmap v580: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:13.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:13 smithi184 ceph-mon[41609]: osdmap e401: 8 total, 8 up, 8 in 2024-02-05T07:26:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:14 smithi188 ceph-mon[33283]: osdmap e402: 8 total, 8 up, 8 in 2024-02-05T07:26:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:14 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:26:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:14 smithi184 ceph-mon[29861]: osdmap e402: 8 total, 8 up, 8 in 2024-02-05T07:26:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:14 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:26:14.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:14 smithi184 ceph-mon[41609]: osdmap e402: 8 total, 8 up, 8 in 2024-02-05T07:26:14.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:14 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:26:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:15 smithi188 ceph-mon[33283]: pgmap v583: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-02-05T07:26:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:15 smithi188 ceph-mon[33283]: osdmap e403: 8 total, 8 up, 8 in 2024-02-05T07:26:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:15 smithi184 ceph-mon[29861]: pgmap v583: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-02-05T07:26:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:15 smithi184 ceph-mon[29861]: osdmap e403: 8 total, 8 up, 8 in 2024-02-05T07:26:15.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:15 smithi184 ceph-mon[41609]: pgmap v583: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-02-05T07:26:15.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:15 smithi184 ceph-mon[41609]: osdmap e403: 8 total, 8 up, 8 in 2024-02-05T07:26:17.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:17 smithi188 ceph-mon[33283]: pgmap v585: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-02-05T07:26:17.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:17 smithi184 ceph-mon[29861]: pgmap v585: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-02-05T07:26:17.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:17 smithi184 ceph-mon[41609]: pgmap v585: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.6 KiB/s wr, 4 op/s 2024-02-05T07:26:18.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:26:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:26:19.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:19.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:19 smithi188 ceph-mon[33283]: pgmap v586: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-02-05T07:26:19.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:19.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:19 smithi184 ceph-mon[29861]: pgmap v586: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-02-05T07:26:19.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:19.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:19 smithi184 ceph-mon[41609]: pgmap v586: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 3.3 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-02-05T07:26:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:20 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:26:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:20 smithi188 ceph-mon[33283]: osdmap e404: 8 total, 8 up, 8 in 2024-02-05T07:26:20.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:20 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:26:20.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:20 smithi184 ceph-mon[29861]: osdmap e404: 8 total, 8 up, 8 in 2024-02-05T07:26:20.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:20 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:26:20.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:20 smithi184 ceph-mon[41609]: osdmap e404: 8 total, 8 up, 8 in 2024-02-05T07:26:21.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:21 smithi188 ceph-mon[33283]: pgmap v588: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 297 B/s wr, 3 op/s 2024-02-05T07:26:21.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:21 smithi184 ceph-mon[29861]: pgmap v588: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 297 B/s wr, 3 op/s 2024-02-05T07:26:21.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:21 smithi184 ceph-mon[41609]: pgmap v588: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 297 B/s wr, 3 op/s 2024-02-05T07:26:22.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:26:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:26:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:26:23.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:23 smithi188 ceph-mon[33283]: pgmap v589: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:26:23.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:23 smithi184 ceph-mon[29861]: pgmap v589: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:26:23.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:23 smithi184 ceph-mon[41609]: pgmap v589: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:26:25.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:25 smithi188 ceph-mon[33283]: pgmap v590: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 207 B/s wr, 2 op/s 2024-02-05T07:26:25.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:25.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:25 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:25.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-65"}]: dispatch 2024-02-05T07:26:25.750 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:25 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-65"}]: dispatch 2024-02-05T07:26:25.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:25 smithi184 ceph-mon[29861]: pgmap v590: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 207 B/s wr, 2 op/s 2024-02-05T07:26:25.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:25.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:25 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:25.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-65"}]: dispatch 2024-02-05T07:26:25.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:25 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-65"}]: dispatch 2024-02-05T07:26:25.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:25 smithi184 ceph-mon[41609]: pgmap v590: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 207 B/s wr, 2 op/s 2024-02-05T07:26:25.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:25.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:25 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:25.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-65"}]: dispatch 2024-02-05T07:26:25.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:25 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-65"}]: dispatch 2024-02-05T07:26:26.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:26 smithi188 ceph-mon[33283]: osdmap e405: 8 total, 8 up, 8 in 2024-02-05T07:26:26.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:26 smithi184 ceph-mon[29861]: osdmap e405: 8 total, 8 up, 8 in 2024-02-05T07:26:26.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:26 smithi184 ceph-mon[41609]: osdmap e405: 8 total, 8 up, 8 in 2024-02-05T07:26:27.650 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:27 smithi188 ceph-mon[33283]: pgmap v592: 292 pgs: 292 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:27.651 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:27 smithi188 ceph-mon[33283]: osdmap e406: 8 total, 8 up, 8 in 2024-02-05T07:26:27.651 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:27.651 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:27 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:27.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:27 smithi184 ceph-mon[29861]: pgmap v592: 292 pgs: 292 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:27 smithi184 ceph-mon[29861]: osdmap e406: 8 total, 8 up, 8 in 2024-02-05T07:26:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:27.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:27 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:27.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:27 smithi184 ceph-mon[41609]: pgmap v592: 292 pgs: 292 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:27.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:27 smithi184 ceph-mon[41609]: osdmap e406: 8 total, 8 up, 8 in 2024-02-05T07:26:27.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:27.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:27 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:27.999 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:26:27 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:26:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:28 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:26:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:28 smithi188 ceph-mon[33283]: osdmap e407: 8 total, 8 up, 8 in 2024-02-05T07:26:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:26:28.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:28 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:26:28.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:28 smithi184 ceph-mon[29861]: osdmap e407: 8 total, 8 up, 8 in 2024-02-05T07:26:28.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:26:28.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:28 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:26:28.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:28 smithi184 ceph-mon[41609]: osdmap e407: 8 total, 8 up, 8 in 2024-02-05T07:26:28.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:26:29.096 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c39460 2024-02-05T07:26:29.096 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c39590 2024-02-05T07:26:29.096 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c396c0 2024-02-05T07:26:29.096 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c397f0 2024-02-05T07:26:29.096 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c39ed0 2024-02-05T07:26:29.096 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c39a30 2024-02-05T07:26:29.097 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c39b60 2024-02-05T07:26:29.097 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c39c90 2024-02-05T07:26:29.097 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c39dc0 2024-02-05T07:26:29.097 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3a4a0 2024-02-05T07:26:29.097 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3a000 2024-02-05T07:26:29.097 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3a130 2024-02-05T07:26:29.097 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3a280 2024-02-05T07:26:29.097 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3a5d0 2024-02-05T07:26:29.097 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3aa60 2024-02-05T07:26:29.097 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3ab90 2024-02-05T07:26:29.097 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c38e60 2024-02-05T07:26:29.097 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c38f90 2024-02-05T07:26:29.097 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3b160 2024-02-05T07:26:29.097 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3acc0 2024-02-05T07:26:29.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3adf0 2024-02-05T07:26:29.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3af20 2024-02-05T07:26:29.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3b050 2024-02-05T07:26:29.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3b750 2024-02-05T07:26:29.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3b2b0 2024-02-05T07:26:29.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3b3e0 2024-02-05T07:26:29.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3b530 2024-02-05T07:26:29.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3b880 2024-02-05T07:26:29.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3bd10 2024-02-05T07:26:29.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3be40 2024-02-05T07:26:29.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3b640 2024-02-05T07:26:29.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3bf70 2024-02-05T07:26:29.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3c0c0 2024-02-05T07:26:29.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3c6b0 2024-02-05T07:26:29.098 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3a700 2024-02-05T07:26:29.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3a830 2024-02-05T07:26:29.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3c210 2024-02-05T07:26:29.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3c340 2024-02-05T07:26:29.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3c470 2024-02-05T07:26:29.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3c5a0 2024-02-05T07:26:29.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3cc80 2024-02-05T07:26:29.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3c7e0 2024-02-05T07:26:29.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3c930 2024-02-05T07:26:29.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3ca60 2024-02-05T07:26:29.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3cdb0 2024-02-05T07:26:29.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3d240 2024-02-05T07:26:29.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3d370 2024-02-05T07:26:29.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3b9b0 2024-02-05T07:26:29.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3bae0 2024-02-05T07:26:29.099 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3d940 2024-02-05T07:26:29.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3d4a0 2024-02-05T07:26:29.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3d5d0 2024-02-05T07:26:29.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3d700 2024-02-05T07:26:29.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3d830 2024-02-05T07:26:29.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3df10 2024-02-05T07:26:29.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3da70 2024-02-05T07:26:29.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3dba0 2024-02-05T07:26:29.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3dcd0 2024-02-05T07:26:29.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3de00 2024-02-05T07:26:29.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3e4e0 2024-02-05T07:26:29.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3e040 2024-02-05T07:26:29.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3e190 2024-02-05T07:26:29.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3e2c0 2024-02-05T07:26:29.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3e610 2024-02-05T07:26:29.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3eaa0 2024-02-05T07:26:29.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3ebd0 2024-02-05T07:26:29.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3e3d0 2024-02-05T07:26:29.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3ed00 2024-02-05T07:26:29.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3cee0 2024-02-05T07:26:29.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3cb70 2024-02-05T07:26:29.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3cff0 2024-02-05T07:26:29.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3d120 2024-02-05T07:26:29.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3ee30 2024-02-05T07:26:29.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3ef60 2024-02-05T07:26:29.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3f550 2024-02-05T07:26:29.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3f0b0 2024-02-05T07:26:29.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3f1e0 2024-02-05T07:26:29.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3f310 2024-02-05T07:26:29.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3f440 2024-02-05T07:26:29.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3fb00 2024-02-05T07:26:29.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3f660 2024-02-05T07:26:29.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3f7b0 2024-02-05T07:26:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:29 smithi188 ceph-mon[33283]: pgmap v595: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:29 smithi188 ceph-mon[33283]: osdmap e408: 8 total, 8 up, 8 in 2024-02-05T07:26:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-67"}]: dispatch 2024-02-05T07:26:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-67"}]: dispatch 2024-02-05T07:26:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:26:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[41609]: pgmap v595: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[41609]: osdmap e408: 8 total, 8 up, 8 in 2024-02-05T07:26:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-67"}]: dispatch 2024-02-05T07:26:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-67"}]: dispatch 2024-02-05T07:26:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:26:29.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:29.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[29861]: pgmap v595: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:29.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[29861]: osdmap e408: 8 total, 8 up, 8 in 2024-02-05T07:26:29.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:29.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:29.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-67"}]: dispatch 2024-02-05T07:26:29.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-67"}]: dispatch 2024-02-05T07:26:29.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:26:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:30 smithi188 ceph-mon[33283]: osdmap e409: 8 total, 8 up, 8 in 2024-02-05T07:26:30.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:30 smithi184 ceph-mon[29861]: osdmap e409: 8 total, 8 up, 8 in 2024-02-05T07:26:30.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:30 smithi184 ceph-mon[41609]: osdmap e409: 8 total, 8 up, 8 in 2024-02-05T07:26:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:31 smithi188 ceph-mon[33283]: pgmap v598: 292 pgs: 292 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:26:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:31 smithi188 ceph-mon[33283]: osdmap e410: 8 total, 8 up, 8 in 2024-02-05T07:26:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:31 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:31 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:26:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:31 smithi188 ceph-mon[33283]: osdmap e411: 8 total, 8 up, 8 in 2024-02-05T07:26:31.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:31 smithi184 ceph-mon[29861]: pgmap v598: 292 pgs: 292 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:26:31.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:31 smithi184 ceph-mon[29861]: osdmap e410: 8 total, 8 up, 8 in 2024-02-05T07:26:31.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:31.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:31 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:31.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:31 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:26:31.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:31 smithi184 ceph-mon[29861]: osdmap e411: 8 total, 8 up, 8 in 2024-02-05T07:26:31.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:31 smithi184 ceph-mon[41609]: pgmap v598: 292 pgs: 292 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:26:31.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:31 smithi184 ceph-mon[41609]: osdmap e410: 8 total, 8 up, 8 in 2024-02-05T07:26:31.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:31.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:31 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:31.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:31 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:26:31.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:31 smithi184 ceph-mon[41609]: osdmap e411: 8 total, 8 up, 8 in 2024-02-05T07:26:32.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:26:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:26:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:26:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:26:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:32 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-69"}]: dispatch 2024-02-05T07:26:32.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:32 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-69"}]: dispatch 2024-02-05T07:26:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:26:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:32 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-69"}]: dispatch 2024-02-05T07:26:32.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:32 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-69"}]: dispatch 2024-02-05T07:26:32.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:26:32.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:32.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:32 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:32.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-69"}]: dispatch 2024-02-05T07:26:32.773 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:32 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-69"}]: dispatch 2024-02-05T07:26:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:33 smithi188 ceph-mon[33283]: pgmap v601: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:33 smithi188 ceph-mon[33283]: osdmap e412: 8 total, 8 up, 8 in 2024-02-05T07:26:33.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:33 smithi184 ceph-mon[29861]: pgmap v601: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:33.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:33 smithi184 ceph-mon[29861]: osdmap e412: 8 total, 8 up, 8 in 2024-02-05T07:26:33.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:33 smithi184 ceph-mon[41609]: pgmap v601: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:33.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:33 smithi184 ceph-mon[41609]: osdmap e412: 8 total, 8 up, 8 in 2024-02-05T07:26:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:34 smithi188 ceph-mon[33283]: osdmap e413: 8 total, 8 up, 8 in 2024-02-05T07:26:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:34 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:34.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:34 smithi184 ceph-mon[41609]: osdmap e413: 8 total, 8 up, 8 in 2024-02-05T07:26:34.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:34.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:34 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:34.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:34 smithi184 ceph-mon[29861]: osdmap e413: 8 total, 8 up, 8 in 2024-02-05T07:26:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:34 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:35.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:35 smithi188 ceph-mon[33283]: pgmap v604: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:26:35.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:35 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:26:35.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:35 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:26:35.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:35 smithi188 ceph-mon[33283]: osdmap e414: 8 total, 8 up, 8 in 2024-02-05T07:26:35.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:26:35.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:26:35.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:35 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:26:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:35 smithi184 ceph-mon[29861]: pgmap v604: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:26:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:35 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:26:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:35 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:26:35.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:35 smithi184 ceph-mon[29861]: osdmap e414: 8 total, 8 up, 8 in 2024-02-05T07:26:35.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:26:35.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:26:35.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:35 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:26:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:35 smithi184 ceph-mon[41609]: pgmap v604: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:26:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:35 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:26:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:35 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:26:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:35 smithi184 ceph-mon[41609]: osdmap e414: 8 total, 8 up, 8 in 2024-02-05T07:26:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:26:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:26:35.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:35 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:26:36.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:36 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:26:36.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:36 smithi188 ceph-mon[33283]: osdmap e415: 8 total, 8 up, 8 in 2024-02-05T07:26:36.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:36 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:26:36.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:36 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:26:36.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:36 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:26:36.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:36 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:26:36.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:36 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:26:36.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:36 smithi184 ceph-mon[29861]: osdmap e415: 8 total, 8 up, 8 in 2024-02-05T07:26:36.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:36 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:26:36.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:36 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:26:36.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:36 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:26:36.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:36 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:26:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:36 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:26:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:36 smithi184 ceph-mon[41609]: osdmap e415: 8 total, 8 up, 8 in 2024-02-05T07:26:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:36 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:26:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:36 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:26:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:36 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:26:36.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:36 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:26:37.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:37 smithi188 ceph-mon[33283]: pgmap v607: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:26:37.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:37 smithi188 ceph-mon[33283]: osdmap e416: 8 total, 8 up, 8 in 2024-02-05T07:26:37.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:37 smithi184 ceph-mon[29861]: pgmap v607: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:26:37.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:37 smithi184 ceph-mon[29861]: osdmap e416: 8 total, 8 up, 8 in 2024-02-05T07:26:37.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:37 smithi184 ceph-mon[41609]: pgmap v607: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:26:37.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:37 smithi184 ceph-mon[41609]: osdmap e416: 8 total, 8 up, 8 in 2024-02-05T07:26:38.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:26:37 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:26:39.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:39.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:39 smithi188 ceph-mon[33283]: pgmap v609: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-02-05T07:26:39.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:39.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:39 smithi184 ceph-mon[29861]: pgmap v609: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-02-05T07:26:39.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:39.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:39 smithi184 ceph-mon[41609]: pgmap v609: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.7 KiB/s wr, 6 op/s 2024-02-05T07:26:40.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:40 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:26:40.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:40 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:26:40.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:40 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:26:41.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:41 smithi188 ceph-mon[33283]: pgmap v610: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 4 op/s 2024-02-05T07:26:41.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:41 smithi184 ceph-mon[29861]: pgmap v610: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 4 op/s 2024-02-05T07:26:41.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:41 smithi184 ceph-mon[41609]: pgmap v610: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 4 op/s 2024-02-05T07:26:42.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:26:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:26:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:26:43.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:43 smithi188 ceph-mon[33283]: pgmap v611: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 788 B/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-05T07:26:43.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:43 smithi184 ceph-mon[29861]: pgmap v611: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 788 B/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-05T07:26:43.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:43 smithi184 ceph-mon[41609]: pgmap v611: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 788 B/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-05T07:26:44.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:26:44.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:26:44.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:26:45.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:45 smithi188 ceph-mon[33283]: pgmap v612: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-05T07:26:45.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:45 smithi184 ceph-mon[29861]: pgmap v612: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-05T07:26:45.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:45 smithi184 ceph-mon[41609]: pgmap v612: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-05T07:26:47.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:47 smithi188 ceph-mon[33283]: pgmap v613: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-02-05T07:26:47.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:47 smithi184 ceph-mon[29861]: pgmap v613: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-02-05T07:26:47.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:47 smithi184 ceph-mon[41609]: pgmap v613: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-02-05T07:26:48.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:26:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:26:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:49.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:49 smithi188 ceph-mon[33283]: pgmap v614: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-02-05T07:26:49.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:49.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:49 smithi184 ceph-mon[29861]: pgmap v614: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-02-05T07:26:49.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:49.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:49 smithi184 ceph-mon[41609]: pgmap v614: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-02-05T07:26:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:50 smithi188 ceph-mon[33283]: pgmap v615: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:26:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:50 smithi184 ceph-mon[29861]: pgmap v615: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:26:51.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:50 smithi184 ceph-mon[41609]: pgmap v615: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:26:52.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:26:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:26:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:26:53.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:53 smithi188 ceph-mon[33283]: pgmap v616: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:26:53.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:53 smithi184 ceph-mon[29861]: pgmap v616: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:26:53.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:53 smithi184 ceph-mon[41609]: pgmap v616: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:26:55.755 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:55 smithi188 ceph-mon[33283]: pgmap v617: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:26:55.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:55 smithi184 ceph-mon[29861]: pgmap v617: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:26:55.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:55 smithi184 ceph-mon[41609]: pgmap v617: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:26:57.847 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:57 smithi188 ceph-mon[33283]: pgmap v618: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:26:57.847 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:57.848 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:57 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:57.848 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-71"}]: dispatch 2024-02-05T07:26:57.848 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:57 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-71"}]: dispatch 2024-02-05T07:26:58.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:57 smithi184 ceph-mon[29861]: pgmap v618: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:26:58.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:58.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:57 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:58.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-71"}]: dispatch 2024-02-05T07:26:58.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:57 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-71"}]: dispatch 2024-02-05T07:26:58.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:57 smithi184 ceph-mon[41609]: pgmap v618: 324 pgs: 324 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:26:58.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:58.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:57 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:26:58.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-71"}]: dispatch 2024-02-05T07:26:58.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:57 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-71"}]: dispatch 2024-02-05T07:26:58.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:26:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:26:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:58 smithi188 ceph-mon[33283]: osdmap e417: 8 total, 8 up, 8 in 2024-02-05T07:26:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:58 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:58 smithi188 ceph-mon[33283]: pgmap v620: 292 pgs: 292 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:58 smithi188 ceph-mon[33283]: osdmap e418: 8 total, 8 up, 8 in 2024-02-05T07:26:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:58 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:59.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:58 smithi184 ceph-mon[29861]: osdmap e417: 8 total, 8 up, 8 in 2024-02-05T07:26:59.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:58 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:59.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:58 smithi184 ceph-mon[29861]: pgmap v620: 292 pgs: 292 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:59.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:58 smithi184 ceph-mon[29861]: osdmap e418: 8 total, 8 up, 8 in 2024-02-05T07:26:59.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:59.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:58 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:59.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:58 smithi184 ceph-mon[41609]: osdmap e417: 8 total, 8 up, 8 in 2024-02-05T07:26:59.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:58 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:26:59.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:58 smithi184 ceph-mon[41609]: pgmap v620: 292 pgs: 292 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:26:59.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:58 smithi184 ceph-mon[41609]: osdmap e418: 8 total, 8 up, 8 in 2024-02-05T07:26:59.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:59.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:58 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:26:59.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:26:59.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:26:59.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:59 smithi188 ceph-mon[33283]: osdmap e419: 8 total, 8 up, 8 in 2024-02-05T07:26:59.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:26:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:00.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:27:00.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:00.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:59 smithi184 ceph-mon[29861]: osdmap e419: 8 total, 8 up, 8 in 2024-02-05T07:27:00.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:26:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:00.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:27:00.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:00.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:59 smithi184 ceph-mon[41609]: osdmap e419: 8 total, 8 up, 8 in 2024-02-05T07:27:00.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:26:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:01.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:01 smithi188 ceph-mon[33283]: pgmap v623: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:27:01.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:01 smithi188 ceph-mon[33283]: osdmap e420: 8 total, 8 up, 8 in 2024-02-05T07:27:01.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:01 smithi184 ceph-mon[29861]: pgmap v623: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:27:01.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:01 smithi184 ceph-mon[29861]: osdmap e420: 8 total, 8 up, 8 in 2024-02-05T07:27:01.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:01 smithi184 ceph-mon[41609]: pgmap v623: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:27:01.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:01 smithi184 ceph-mon[41609]: osdmap e420: 8 total, 8 up, 8 in 2024-02-05T07:27:02.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:27:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:27:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:27:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:02 smithi188 ceph-mon[33283]: osdmap e421: 8 total, 8 up, 8 in 2024-02-05T07:27:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:02 smithi184 ceph-mon[29861]: osdmap e421: 8 total, 8 up, 8 in 2024-02-05T07:27:02.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:02 smithi184 ceph-mon[41609]: osdmap e421: 8 total, 8 up, 8 in 2024-02-05T07:27:03.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:03 smithi188 ceph-mon[33283]: pgmap v626: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:27:03.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:03 smithi184 ceph-mon[29861]: pgmap v626: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:27:03.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:03 smithi184 ceph-mon[41609]: pgmap v626: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:27:05.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:05 smithi188 ceph-mon[33283]: pgmap v627: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-05T07:27:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:05 smithi184 ceph-mon[29861]: pgmap v627: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-05T07:27:05.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:05 smithi184 ceph-mon[41609]: pgmap v627: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-05T07:27:07.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:07 smithi188 ceph-mon[33283]: pgmap v628: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-02-05T07:27:07.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:07 smithi184 ceph-mon[29861]: pgmap v628: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-02-05T07:27:07.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:07 smithi184 ceph-mon[41609]: pgmap v628: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-02-05T07:27:08.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:27:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:27:09.573 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:09.573 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:09 smithi184 ceph-mon[29861]: pgmap v629: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 895 B/s wr, 3 op/s 2024-02-05T07:27:09.573 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:09.573 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:09 smithi184 ceph-mon[41609]: pgmap v629: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 895 B/s wr, 3 op/s 2024-02-05T07:27:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:09.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:09 smithi188 ceph-mon[33283]: pgmap v629: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 895 B/s wr, 3 op/s 2024-02-05T07:27:11.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:10 smithi188 ceph-mon[33283]: pgmap v630: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 721 B/s wr, 3 op/s 2024-02-05T07:27:11.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:10 smithi184 ceph-mon[29861]: pgmap v630: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 721 B/s wr, 3 op/s 2024-02-05T07:27:11.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:10 smithi184 ceph-mon[41609]: pgmap v630: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 721 B/s wr, 3 op/s 2024-02-05T07:27:12.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:12.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:11 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:12.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-73"}]: dispatch 2024-02-05T07:27:12.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:11 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-73"}]: dispatch 2024-02-05T07:27:12.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:27:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:27:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:27:12.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:12.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:11 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:12.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-73"}]: dispatch 2024-02-05T07:27:12.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:11 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-73"}]: dispatch 2024-02-05T07:27:12.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:12.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:11 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:12.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-73"}]: dispatch 2024-02-05T07:27:12.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:11 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-73"}]: dispatch 2024-02-05T07:27:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:12 smithi188 ceph-mon[33283]: osdmap e422: 8 total, 8 up, 8 in 2024-02-05T07:27:13.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:12 smithi188 ceph-mon[33283]: pgmap v632: 292 pgs: 292 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 307 B/s wr, 1 op/s 2024-02-05T07:27:13.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:12 smithi184 ceph-mon[29861]: osdmap e422: 8 total, 8 up, 8 in 2024-02-05T07:27:13.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:12 smithi184 ceph-mon[29861]: pgmap v632: 292 pgs: 292 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 307 B/s wr, 1 op/s 2024-02-05T07:27:13.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:12 smithi184 ceph-mon[41609]: osdmap e422: 8 total, 8 up, 8 in 2024-02-05T07:27:13.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:12 smithi184 ceph-mon[41609]: pgmap v632: 292 pgs: 292 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 307 B/s wr, 1 op/s 2024-02-05T07:27:14.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:13 smithi188 ceph-mon[33283]: osdmap e423: 8 total, 8 up, 8 in 2024-02-05T07:27:14.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:14.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:13 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:14.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:13 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:27:14.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:13 smithi184 ceph-mon[29861]: osdmap e423: 8 total, 8 up, 8 in 2024-02-05T07:27:14.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:14.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:13 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:14.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:13 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:27:14.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:13 smithi184 ceph-mon[41609]: osdmap e423: 8 total, 8 up, 8 in 2024-02-05T07:27:14.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:14.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:13 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:14.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:13 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:27:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:14 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:14 smithi188 ceph-mon[33283]: osdmap e424: 8 total, 8 up, 8 in 2024-02-05T07:27:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:14 smithi188 ceph-mon[33283]: pgmap v635: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:27:15.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:14 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:15.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:14 smithi184 ceph-mon[29861]: osdmap e424: 8 total, 8 up, 8 in 2024-02-05T07:27:15.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:15.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:14 smithi184 ceph-mon[29861]: pgmap v635: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:27:15.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:14 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:15.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:14 smithi184 ceph-mon[41609]: osdmap e424: 8 total, 8 up, 8 in 2024-02-05T07:27:15.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:15.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:14 smithi184 ceph-mon[41609]: pgmap v635: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:27:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:15 smithi188 ceph-mon[33283]: osdmap e425: 8 total, 8 up, 8 in 2024-02-05T07:27:16.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:15 smithi184 ceph-mon[29861]: osdmap e425: 8 total, 8 up, 8 in 2024-02-05T07:27:16.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:15 smithi184 ceph-mon[41609]: osdmap e425: 8 total, 8 up, 8 in 2024-02-05T07:27:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:16 smithi188 ceph-mon[33283]: osdmap e426: 8 total, 8 up, 8 in 2024-02-05T07:27:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:16 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-75"}]: dispatch 2024-02-05T07:27:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:16 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-75"}]: dispatch 2024-02-05T07:27:17.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:16 smithi188 ceph-mon[33283]: pgmap v638: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:27:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:16 smithi184 ceph-mon[29861]: osdmap e426: 8 total, 8 up, 8 in 2024-02-05T07:27:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:16 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-75"}]: dispatch 2024-02-05T07:27:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:16 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-75"}]: dispatch 2024-02-05T07:27:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:16 smithi184 ceph-mon[29861]: pgmap v638: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:27:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:16 smithi184 ceph-mon[41609]: osdmap e426: 8 total, 8 up, 8 in 2024-02-05T07:27:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:16 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-75"}]: dispatch 2024-02-05T07:27:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:16 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-75"}]: dispatch 2024-02-05T07:27:17.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:16 smithi184 ceph-mon[41609]: pgmap v638: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:27:18.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:17 smithi188 ceph-mon[33283]: osdmap e427: 8 total, 8 up, 8 in 2024-02-05T07:27:18.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:27:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:27:18.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:17 smithi184 ceph-mon[29861]: osdmap e427: 8 total, 8 up, 8 in 2024-02-05T07:27:18.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:17 smithi184 ceph-mon[41609]: osdmap e427: 8 total, 8 up, 8 in 2024-02-05T07:27:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:18 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:18 smithi188 ceph-mon[33283]: osdmap e428: 8 total, 8 up, 8 in 2024-02-05T07:27:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:18 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:19.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:18 smithi188 ceph-mon[33283]: pgmap v641: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-05T07:27:19.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:18 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:19.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:18 smithi184 ceph-mon[29861]: osdmap e428: 8 total, 8 up, 8 in 2024-02-05T07:27:19.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:18 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:19.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:18 smithi184 ceph-mon[29861]: pgmap v641: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-05T07:27:19.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:18 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:19.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:18 smithi184 ceph-mon[41609]: osdmap e428: 8 total, 8 up, 8 in 2024-02-05T07:27:19.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:19.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:18 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:19.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:18 smithi184 ceph-mon[41609]: pgmap v641: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-05T07:27:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:19 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:27:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:19 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:19 smithi188 ceph-mon[33283]: osdmap e429: 8 total, 8 up, 8 in 2024-02-05T07:27:20.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:20.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:19 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:27:20.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:19 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:20.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:19 smithi184 ceph-mon[29861]: osdmap e429: 8 total, 8 up, 8 in 2024-02-05T07:27:20.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:20.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:19 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:27:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:19 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:19 smithi184 ceph-mon[41609]: osdmap e429: 8 total, 8 up, 8 in 2024-02-05T07:27:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:21.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:20 smithi188 ceph-mon[33283]: osdmap e430: 8 total, 8 up, 8 in 2024-02-05T07:27:21.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:21.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:20 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:21.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-77"}]: dispatch 2024-02-05T07:27:21.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:20 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-77"}]: dispatch 2024-02-05T07:27:21.252 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:20 smithi188 ceph-mon[33283]: pgmap v644: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-05T07:27:21.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:20 smithi184 ceph-mon[29861]: osdmap e430: 8 total, 8 up, 8 in 2024-02-05T07:27:21.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:21.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:20 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:21.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-77"}]: dispatch 2024-02-05T07:27:21.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:20 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-77"}]: dispatch 2024-02-05T07:27:21.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:20 smithi184 ceph-mon[29861]: pgmap v644: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-05T07:27:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:20 smithi184 ceph-mon[41609]: osdmap e430: 8 total, 8 up, 8 in 2024-02-05T07:27:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:20 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-77"}]: dispatch 2024-02-05T07:27:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:20 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-77"}]: dispatch 2024-02-05T07:27:21.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:20 smithi184 ceph-mon[41609]: pgmap v644: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-05T07:27:22.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:21 smithi188 ceph-mon[33283]: osdmap e431: 8 total, 8 up, 8 in 2024-02-05T07:27:22.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:21 smithi184 ceph-mon[29861]: osdmap e431: 8 total, 8 up, 8 in 2024-02-05T07:27:22.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:21 smithi184 ceph-mon[41609]: osdmap e431: 8 total, 8 up, 8 in 2024-02-05T07:27:22.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:27:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:27:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:27:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:22 smithi188 ceph-mon[33283]: osdmap e432: 8 total, 8 up, 8 in 2024-02-05T07:27:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:22 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:23.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:22 smithi188 ceph-mon[33283]: pgmap v647: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:27:23.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:22 smithi184 ceph-mon[29861]: osdmap e432: 8 total, 8 up, 8 in 2024-02-05T07:27:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:22 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:23.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:22 smithi184 ceph-mon[29861]: pgmap v647: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:27:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:22 smithi184 ceph-mon[41609]: osdmap e432: 8 total, 8 up, 8 in 2024-02-05T07:27:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:22 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:23.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:22 smithi184 ceph-mon[41609]: pgmap v647: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:27:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:23 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:23 smithi188 ceph-mon[33283]: osdmap e433: 8 total, 8 up, 8 in 2024-02-05T07:27:24.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:24.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:23 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:24.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:23 smithi184 ceph-mon[29861]: osdmap e433: 8 total, 8 up, 8 in 2024-02-05T07:27:24.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:24.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:23 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:24.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:23 smithi184 ceph-mon[41609]: osdmap e433: 8 total, 8 up, 8 in 2024-02-05T07:27:24.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:24 smithi188 ceph-mon[33283]: osdmap e434: 8 total, 8 up, 8 in 2024-02-05T07:27:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:24 smithi188 ceph-mon[33283]: pgmap v650: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-05T07:27:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:24 smithi184 ceph-mon[29861]: osdmap e434: 8 total, 8 up, 8 in 2024-02-05T07:27:25.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:24 smithi184 ceph-mon[29861]: pgmap v650: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-05T07:27:25.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:24 smithi184 ceph-mon[41609]: osdmap e434: 8 total, 8 up, 8 in 2024-02-05T07:27:25.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:24 smithi184 ceph-mon[41609]: pgmap v650: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-05T07:27:26.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:25 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:27:26.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:25 smithi188 ceph-mon[33283]: osdmap e435: 8 total, 8 up, 8 in 2024-02-05T07:27:26.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "294.4"}]: dispatch 2024-02-05T07:27:26.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:25 smithi188 ceph-mon[33283]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "294.4"}]: dispatch 2024-02-05T07:27:26.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:25 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:27:26.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:25 smithi184 ceph-mon[29861]: osdmap e435: 8 total, 8 up, 8 in 2024-02-05T07:27:26.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "294.4"}]: dispatch 2024-02-05T07:27:26.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:25 smithi184 ceph-mon[29861]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "294.4"}]: dispatch 2024-02-05T07:27:26.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:25 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:27:26.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:25 smithi184 ceph-mon[41609]: osdmap e435: 8 total, 8 up, 8 in 2024-02-05T07:27:26.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "294.4"}]: dispatch 2024-02-05T07:27:26.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:25 smithi184 ceph-mon[41609]: from='mon.? v1:172.21.15.184:0/3028843635' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "294.4"}]: dispatch 2024-02-05T07:27:27.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:26 smithi188 ceph-mon[33283]: 294.4 deep-scrub starts 2024-02-05T07:27:27.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:26 smithi188 ceph-mon[33283]: 294.4 deep-scrub ok 2024-02-05T07:27:27.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:26 smithi188 ceph-mon[33283]: pgmap v652: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 478 B/s wr, 2 op/s 2024-02-05T07:27:27.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:26 smithi184 ceph-mon[41609]: 294.4 deep-scrub starts 2024-02-05T07:27:27.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:26 smithi184 ceph-mon[41609]: 294.4 deep-scrub ok 2024-02-05T07:27:27.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:26 smithi184 ceph-mon[41609]: pgmap v652: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 478 B/s wr, 2 op/s 2024-02-05T07:27:27.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:26 smithi184 ceph-mon[29861]: 294.4 deep-scrub starts 2024-02-05T07:27:27.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:26 smithi184 ceph-mon[29861]: 294.4 deep-scrub ok 2024-02-05T07:27:27.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:26 smithi184 ceph-mon[29861]: pgmap v652: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 478 B/s wr, 2 op/s 2024-02-05T07:27:28.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:27:27 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:27:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:29 smithi188 ceph-mon[33283]: pgmap v653: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 1.2 KiB/s wr, 123 op/s 2024-02-05T07:27:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:27:29.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:29.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:29 smithi184 ceph-mon[29861]: pgmap v653: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 1.2 KiB/s wr, 123 op/s 2024-02-05T07:27:29.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:27:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:29 smithi184 ceph-mon[41609]: pgmap v653: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 1.2 KiB/s wr, 123 op/s 2024-02-05T07:27:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:27:31.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:30 smithi188 ceph-mon[33283]: pgmap v654: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 704 B/s wr, 100 op/s 2024-02-05T07:27:31.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:30 smithi184 ceph-mon[29861]: pgmap v654: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 704 B/s wr, 100 op/s 2024-02-05T07:27:31.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:30 smithi184 ceph-mon[41609]: pgmap v654: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 60 KiB/s rd, 704 B/s wr, 100 op/s 2024-02-05T07:27:32.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:27:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:27:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:27:33.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:33 smithi188 ceph-mon[33283]: pgmap v655: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s rd, 618 B/s wr, 88 op/s 2024-02-05T07:27:33.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:33 smithi184 ceph-mon[29861]: pgmap v655: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s rd, 618 B/s wr, 88 op/s 2024-02-05T07:27:33.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:33 smithi184 ceph-mon[41609]: pgmap v655: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 52 KiB/s rd, 618 B/s wr, 88 op/s 2024-02-05T07:27:35.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:35 smithi188 ceph-mon[33283]: pgmap v656: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 511 B/s wr, 73 op/s 2024-02-05T07:27:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:35 smithi184 ceph-mon[29861]: pgmap v656: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 511 B/s wr, 73 op/s 2024-02-05T07:27:35.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:35 smithi184 ceph-mon[41609]: pgmap v656: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 44 KiB/s rd, 511 B/s wr, 73 op/s 2024-02-05T07:27:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:37 smithi188 ceph-mon[33283]: pgmap v657: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 454 B/s wr, 65 op/s 2024-02-05T07:27:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:37 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:27:37.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:37 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:27:37.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:37 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:27:37.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:37 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:27:37.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:37 smithi184 ceph-mon[29861]: pgmap v657: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 454 B/s wr, 65 op/s 2024-02-05T07:27:37.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:37 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:27:37.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:37 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:27:37.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:37 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:27:37.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:37 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:27:37.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:37 smithi184 ceph-mon[41609]: pgmap v657: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 39 KiB/s rd, 454 B/s wr, 65 op/s 2024-02-05T07:27:37.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:37 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:27:37.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:37 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:27:37.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:37 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:27:37.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:37 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:27:38.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:27:37 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:27:39.574 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:39.574 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:39 smithi184 ceph-mon[29861]: pgmap v658: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 426 B/s wr, 61 op/s 2024-02-05T07:27:39.574 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:39.574 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:39 smithi184 ceph-mon[41609]: pgmap v658: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 426 B/s wr, 61 op/s 2024-02-05T07:27:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:39.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:39 smithi188 ceph-mon[33283]: pgmap v658: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 426 B/s wr, 61 op/s 2024-02-05T07:27:41.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:40 smithi188 ceph-mon[33283]: pgmap v659: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:27:41.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:40 smithi184 ceph-mon[29861]: pgmap v659: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:27:41.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:40 smithi184 ceph-mon[41609]: pgmap v659: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:27:42.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:27:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:27:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:27:43.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:43 smithi188 ceph-mon[33283]: pgmap v660: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:27:43.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:43 smithi184 ceph-mon[29861]: pgmap v660: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:27:43.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:43 smithi184 ceph-mon[41609]: pgmap v660: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:27:44.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:27:44.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:27:44.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:27:45.271 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:27:45 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-1[51940]: 2024-02-05T07:27:45.013+0000 7f51597a0700 -1 snap_mapper.add_oid found existing snaps mapped on 294:257ad3b3:test-rados-api-smithi184-81478-80::foo:2, removing 2024-02-05T07:27:45.305 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:27:45 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4[38737]: 2024-02-05T07:27:45.012+0000 7f02ec329700 -1 snap_mapper.add_oid found existing snaps mapped on 294:257ad3b3:test-rados-api-smithi184-81478-80::foo:2, removing 2024-02-05T07:27:45.305 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:27:45 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:27:45.012+0000 7f4d4e311700 -1 snap_mapper.add_oid found existing snaps mapped on 294:257ad3b3:test-rados-api-smithi184-81478-80::foo:2, removing 2024-02-05T07:27:45.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:45 smithi188 ceph-mon[33283]: pgmap v661: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:27:45.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:45.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:45 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:45.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-79"}]: dispatch 2024-02-05T07:27:45.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:45 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-79"}]: dispatch 2024-02-05T07:27:45.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:45 smithi184 ceph-mon[29861]: pgmap v661: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:27:45.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:45.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:45 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:45.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-79"}]: dispatch 2024-02-05T07:27:45.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:45 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-79"}]: dispatch 2024-02-05T07:27:45.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:45 smithi184 ceph-mon[41609]: pgmap v661: 324 pgs: 324 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:27:45.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:45.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:45 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:45.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-79"}]: dispatch 2024-02-05T07:27:45.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:45 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-79"}]: dispatch 2024-02-05T07:27:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:46 smithi188 ceph-mon[33283]: osdmap e436: 8 total, 8 up, 8 in 2024-02-05T07:27:47.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:46 smithi188 ceph-mon[33283]: pgmap v663: 292 pgs: 292 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:27:47.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:46 smithi184 ceph-mon[29861]: osdmap e436: 8 total, 8 up, 8 in 2024-02-05T07:27:47.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:46 smithi184 ceph-mon[29861]: pgmap v663: 292 pgs: 292 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:27:47.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:46 smithi184 ceph-mon[41609]: osdmap e436: 8 total, 8 up, 8 in 2024-02-05T07:27:47.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:46 smithi184 ceph-mon[41609]: pgmap v663: 292 pgs: 292 active+clean; 8.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:27:48.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:47 smithi188 ceph-mon[33283]: osdmap e437: 8 total, 8 up, 8 in 2024-02-05T07:27:48.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:47 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:48.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:47 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:48.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:27:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:27:48.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:47 smithi184 ceph-mon[29861]: osdmap e437: 8 total, 8 up, 8 in 2024-02-05T07:27:48.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:47 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:48.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:47 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:48.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:47 smithi184 ceph-mon[41609]: osdmap e437: 8 total, 8 up, 8 in 2024-02-05T07:27:48.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:47 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:48.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:47 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:48 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:48 smithi188 ceph-mon[33283]: osdmap e438: 8 total, 8 up, 8 in 2024-02-05T07:27:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:48 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:48 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:48 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:27:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:48 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:27:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:48 smithi188 ceph-mon[33283]: pgmap v666: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-02-05T07:27:49.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:48 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:49.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:48 smithi184 ceph-mon[29861]: osdmap e438: 8 total, 8 up, 8 in 2024-02-05T07:27:49.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:48 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:49.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:48 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:49.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:48 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:27:49.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:48 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:27:49.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:48 smithi184 ceph-mon[29861]: pgmap v666: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-02-05T07:27:49.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:48 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:49.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:48 smithi184 ceph-mon[41609]: osdmap e438: 8 total, 8 up, 8 in 2024-02-05T07:27:49.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:48 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:49.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:48 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:49.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:48 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:27:49.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:48 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:27:49.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:48 smithi184 ceph-mon[41609]: pgmap v666: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-02-05T07:27:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:49 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:27:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:49 smithi188 ceph-mon[33283]: osdmap e439: 8 total, 8 up, 8 in 2024-02-05T07:27:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:50.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:49 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:49 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:27:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:49 smithi184 ceph-mon[29861]: osdmap e439: 8 total, 8 up, 8 in 2024-02-05T07:27:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:49 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:50.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:49 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:27:50.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:49 smithi184 ceph-mon[41609]: osdmap e439: 8 total, 8 up, 8 in 2024-02-05T07:27:50.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:50.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:49 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:51.113 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3f8e0 2024-02-05T07:27:51.113 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3fc30 2024-02-05T07:27:51.113 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c400c0 2024-02-05T07:27:51.113 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c401f0 2024-02-05T07:27:51.113 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3e740 2024-02-05T07:27:51.113 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3e870 2024-02-05T07:27:51.113 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c407c0 2024-02-05T07:27:51.113 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c40320 2024-02-05T07:27:51.113 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c40470 2024-02-05T07:27:51.113 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c405a0 2024-02-05T07:27:51.113 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c40910 2024-02-05T07:27:51.113 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c40df0 2024-02-05T07:27:51.113 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c40f70 2024-02-05T07:27:51.113 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3fd60 2024-02-05T07:27:51.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c3fe90 2024-02-05T07:27:51.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c41540 2024-02-05T07:27:51.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c410a0 2024-02-05T07:27:51.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c411d0 2024-02-05T07:27:51.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c41300 2024-02-05T07:27:51.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c41430 2024-02-05T07:27:51.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c41b10 2024-02-05T07:27:51.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c41670 2024-02-05T07:27:51.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c417c0 2024-02-05T07:27:51.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c418f0 2024-02-05T07:27:51.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c41c40 2024-02-05T07:27:51.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c420d0 2024-02-05T07:27:51.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c42200 2024-02-05T07:27:51.114 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c40a40 2024-02-05T07:27:51.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c40b70 2024-02-05T07:27:51.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c427d0 2024-02-05T07:27:51.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c42330 2024-02-05T07:27:51.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c42460 2024-02-05T07:27:51.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c42590 2024-02-05T07:27:51.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c42900 2024-02-05T07:27:51.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c42e00 2024-02-05T07:27:51.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c42f30 2024-02-05T07:27:51.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c426c0 2024-02-05T07:27:51.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c42a50 2024-02-05T07:27:51.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c42b80 2024-02-05T07:27:51.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c43060 2024-02-05T07:27:51.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c434f0 2024-02-05T07:27:51.115 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c43620 2024-02-05T07:27:51.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c41d70 2024-02-05T07:27:51.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c41ea0 2024-02-05T07:27:51.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c43bf0 2024-02-05T07:27:51.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c43750 2024-02-05T07:27:51.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c43880 2024-02-05T07:27:51.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c41fb0 2024-02-05T07:27:51.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c439b0 2024-02-05T07:27:51.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c43ae0 2024-02-05T07:27:51.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c42cd0 2024-02-05T07:27:51.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c441c0 2024-02-05T07:27:51.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c43d20 2024-02-05T07:27:51.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c43e70 2024-02-05T07:27:51.116 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c43fc0 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c442f0 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c44780 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c448b0 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c43190 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c432c0 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c44e80 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c449e0 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c44b10 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c44c40 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c44d70 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c45450 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c44fb0 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c450e0 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c45210 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c45340 2024-02-05T07:27:51.117 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c45a20 2024-02-05T07:27:51.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c45580 2024-02-05T07:27:51.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c456d0 2024-02-05T07:27:51.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c45800 2024-02-05T07:27:51.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c45b50 2024-02-05T07:27:51.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c46030 2024-02-05T07:27:51.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c46160 2024-02-05T07:27:51.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c44420 2024-02-05T07:27:51.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c44550 2024-02-05T07:27:51.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c46730 2024-02-05T07:27:51.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c46290 2024-02-05T07:27:51.118 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c463c0 2024-02-05T07:27:51.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:50 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:27:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:50 smithi188 ceph-mon[33283]: osdmap e440: 8 total, 8 up, 8 in 2024-02-05T07:27:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:27:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:50 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:27:51.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:50 smithi188 ceph-mon[33283]: pgmap v669: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-05T07:27:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:50 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:27:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:50 smithi184 ceph-mon[29861]: osdmap e440: 8 total, 8 up, 8 in 2024-02-05T07:27:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:27:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:50 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:27:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:50 smithi184 ceph-mon[29861]: pgmap v669: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-05T07:27:51.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:50 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:27:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:50 smithi184 ceph-mon[41609]: osdmap e440: 8 total, 8 up, 8 in 2024-02-05T07:27:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:27:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:50 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:27:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:50 smithi184 ceph-mon[41609]: pgmap v669: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-05T07:27:52.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:51 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-05T07:27:52.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:51 smithi188 ceph-mon[33283]: osdmap e441: 8 total, 8 up, 8 in 2024-02-05T07:27:52.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:27:52.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:51 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:27:52.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:27:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:27:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:27:52.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:51 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-05T07:27:52.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:51 smithi184 ceph-mon[29861]: osdmap e441: 8 total, 8 up, 8 in 2024-02-05T07:27:52.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:27:52.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:51 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:27:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:51 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-05T07:27:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:51 smithi184 ceph-mon[41609]: osdmap e441: 8 total, 8 up, 8 in 2024-02-05T07:27:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:27:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:51 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:27:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:52 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:27:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:52 smithi188 ceph-mon[33283]: osdmap e442: 8 total, 8 up, 8 in 2024-02-05T07:27:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-02-05T07:27:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:52 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-02-05T07:27:53.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:52 smithi188 ceph-mon[33283]: pgmap v672: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:27:53.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:52 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:27:53.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:52 smithi184 ceph-mon[29861]: osdmap e442: 8 total, 8 up, 8 in 2024-02-05T07:27:53.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-02-05T07:27:53.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:52 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-02-05T07:27:53.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:52 smithi184 ceph-mon[29861]: pgmap v672: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:27:53.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:52 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:27:53.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:52 smithi184 ceph-mon[41609]: osdmap e442: 8 total, 8 up, 8 in 2024-02-05T07:27:53.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-02-05T07:27:53.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:52 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-02-05T07:27:53.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:52 smithi184 ceph-mon[41609]: pgmap v672: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:27:54.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:53 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-02-05T07:27:54.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:53 smithi188 ceph-mon[33283]: osdmap e443: 8 total, 8 up, 8 in 2024-02-05T07:27:54.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:53 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-02-05T07:27:54.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:53 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-02-05T07:27:54.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:53 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-02-05T07:27:54.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:53 smithi184 ceph-mon[41609]: osdmap e443: 8 total, 8 up, 8 in 2024-02-05T07:27:54.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:53 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-02-05T07:27:54.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:53 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-02-05T07:27:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:53 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-02-05T07:27:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:53 smithi184 ceph-mon[29861]: osdmap e443: 8 total, 8 up, 8 in 2024-02-05T07:27:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-02-05T07:27:54.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:53 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-02-05T07:27:55.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:54 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-02-05T07:27:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:54 smithi188 ceph-mon[33283]: osdmap e444: 8 total, 8 up, 8 in 2024-02-05T07:27:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:27:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:54 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:27:55.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:54 smithi188 ceph-mon[33283]: pgmap v675: 324 pgs: 324 active+clean; 8.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-02-05T07:27:55.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:54 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-02-05T07:27:55.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:54 smithi184 ceph-mon[29861]: osdmap e444: 8 total, 8 up, 8 in 2024-02-05T07:27:55.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:27:55.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:54 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:27:55.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:54 smithi184 ceph-mon[29861]: pgmap v675: 324 pgs: 324 active+clean; 8.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-02-05T07:27:55.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:54 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-02-05T07:27:55.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:54 smithi184 ceph-mon[41609]: osdmap e444: 8 total, 8 up, 8 in 2024-02-05T07:27:55.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:27:55.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:54 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:27:55.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:54 smithi184 ceph-mon[41609]: pgmap v675: 324 pgs: 324 active+clean; 8.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 5.2 KiB/s wr, 8 op/s 2024-02-05T07:27:56.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:55 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:27:56.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:55 smithi188 ceph-mon[33283]: osdmap e445: 8 total, 8 up, 8 in 2024-02-05T07:27:56.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:55 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:56.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:55 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:56.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:55 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-81"}]: dispatch 2024-02-05T07:27:56.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:55 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-81"}]: dispatch 2024-02-05T07:27:56.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:55 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:27:56.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:55 smithi184 ceph-mon[29861]: osdmap e445: 8 total, 8 up, 8 in 2024-02-05T07:27:56.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:55 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:56.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:55 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:56.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:55 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-81"}]: dispatch 2024-02-05T07:27:56.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:55 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-81"}]: dispatch 2024-02-05T07:27:56.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:55 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:27:56.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:55 smithi184 ceph-mon[41609]: osdmap e445: 8 total, 8 up, 8 in 2024-02-05T07:27:56.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:55 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:56.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:55 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:27:56.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:55 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-81"}]: dispatch 2024-02-05T07:27:56.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:55 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-81"}]: dispatch 2024-02-05T07:27:57.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:56 smithi188 ceph-mon[33283]: osdmap e446: 8 total, 8 up, 8 in 2024-02-05T07:27:57.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:56 smithi188 ceph-mon[33283]: pgmap v678: 292 pgs: 292 active+clean; 8.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-02-05T07:27:57.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:56 smithi184 ceph-mon[29861]: osdmap e446: 8 total, 8 up, 8 in 2024-02-05T07:27:57.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:56 smithi184 ceph-mon[29861]: pgmap v678: 292 pgs: 292 active+clean; 8.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-02-05T07:27:57.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:56 smithi184 ceph-mon[41609]: osdmap e446: 8 total, 8 up, 8 in 2024-02-05T07:27:57.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:56 smithi184 ceph-mon[41609]: pgmap v678: 292 pgs: 292 active+clean; 8.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-02-05T07:27:58.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:57 smithi188 ceph-mon[33283]: osdmap e447: 8 total, 8 up, 8 in 2024-02-05T07:27:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:58.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:57 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:58.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:27:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:27:58.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:57 smithi184 ceph-mon[29861]: osdmap e447: 8 total, 8 up, 8 in 2024-02-05T07:27:58.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:58.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:57 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:58.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:57 smithi184 ceph-mon[41609]: osdmap e447: 8 total, 8 up, 8 in 2024-02-05T07:27:58.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:58.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:57 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:27:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:58 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:58 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:58 smithi188 ceph-mon[33283]: osdmap e448: 8 total, 8 up, 8 in 2024-02-05T07:27:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:27:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:58 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:27:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:58 smithi188 ceph-mon[33283]: pgmap v681: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 7.0 KiB/s wr, 32 op/s 2024-02-05T07:27:59.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:27:59.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:59.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:59.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[29861]: osdmap e448: 8 total, 8 up, 8 in 2024-02-05T07:27:59.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:59.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:27:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:27:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[29861]: pgmap v681: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 7.0 KiB/s wr, 32 op/s 2024-02-05T07:27:59.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:27:59.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:27:59.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:27:59.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[41609]: osdmap e448: 8 total, 8 up, 8 in 2024-02-05T07:27:59.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:27:59.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:27:59.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:27:59.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[41609]: pgmap v681: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 7.0 KiB/s wr, 32 op/s 2024-02-05T07:27:59.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:28:00.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:28:00.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:00.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:59 smithi188 ceph-mon[33283]: osdmap e449: 8 total, 8 up, 8 in 2024-02-05T07:28:00.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:27:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:00.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:28:00.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:00.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:59 smithi184 ceph-mon[29861]: osdmap e449: 8 total, 8 up, 8 in 2024-02-05T07:28:00.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:27:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:00.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:28:00.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:00.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:59 smithi184 ceph-mon[41609]: osdmap e449: 8 total, 8 up, 8 in 2024-02-05T07:28:00.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:27:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:00 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:28:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:00 smithi188 ceph-mon[33283]: osdmap e450: 8 total, 8 up, 8 in 2024-02-05T07:28:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:00 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:01.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:00 smithi188 ceph-mon[33283]: pgmap v684: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 9.0 KiB/s wr, 32 op/s 2024-02-05T07:28:01.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:00 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:28:01.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:00 smithi184 ceph-mon[29861]: osdmap e450: 8 total, 8 up, 8 in 2024-02-05T07:28:01.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:01.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:00 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:01.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:00 smithi184 ceph-mon[29861]: pgmap v684: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 9.0 KiB/s wr, 32 op/s 2024-02-05T07:28:01.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:00 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:28:01.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:00 smithi184 ceph-mon[41609]: osdmap e450: 8 total, 8 up, 8 in 2024-02-05T07:28:01.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:01.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:00 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:01.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:00 smithi184 ceph-mon[41609]: pgmap v684: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 9.5 KiB/s rd, 9.0 KiB/s wr, 32 op/s 2024-02-05T07:28:02.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:02 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-05T07:28:02.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:02 smithi184 ceph-mon[29861]: osdmap e451: 8 total, 8 up, 8 in 2024-02-05T07:28:02.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:02.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:02 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:02.272 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:28:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:28:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:28:02.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:02 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-05T07:28:02.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:02 smithi184 ceph-mon[41609]: osdmap e451: 8 total, 8 up, 8 in 2024-02-05T07:28:02.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:02.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:02 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:02.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:02 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-05T07:28:02.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:02 smithi188 ceph-mon[33283]: osdmap e451: 8 total, 8 up, 8 in 2024-02-05T07:28:02.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:02.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:02 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:03.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:03 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:28:03.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:03 smithi184 ceph-mon[29861]: osdmap e452: 8 total, 8 up, 8 in 2024-02-05T07:28:03.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:03 smithi184 ceph-mon[29861]: pgmap v687: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:28:03.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:03 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:28:03.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:03 smithi184 ceph-mon[41609]: osdmap e452: 8 total, 8 up, 8 in 2024-02-05T07:28:03.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:03 smithi184 ceph-mon[41609]: pgmap v687: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:28:03.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:03 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:28:03.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:03 smithi188 ceph-mon[33283]: osdmap e452: 8 total, 8 up, 8 in 2024-02-05T07:28:03.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:03 smithi188 ceph-mon[33283]: pgmap v687: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:28:04.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:04 smithi184 ceph-mon[29861]: osdmap e453: 8 total, 8 up, 8 in 2024-02-05T07:28:04.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:04 smithi184 ceph-mon[41609]: osdmap e453: 8 total, 8 up, 8 in 2024-02-05T07:28:04.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:04 smithi188 ceph-mon[33283]: osdmap e453: 8 total, 8 up, 8 in 2024-02-05T07:28:05.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:05 smithi188 ceph-mon[33283]: osdmap e454: 8 total, 8 up, 8 in 2024-02-05T07:28:05.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:05.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:05 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:05.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-83"}]: dispatch 2024-02-05T07:28:05.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:05 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-83"}]: dispatch 2024-02-05T07:28:05.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:05 smithi188 ceph-mon[33283]: pgmap v690: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-02-05T07:28:05.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:05 smithi184 ceph-mon[29861]: osdmap e454: 8 total, 8 up, 8 in 2024-02-05T07:28:05.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:05.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:05 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:05.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-83"}]: dispatch 2024-02-05T07:28:05.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:05 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-83"}]: dispatch 2024-02-05T07:28:05.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:05 smithi184 ceph-mon[29861]: pgmap v690: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-02-05T07:28:05.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:05 smithi184 ceph-mon[41609]: osdmap e454: 8 total, 8 up, 8 in 2024-02-05T07:28:05.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:05.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:05 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:05.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-83"}]: dispatch 2024-02-05T07:28:05.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:05 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-83"}]: dispatch 2024-02-05T07:28:05.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:05 smithi184 ceph-mon[41609]: pgmap v690: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 2.2 KiB/s wr, 2 op/s 2024-02-05T07:28:06.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:06 smithi188 ceph-mon[33283]: osdmap e455: 8 total, 8 up, 8 in 2024-02-05T07:28:06.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:06 smithi184 ceph-mon[29861]: osdmap e455: 8 total, 8 up, 8 in 2024-02-05T07:28:06.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:06 smithi184 ceph-mon[41609]: osdmap e455: 8 total, 8 up, 8 in 2024-02-05T07:28:07.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:07 smithi188 ceph-mon[33283]: osdmap e456: 8 total, 8 up, 8 in 2024-02-05T07:28:07.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:07.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:07 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:07.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:07 smithi188 ceph-mon[33283]: pgmap v693: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:28:07.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:07 smithi184 ceph-mon[29861]: osdmap e456: 8 total, 8 up, 8 in 2024-02-05T07:28:07.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:07.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:07 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:07.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:07 smithi184 ceph-mon[29861]: pgmap v693: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:28:07.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:07 smithi184 ceph-mon[41609]: osdmap e456: 8 total, 8 up, 8 in 2024-02-05T07:28:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:07 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:07.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:07 smithi184 ceph-mon[41609]: pgmap v693: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:28:08.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:28:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:28:08.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:08 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:08.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:08 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:28:08.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:08 smithi188 ceph-mon[33283]: osdmap e457: 8 total, 8 up, 8 in 2024-02-05T07:28:08.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:28:08.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:08.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:08 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:08.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:08 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:08.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:08 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:28:08.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:08 smithi184 ceph-mon[29861]: osdmap e457: 8 total, 8 up, 8 in 2024-02-05T07:28:08.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:28:08.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:08.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:08 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:08.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:08 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:08.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:08 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:28:08.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:08 smithi184 ceph-mon[41609]: osdmap e457: 8 total, 8 up, 8 in 2024-02-05T07:28:08.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:28:08.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:08.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:08 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:09.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:09.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:09 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:28:09.423 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:09 smithi184 ceph-mon[29861]: osdmap e458: 8 total, 8 up, 8 in 2024-02-05T07:28:09.424 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:09.424 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:09 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:09.424 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:09 smithi184 ceph-mon[29861]: pgmap v696: 324 pgs: 324 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-02-05T07:28:09.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:09.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:09 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:28:09.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:09 smithi184 ceph-mon[41609]: osdmap e458: 8 total, 8 up, 8 in 2024-02-05T07:28:09.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:09.424 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:09 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:09.425 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:09 smithi184 ceph-mon[41609]: pgmap v696: 324 pgs: 324 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-02-05T07:28:09.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:09.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:09 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:28:09.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:09 smithi188 ceph-mon[33283]: osdmap e458: 8 total, 8 up, 8 in 2024-02-05T07:28:09.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:09.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:09 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:09.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:09 smithi188 ceph-mon[33283]: pgmap v696: 324 pgs: 324 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-02-05T07:28:10.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:10 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:28:10.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:10 smithi188 ceph-mon[33283]: osdmap e459: 8 total, 8 up, 8 in 2024-02-05T07:28:10.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:10.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:10 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:10.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:10 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-05T07:28:10.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:10 smithi188 ceph-mon[33283]: osdmap e460: 8 total, 8 up, 8 in 2024-02-05T07:28:10.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:10.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:10 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:10.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:28:10.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[29861]: osdmap e459: 8 total, 8 up, 8 in 2024-02-05T07:28:10.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:10.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:10.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-05T07:28:10.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[29861]: osdmap e460: 8 total, 8 up, 8 in 2024-02-05T07:28:10.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:10.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:10.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_tier","val": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:28:10.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[41609]: osdmap e459: 8 total, 8 up, 8 in 2024-02-05T07:28:10.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:10.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:10.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-05T07:28:10.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[41609]: osdmap e460: 8 total, 8 up, 8 in 2024-02-05T07:28:10.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:10.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:10 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:11.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:11 smithi188 ceph-mon[33283]: pgmap v699: 324 pgs: 324 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-02-05T07:28:11.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:11 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:28:11.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:11 smithi188 ceph-mon[33283]: osdmap e461: 8 total, 8 up, 8 in 2024-02-05T07:28:11.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:11 smithi184 ceph-mon[29861]: pgmap v699: 324 pgs: 324 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-02-05T07:28:11.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:11 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:28:11.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:11 smithi184 ceph-mon[29861]: osdmap e461: 8 total, 8 up, 8 in 2024-02-05T07:28:11.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:11 smithi184 ceph-mon[41609]: pgmap v699: 324 pgs: 324 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 4.0 KiB/s wr, 9 op/s 2024-02-05T07:28:11.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:11 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:28:11.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:11 smithi184 ceph-mon[41609]: osdmap e461: 8 total, 8 up, 8 in 2024-02-05T07:28:12.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:28:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:28:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:28:13.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:13 smithi188 ceph-mon[33283]: osdmap e462: 8 total, 8 up, 8 in 2024-02-05T07:28:13.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:13 smithi188 ceph-mon[33283]: pgmap v702: 324 pgs: 324 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:28:13.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:13 smithi184 ceph-mon[29861]: osdmap e462: 8 total, 8 up, 8 in 2024-02-05T07:28:13.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:13 smithi184 ceph-mon[29861]: pgmap v702: 324 pgs: 324 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:28:13.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:13 smithi184 ceph-mon[41609]: osdmap e462: 8 total, 8 up, 8 in 2024-02-05T07:28:13.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:13 smithi184 ceph-mon[41609]: pgmap v702: 324 pgs: 324 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:28:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:14 smithi188 ceph-mon[33283]: osdmap e463: 8 total, 8 up, 8 in 2024-02-05T07:28:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:14 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-85"}]: dispatch 2024-02-05T07:28:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:14 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-85"}]: dispatch 2024-02-05T07:28:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:14 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:28:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:14 smithi184 ceph-mon[29861]: osdmap e463: 8 total, 8 up, 8 in 2024-02-05T07:28:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:14 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-85"}]: dispatch 2024-02-05T07:28:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:14 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-85"}]: dispatch 2024-02-05T07:28:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:14 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:28:14.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:14 smithi184 ceph-mon[41609]: osdmap e463: 8 total, 8 up, 8 in 2024-02-05T07:28:14.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:14.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:14 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:14.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-85"}]: dispatch 2024-02-05T07:28:14.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:14 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-85"}]: dispatch 2024-02-05T07:28:14.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:14 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:28:15.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:15 smithi188 ceph-mon[33283]: osdmap e464: 8 total, 8 up, 8 in 2024-02-05T07:28:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:15 smithi188 ceph-mon[33283]: pgmap v705: 292 pgs: 292 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:28:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:15 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:15 smithi188 ceph-mon[33283]: osdmap e465: 8 total, 8 up, 8 in 2024-02-05T07:28:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:15 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:15 smithi184 ceph-mon[29861]: osdmap e464: 8 total, 8 up, 8 in 2024-02-05T07:28:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:15 smithi184 ceph-mon[29861]: pgmap v705: 292 pgs: 292 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:28:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:15 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:15 smithi184 ceph-mon[29861]: osdmap e465: 8 total, 8 up, 8 in 2024-02-05T07:28:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:15 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:15.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:15 smithi184 ceph-mon[41609]: osdmap e464: 8 total, 8 up, 8 in 2024-02-05T07:28:15.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:15 smithi184 ceph-mon[41609]: pgmap v705: 292 pgs: 292 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:28:15.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:15 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:15.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:15 smithi184 ceph-mon[41609]: osdmap e465: 8 total, 8 up, 8 in 2024-02-05T07:28:15.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:15.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:15 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:16.099 INFO:tasks.workunit.client.0.smithi184.stdout: OK ] LibRadosTwoPoolsPP.ProxyRead (18091 ms) 2024-02-05T07:28:16.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-02-05T07:28:16.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (23012 ms) 2024-02-05T07:28:16.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-02-05T07:28:16.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3012 ms) 2024-02-05T07:28:16.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-02-05T07:28:16.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:28:16.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3017 ms) 2024-02-05T07:28:16.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-02-05T07:28:16.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (3021 ms) 2024-02-05T07:28:16.100 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-02-05T07:28:16.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:28:16.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3026 ms) 2024-02-05T07:28:16.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-02-05T07:28:16.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:28:16.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (4035 ms) 2024-02-05T07:28:16.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-02-05T07:28:16.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:28:16.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (39889 ms) 2024-02-05T07:28:16.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-02-05T07:28:16.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:28:16.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (17076 ms) 2024-02-05T07:28:16.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-02-05T07:28:16.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:28:16.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4043 ms) 2024-02-05T07:28:16.101 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-02-05T07:28:16.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:28:16.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (3027 ms) 2024-02-05T07:28:16.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-02-05T07:28:16.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:28:16.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (24874 ms) 2024-02-05T07:28:16.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-02-05T07:28:16.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:28:16.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (14584 ms) 2024-02-05T07:28:16.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-02-05T07:28:16.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:28:16.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5050 ms) 2024-02-05T07:28:16.102 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-02-05T07:28:16.103 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:28:16.103 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (4029 ms) 2024-02-05T07:28:16.103 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-02-05T07:28:16.103 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:28:16.103 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: waiting for scrubs... 2024-02-05T07:28:16.103 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: done waiting 2024-02-05T07:28:16.103 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (24938 ms) 2024-02-05T07:28:16.103 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-02-05T07:28:16.103 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:28:16.103 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (10065 ms) 2024-02-05T07:28:16.103 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-02-05T07:28:16.103 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:28:16.103 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (9076 ms) 2024-02-05T07:28:16.103 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-02-05T07:28:16.104 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:28:16.104 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9051 ms) 2024-02-05T07:28:16.104 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-02-05T07:28:17.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:17 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:28:17.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:17 smithi188 ceph-mon[33283]: osdmap e466: 8 total, 8 up, 8 in 2024-02-05T07:28:17.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:28:17.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:17 smithi188 ceph-mon[33283]: pgmap v708: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:28:17.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:17 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:28:17.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:17 smithi184 ceph-mon[29861]: osdmap e466: 8 total, 8 up, 8 in 2024-02-05T07:28:17.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:28:17.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:17 smithi184 ceph-mon[29861]: pgmap v708: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:28:17.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:17 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:28:17.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:17 smithi184 ceph-mon[41609]: osdmap e466: 8 total, 8 up, 8 in 2024-02-05T07:28:17.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:28:17.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:17 smithi184 ceph-mon[41609]: pgmap v708: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:28:18.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:18 smithi188 ceph-mon[33283]: osdmap e467: 8 total, 8 up, 8 in 2024-02-05T07:28:18.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:18.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:18 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:18.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:28:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:28:18.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:18 smithi184 ceph-mon[29861]: osdmap e467: 8 total, 8 up, 8 in 2024-02-05T07:28:18.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:18.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:18 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:18.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:18 smithi184 ceph-mon[41609]: osdmap e467: 8 total, 8 up, 8 in 2024-02-05T07:28:18.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:18.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:18 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:19.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:19 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:28:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:19 smithi188 ceph-mon[33283]: osdmap e468: 8 total, 8 up, 8 in 2024-02-05T07:28:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_tier","val": "test-rados-api-smithi184-81478-89-test-flush"}]: dispatch 2024-02-05T07:28:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:19 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_tier","val": "test-rados-api-smithi184-81478-89-test-flush"}]: dispatch 2024-02-05T07:28:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:19 smithi188 ceph-mon[33283]: pgmap v711: 356 pgs: 32 creating+peering, 324 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-02-05T07:28:19.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:19.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:19 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:28:19.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:19 smithi184 ceph-mon[29861]: osdmap e468: 8 total, 8 up, 8 in 2024-02-05T07:28:19.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_tier","val": "test-rados-api-smithi184-81478-89-test-flush"}]: dispatch 2024-02-05T07:28:19.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:19 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_tier","val": "test-rados-api-smithi184-81478-89-test-flush"}]: dispatch 2024-02-05T07:28:19.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:19 smithi184 ceph-mon[29861]: pgmap v711: 356 pgs: 32 creating+peering, 324 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-02-05T07:28:19.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:19 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:28:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:19 smithi184 ceph-mon[41609]: osdmap e468: 8 total, 8 up, 8 in 2024-02-05T07:28:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_tier","val": "test-rados-api-smithi184-81478-89-test-flush"}]: dispatch 2024-02-05T07:28:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:19 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_tier","val": "test-rados-api-smithi184-81478-89-test-flush"}]: dispatch 2024-02-05T07:28:19.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:19 smithi184 ceph-mon[41609]: pgmap v711: 356 pgs: 32 creating+peering, 324 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-02-05T07:28:20.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:20 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_tier","val": "test-rados-api-smithi184-81478-89-test-flush"}]': finished 2024-02-05T07:28:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:20 smithi188 ceph-mon[33283]: osdmap e469: 8 total, 8 up, 8 in 2024-02-05T07:28:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:20 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:20 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:20.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:20 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_tier","val": "test-rados-api-smithi184-81478-89-test-flush"}]': finished 2024-02-05T07:28:20.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:20 smithi184 ceph-mon[41609]: osdmap e469: 8 total, 8 up, 8 in 2024-02-05T07:28:20.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:20.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:20 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:20.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:20 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:20.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:20 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_tier","val": "test-rados-api-smithi184-81478-89-test-flush"}]': finished 2024-02-05T07:28:20.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:20 smithi184 ceph-mon[29861]: osdmap e469: 8 total, 8 up, 8 in 2024-02-05T07:28:20.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:20.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:20 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:28:20.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:20 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:21.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:21 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-05T07:28:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:21 smithi188 ceph-mon[33283]: osdmap e470: 8 total, 8 up, 8 in 2024-02-05T07:28:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:21 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:21 smithi188 ceph-mon[33283]: pgmap v714: 356 pgs: 32 creating+peering, 324 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-02-05T07:28:21.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:21 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:28:21.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:21 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-05T07:28:21.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:21 smithi184 ceph-mon[41609]: osdmap e470: 8 total, 8 up, 8 in 2024-02-05T07:28:21.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:21.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:21 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:21.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:21 smithi184 ceph-mon[41609]: pgmap v714: 356 pgs: 32 creating+peering, 324 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-02-05T07:28:21.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:21 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:28:21.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:21 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-05T07:28:21.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:21 smithi184 ceph-mon[29861]: osdmap e470: 8 total, 8 up, 8 in 2024-02-05T07:28:21.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:21.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:21 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:28:21.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:21 smithi184 ceph-mon[29861]: pgmap v714: 356 pgs: 32 creating+peering, 324 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-02-05T07:28:21.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:21 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:28:22.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:22 smithi184 ceph-mon[29861]: osdmap e471: 8 total, 8 up, 8 in 2024-02-05T07:28:22.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:22 smithi184 ceph-mon[41609]: osdmap e471: 8 total, 8 up, 8 in 2024-02-05T07:28:22.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:28:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:28:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:28:22.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:22 smithi188 ceph-mon[33283]: osdmap e471: 8 total, 8 up, 8 in 2024-02-05T07:28:23.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:23 smithi188 ceph-mon[33283]: osdmap e472: 8 total, 8 up, 8 in 2024-02-05T07:28:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:23 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-87"}]: dispatch 2024-02-05T07:28:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:23 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-87"}]: dispatch 2024-02-05T07:28:23.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:23 smithi188 ceph-mon[33283]: pgmap v717: 324 pgs: 324 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:28:23.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:23 smithi184 ceph-mon[29861]: osdmap e472: 8 total, 8 up, 8 in 2024-02-05T07:28:23.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:23.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:23 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:23.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-87"}]: dispatch 2024-02-05T07:28:23.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:23 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-87"}]: dispatch 2024-02-05T07:28:23.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:23 smithi184 ceph-mon[29861]: pgmap v717: 324 pgs: 324 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:28:23.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:23 smithi184 ceph-mon[41609]: osdmap e472: 8 total, 8 up, 8 in 2024-02-05T07:28:23.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:23.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:23 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:23.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-87"}]: dispatch 2024-02-05T07:28:23.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:23 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-87"}]: dispatch 2024-02-05T07:28:23.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:23 smithi184 ceph-mon[41609]: pgmap v717: 324 pgs: 324 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:28:24.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:24 smithi188 ceph-mon[33283]: osdmap e473: 8 total, 8 up, 8 in 2024-02-05T07:28:24.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:24 smithi184 ceph-mon[29861]: osdmap e473: 8 total, 8 up, 8 in 2024-02-05T07:28:24.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:24 smithi184 ceph-mon[41609]: osdmap e473: 8 total, 8 up, 8 in 2024-02-05T07:28:25.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:25 smithi188 ceph-mon[33283]: osdmap e474: 8 total, 8 up, 8 in 2024-02-05T07:28:25.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:25.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:25 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:25.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:25 smithi188 ceph-mon[33283]: pgmap v720: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:28:25.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:25 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:25.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:25 smithi184 ceph-mon[29861]: osdmap e474: 8 total, 8 up, 8 in 2024-02-05T07:28:25.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:25.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:25 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:25.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:25 smithi184 ceph-mon[29861]: pgmap v720: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:28:25.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:25 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:25.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:25 smithi184 ceph-mon[41609]: osdmap e474: 8 total, 8 up, 8 in 2024-02-05T07:28:25.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:25.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:25 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:25.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:25 smithi184 ceph-mon[41609]: pgmap v720: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:28:25.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:25 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:26.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:26 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:28:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:26 smithi188 ceph-mon[33283]: osdmap e475: 8 total, 8 up, 8 in 2024-02-05T07:28:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:28:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:26.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:26 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:26.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:26 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:28:26.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:26 smithi184 ceph-mon[29861]: osdmap e475: 8 total, 8 up, 8 in 2024-02-05T07:28:26.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:28:26.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:26.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:26 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:26.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:26 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:28:26.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:26 smithi184 ceph-mon[41609]: osdmap e475: 8 total, 8 up, 8 in 2024-02-05T07:28:26.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:28:26.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:26.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:26 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:28:27.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:27 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:28:27.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:27 smithi188 ceph-mon[33283]: osdmap e476: 8 total, 8 up, 8 in 2024-02-05T07:28:27.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:27 smithi188 ceph-mon[33283]: pgmap v723: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:28:27.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:27 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:28:27.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:27 smithi184 ceph-mon[29861]: osdmap e476: 8 total, 8 up, 8 in 2024-02-05T07:28:27.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:27 smithi184 ceph-mon[29861]: pgmap v723: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:28:27.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:27 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:28:27.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:27 smithi184 ceph-mon[41609]: osdmap e476: 8 total, 8 up, 8 in 2024-02-05T07:28:27.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:27 smithi184 ceph-mon[41609]: pgmap v723: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:28:28.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:28 smithi188 ceph-mon[33283]: osdmap e477: 8 total, 8 up, 8 in 2024-02-05T07:28:28.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:28:27 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:28:28.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:28 smithi184 ceph-mon[29861]: osdmap e477: 8 total, 8 up, 8 in 2024-02-05T07:28:28.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:28 smithi184 ceph-mon[41609]: osdmap e477: 8 total, 8 up, 8 in 2024-02-05T07:28:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:29 smithi188 ceph-mon[33283]: osdmap e478: 8 total, 8 up, 8 in 2024-02-05T07:28:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-90"}]: dispatch 2024-02-05T07:28:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-90"}]: dispatch 2024-02-05T07:28:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:29 smithi188 ceph-mon[33283]: pgmap v726: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 6 op/s 2024-02-05T07:28:29.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:28:29.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:29.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[29861]: osdmap e478: 8 total, 8 up, 8 in 2024-02-05T07:28:29.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:29.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:29.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-90"}]: dispatch 2024-02-05T07:28:29.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-90"}]: dispatch 2024-02-05T07:28:29.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[29861]: pgmap v726: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 6 op/s 2024-02-05T07:28:29.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:28:29.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:29.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[41609]: osdmap e478: 8 total, 8 up, 8 in 2024-02-05T07:28:29.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:29.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:29.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-90"}]: dispatch 2024-02-05T07:28:29.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-90"}]: dispatch 2024-02-05T07:28:29.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[41609]: pgmap v726: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.0 KiB/s wr, 6 op/s 2024-02-05T07:28:29.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:28:30.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:30 smithi188 ceph-mon[33283]: osdmap e479: 8 total, 8 up, 8 in 2024-02-05T07:28:30.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:30 smithi184 ceph-mon[29861]: osdmap e479: 8 total, 8 up, 8 in 2024-02-05T07:28:30.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:30 smithi184 ceph-mon[41609]: osdmap e479: 8 total, 8 up, 8 in 2024-02-05T07:28:31.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:31 smithi188 ceph-mon[33283]: osdmap e480: 8 total, 8 up, 8 in 2024-02-05T07:28:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:31 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:31.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:31 smithi188 ceph-mon[33283]: pgmap v729: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:28:31.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:31 smithi184 ceph-mon[29861]: osdmap e480: 8 total, 8 up, 8 in 2024-02-05T07:28:31.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:31.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:31 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:31.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:31 smithi184 ceph-mon[29861]: pgmap v729: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:28:31.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:31 smithi184 ceph-mon[41609]: osdmap e480: 8 total, 8 up, 8 in 2024-02-05T07:28:31.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:31.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:31 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:31.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:31 smithi184 ceph-mon[41609]: pgmap v729: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:28:32.207 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:28:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:28:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:28:32.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:32 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:32.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:32 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:28:32.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:32 smithi188 ceph-mon[33283]: osdmap e481: 8 total, 8 up, 8 in 2024-02-05T07:28:32.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:28:32.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:32 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:32.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:32 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:28:32.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:32 smithi184 ceph-mon[29861]: osdmap e481: 8 total, 8 up, 8 in 2024-02-05T07:28:32.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:28:32.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:32 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:32.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:32 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:28:32.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:32 smithi184 ceph-mon[41609]: osdmap e481: 8 total, 8 up, 8 in 2024-02-05T07:28:32.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:28:33.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:33 smithi188 ceph-mon[33283]: osdmap e482: 8 total, 8 up, 8 in 2024-02-05T07:28:33.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:33 smithi188 ceph-mon[33283]: pgmap v732: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:28:33.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:33 smithi184 ceph-mon[41609]: osdmap e482: 8 total, 8 up, 8 in 2024-02-05T07:28:33.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:33 smithi184 ceph-mon[41609]: pgmap v732: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:28:33.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:33 smithi184 ceph-mon[29861]: osdmap e482: 8 total, 8 up, 8 in 2024-02-05T07:28:33.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:33 smithi184 ceph-mon[29861]: pgmap v732: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:28:34.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:34 smithi188 ceph-mon[33283]: osdmap e483: 8 total, 8 up, 8 in 2024-02-05T07:28:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:34 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-92"}]: dispatch 2024-02-05T07:28:34.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:34 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-92"}]: dispatch 2024-02-05T07:28:34.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:34 smithi184 ceph-mon[41609]: osdmap e483: 8 total, 8 up, 8 in 2024-02-05T07:28:34.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:34.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:34 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:34.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-92"}]: dispatch 2024-02-05T07:28:34.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:34 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-92"}]: dispatch 2024-02-05T07:28:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:34 smithi184 ceph-mon[29861]: osdmap e483: 8 total, 8 up, 8 in 2024-02-05T07:28:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:34 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-92"}]: dispatch 2024-02-05T07:28:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:34 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-92"}]: dispatch 2024-02-05T07:28:35.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:35 smithi188 ceph-mon[33283]: osdmap e484: 8 total, 8 up, 8 in 2024-02-05T07:28:35.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:35 smithi188 ceph-mon[33283]: pgmap v735: 292 pgs: 292 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:28:35.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:35 smithi188 ceph-mon[33283]: osdmap e485: 8 total, 8 up, 8 in 2024-02-05T07:28:35.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:35.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:35 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:35 smithi184 ceph-mon[29861]: osdmap e484: 8 total, 8 up, 8 in 2024-02-05T07:28:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:35 smithi184 ceph-mon[29861]: pgmap v735: 292 pgs: 292 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:28:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:35 smithi184 ceph-mon[29861]: osdmap e485: 8 total, 8 up, 8 in 2024-02-05T07:28:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:35 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:35.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:35 smithi184 ceph-mon[41609]: osdmap e484: 8 total, 8 up, 8 in 2024-02-05T07:28:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:35 smithi184 ceph-mon[41609]: pgmap v735: 292 pgs: 292 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:28:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:35 smithi184 ceph-mon[41609]: osdmap e485: 8 total, 8 up, 8 in 2024-02-05T07:28:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:35 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:28:37.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:37 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:28:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:37 smithi188 ceph-mon[33283]: osdmap e486: 8 total, 8 up, 8 in 2024-02-05T07:28:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:28:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:37 smithi188 ceph-mon[33283]: pgmap v738: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:28:37.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:37 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:28:37.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:37 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:28:37.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:37 smithi184 ceph-mon[29861]: osdmap e486: 8 total, 8 up, 8 in 2024-02-05T07:28:37.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:28:37.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:37 smithi184 ceph-mon[29861]: pgmap v738: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:28:37.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:37 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:28:37.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:37 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:28:37.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:37 smithi184 ceph-mon[41609]: osdmap e486: 8 total, 8 up, 8 in 2024-02-05T07:28:37.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:28:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:37 smithi184 ceph-mon[41609]: pgmap v738: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:28:37.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:37 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:28:38.240 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:28:37 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:28:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:38 smithi188 ceph-mon[33283]: osdmap e487: 8 total, 8 up, 8 in 2024-02-05T07:28:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:28:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:28:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:28:38.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:28:38.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:28:38.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[29861]: osdmap e487: 8 total, 8 up, 8 in 2024-02-05T07:28:38.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:28:38.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:28:38.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:28:38.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:28:38.522 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:28:38.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[41609]: osdmap e487: 8 total, 8 up, 8 in 2024-02-05T07:28:38.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-05T07:28:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:28:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:28:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:28:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:28:38.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:28:39.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:39 smithi188 ceph-mon[33283]: Adjusting osd_memory_target on smithi188 to 3248M 2024-02-05T07:28:39.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:39 smithi188 ceph-mon[33283]: Adjusting osd_memory_target on smithi184 to 3248M 2024-02-05T07:28:39.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:39.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:39 smithi188 ceph-mon[33283]: osdmap e488: 8 total, 8 up, 8 in 2024-02-05T07:28:39.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:39 smithi188 ceph-mon[33283]: pgmap v741: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-02-05T07:28:39.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:39 smithi184 ceph-mon[29861]: Adjusting osd_memory_target on smithi188 to 3248M 2024-02-05T07:28:39.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:39 smithi184 ceph-mon[29861]: Adjusting osd_memory_target on smithi184 to 3248M 2024-02-05T07:28:39.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:39.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:39 smithi184 ceph-mon[29861]: osdmap e488: 8 total, 8 up, 8 in 2024-02-05T07:28:39.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:39 smithi184 ceph-mon[29861]: pgmap v741: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-02-05T07:28:39.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:39 smithi184 ceph-mon[41609]: Adjusting osd_memory_target on smithi188 to 3248M 2024-02-05T07:28:39.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:39 smithi184 ceph-mon[41609]: Adjusting osd_memory_target on smithi184 to 3248M 2024-02-05T07:28:39.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:39.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:39 smithi184 ceph-mon[41609]: osdmap e488: 8 total, 8 up, 8 in 2024-02-05T07:28:39.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:39 smithi184 ceph-mon[41609]: pgmap v741: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 2.0 KiB/s wr, 3 op/s 2024-02-05T07:28:40.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:40 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:40.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:40 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:40.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:40 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:28:41.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:41 smithi184 ceph-mon[29861]: pgmap v742: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-02-05T07:28:41.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:41 smithi184 ceph-mon[41609]: pgmap v742: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-02-05T07:28:41.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:41 smithi188 ceph-mon[33283]: pgmap v742: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-02-05T07:28:42.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:28:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:28:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:28:43.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:43 smithi188 ceph-mon[33283]: pgmap v743: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-05T07:28:43.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:43 smithi184 ceph-mon[29861]: pgmap v743: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-05T07:28:43.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:43 smithi184 ceph-mon[41609]: pgmap v743: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.3 KiB/s wr, 2 op/s 2024-02-05T07:28:44.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:28:44.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:28:44.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:28:45.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:45 smithi188 ceph-mon[33283]: pgmap v744: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-05T07:28:45.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:45 smithi184 ceph-mon[29861]: pgmap v744: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-05T07:28:45.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:45 smithi184 ceph-mon[41609]: pgmap v744: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-05T07:28:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:47 smithi188 ceph-mon[33283]: pgmap v745: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1020 B/s wr, 4 op/s 2024-02-05T07:28:47.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:47 smithi184 ceph-mon[29861]: pgmap v745: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1020 B/s wr, 4 op/s 2024-02-05T07:28:47.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:47 smithi184 ceph-mon[41609]: pgmap v745: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 1020 B/s wr, 4 op/s 2024-02-05T07:28:48.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:28:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:28:49.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:49.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:49 smithi188 ceph-mon[33283]: pgmap v746: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 102 B/s wr, 2 op/s 2024-02-05T07:28:49.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:49 smithi188 ceph-mon[33283]: osdmap e489: 8 total, 8 up, 8 in 2024-02-05T07:28:49.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:49.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:49 smithi184 ceph-mon[29861]: pgmap v746: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 102 B/s wr, 2 op/s 2024-02-05T07:28:49.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:49 smithi184 ceph-mon[29861]: osdmap e489: 8 total, 8 up, 8 in 2024-02-05T07:28:49.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:49.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:49 smithi184 ceph-mon[41609]: pgmap v746: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 102 B/s wr, 2 op/s 2024-02-05T07:28:49.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:49 smithi184 ceph-mon[41609]: osdmap e489: 8 total, 8 up, 8 in 2024-02-05T07:28:51.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:50 smithi188 ceph-mon[33283]: pgmap v748: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 102 B/s wr, 2 op/s 2024-02-05T07:28:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:50 smithi184 ceph-mon[29861]: pgmap v748: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 102 B/s wr, 2 op/s 2024-02-05T07:28:51.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:50 smithi184 ceph-mon[41609]: pgmap v748: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 102 B/s wr, 2 op/s 2024-02-05T07:28:51.748 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:28:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=cleanup t=2024-02-05T07:28:51.297067494Z level=info msg="Completed cleanup jobs" duration=2.241953ms 2024-02-05T07:28:51.749 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:28:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=sqlstore.transactions t=2024-02-05T07:28:51.305342931Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-02-05T07:28:52.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:28:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:28:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:28:53.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:53 smithi188 ceph-mon[33283]: pgmap v749: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 102 B/s wr, 2 op/s 2024-02-05T07:28:53.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:53 smithi184 ceph-mon[29861]: pgmap v749: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 102 B/s wr, 2 op/s 2024-02-05T07:28:53.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:53 smithi184 ceph-mon[41609]: pgmap v749: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 102 B/s wr, 2 op/s 2024-02-05T07:28:55.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:55 smithi188 ceph-mon[33283]: pgmap v750: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:28:55.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:55 smithi188 ceph-mon[33283]: osdmap e490: 8 total, 8 up, 8 in 2024-02-05T07:28:55.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:55 smithi184 ceph-mon[29861]: pgmap v750: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:28:55.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:55 smithi184 ceph-mon[29861]: osdmap e490: 8 total, 8 up, 8 in 2024-02-05T07:28:55.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:55 smithi184 ceph-mon[41609]: pgmap v750: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:28:55.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:55 smithi184 ceph-mon[41609]: osdmap e490: 8 total, 8 up, 8 in 2024-02-05T07:28:57.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:57 smithi188 ceph-mon[33283]: pgmap v752: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:28:57.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:57 smithi184 ceph-mon[29861]: pgmap v752: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:28:57.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:57 smithi184 ceph-mon[41609]: pgmap v752: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:28:58.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:28:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:28:59.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:28:59.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:59 smithi188 ceph-mon[33283]: pgmap v753: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:28:59.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:59.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:28:59.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-94"}]: dispatch 2024-02-05T07:28:59.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:59 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-94"}]: dispatch 2024-02-05T07:28:59.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:28:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:29:00.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:00.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:59 smithi184 ceph-mon[41609]: pgmap v753: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:00.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:00.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:00.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-94"}]: dispatch 2024-02-05T07:29:00.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:59 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-94"}]: dispatch 2024-02-05T07:29:00.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:28:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:29:00.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:00.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:59 smithi184 ceph-mon[29861]: pgmap v753: 324 pgs: 324 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:00.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:00.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:00.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-94"}]: dispatch 2024-02-05T07:29:00.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:59 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-94"}]: dispatch 2024-02-05T07:29:00.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:28:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:29:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:00 smithi188 ceph-mon[33283]: osdmap e491: 8 total, 8 up, 8 in 2024-02-05T07:29:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:00 smithi188 ceph-mon[33283]: pgmap v755: 292 pgs: 292 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:29:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:00 smithi188 ceph-mon[33283]: osdmap e492: 8 total, 8 up, 8 in 2024-02-05T07:29:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:00 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:00 smithi184 ceph-mon[29861]: osdmap e491: 8 total, 8 up, 8 in 2024-02-05T07:29:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:00 smithi184 ceph-mon[29861]: pgmap v755: 292 pgs: 292 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:29:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:00 smithi184 ceph-mon[29861]: osdmap e492: 8 total, 8 up, 8 in 2024-02-05T07:29:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:00 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:00 smithi184 ceph-mon[41609]: osdmap e491: 8 total, 8 up, 8 in 2024-02-05T07:29:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:00 smithi184 ceph-mon[41609]: pgmap v755: 292 pgs: 292 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:29:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:00 smithi184 ceph-mon[41609]: osdmap e492: 8 total, 8 up, 8 in 2024-02-05T07:29:01.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:01.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:00 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:02.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:29:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:29:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:29:02.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:02 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:02 smithi188 ceph-mon[33283]: osdmap e493: 8 total, 8 up, 8 in 2024-02-05T07:29:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:29:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:02 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:02 smithi184 ceph-mon[29861]: osdmap e493: 8 total, 8 up, 8 in 2024-02-05T07:29:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:29:02.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:02 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:02.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:02 smithi184 ceph-mon[41609]: osdmap e493: 8 total, 8 up, 8 in 2024-02-05T07:29:02.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:29:03.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:03 smithi188 ceph-mon[33283]: pgmap v758: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:03.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:03 smithi188 ceph-mon[33283]: osdmap e494: 8 total, 8 up, 8 in 2024-02-05T07:29:03.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:03 smithi184 ceph-mon[29861]: pgmap v758: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:03.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:03 smithi184 ceph-mon[29861]: osdmap e494: 8 total, 8 up, 8 in 2024-02-05T07:29:03.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:03 smithi184 ceph-mon[41609]: pgmap v758: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 642 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:03.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:03 smithi184 ceph-mon[41609]: osdmap e494: 8 total, 8 up, 8 in 2024-02-05T07:29:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:05 smithi188 ceph-mon[33283]: pgmap v760: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-02-05T07:29:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:05 smithi184 ceph-mon[29861]: pgmap v760: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-02-05T07:29:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:05 smithi184 ceph-mon[41609]: pgmap v760: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-02-05T07:29:07.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:07 smithi188 ceph-mon[33283]: pgmap v761: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:29:07.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:07 smithi184 ceph-mon[29861]: pgmap v761: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:29:07.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:07 smithi184 ceph-mon[41609]: pgmap v761: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:29:08.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:29:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:29:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:09 smithi188 ceph-mon[33283]: pgmap v762: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 773 B/s wr, 2 op/s 2024-02-05T07:29:09.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:09.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:09 smithi184 ceph-mon[29861]: pgmap v762: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 773 B/s wr, 2 op/s 2024-02-05T07:29:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:09 smithi184 ceph-mon[41609]: pgmap v762: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 773 B/s wr, 2 op/s 2024-02-05T07:29:11.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:10 smithi188 ceph-mon[33283]: pgmap v763: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 687 B/s wr, 2 op/s 2024-02-05T07:29:11.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:10 smithi184 ceph-mon[29861]: pgmap v763: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 687 B/s wr, 2 op/s 2024-02-05T07:29:11.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:10 smithi184 ceph-mon[41609]: pgmap v763: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 687 B/s wr, 2 op/s 2024-02-05T07:29:12.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:29:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:29:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:29:12.748 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:29:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:29:12.369+0000 7f7cab1c1700 -1 snap_mapper.add_oid found existing snaps mapped on 100:e4918462:test-rados-api-smithi184-81478-97::foo:21, removing 2024-02-05T07:29:12.771 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:29:12 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-2[58237]: 2024-02-05T07:29:12.369+0000 7f259ddd7700 -1 snap_mapper.add_oid found existing snaps mapped on 100:e4918462:test-rados-api-smithi184-81478-97::foo:21, removing 2024-02-05T07:29:12.771 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:29:12 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3[64329]: 2024-02-05T07:29:12.369+0000 7f19da531700 -1 snap_mapper.add_oid found existing snaps mapped on 100:e4918462:test-rados-api-smithi184-81478-97::foo:21, removing 2024-02-05T07:29:13.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:13 smithi188 ceph-mon[33283]: pgmap v764: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 614 B/s wr, 2 op/s 2024-02-05T07:29:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:13 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-96"}]: dispatch 2024-02-05T07:29:13.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:13 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-96"}]: dispatch 2024-02-05T07:29:13.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:13 smithi184 ceph-mon[29861]: pgmap v764: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 614 B/s wr, 2 op/s 2024-02-05T07:29:13.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:13.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:13 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:13.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-96"}]: dispatch 2024-02-05T07:29:13.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:13 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-96"}]: dispatch 2024-02-05T07:29:13.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:13 smithi184 ceph-mon[41609]: pgmap v764: 324 pgs: 324 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 614 B/s wr, 2 op/s 2024-02-05T07:29:13.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:13.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:13 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:13.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-96"}]: dispatch 2024-02-05T07:29:13.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:13 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-96"}]: dispatch 2024-02-05T07:29:14.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:14 smithi188 ceph-mon[33283]: osdmap e495: 8 total, 8 up, 8 in 2024-02-05T07:29:14.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:14 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:29:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:14 smithi184 ceph-mon[29861]: osdmap e495: 8 total, 8 up, 8 in 2024-02-05T07:29:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:14 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:29:14.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:14 smithi184 ceph-mon[41609]: osdmap e495: 8 total, 8 up, 8 in 2024-02-05T07:29:14.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:14 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:29:15.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:15 smithi188 ceph-mon[33283]: pgmap v766: 292 pgs: 292 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-02-05T07:29:15.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:15 smithi188 ceph-mon[33283]: osdmap e496: 8 total, 8 up, 8 in 2024-02-05T07:29:15.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:15.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:15 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:15 smithi184 ceph-mon[29861]: pgmap v766: 292 pgs: 292 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-02-05T07:29:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:15 smithi184 ceph-mon[29861]: osdmap e496: 8 total, 8 up, 8 in 2024-02-05T07:29:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:15 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:15.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:15 smithi184 ceph-mon[41609]: pgmap v766: 292 pgs: 292 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 op/s 2024-02-05T07:29:15.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:15 smithi184 ceph-mon[41609]: osdmap e496: 8 total, 8 up, 8 in 2024-02-05T07:29:15.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:15.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:15 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:16.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:16 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:16.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:16 smithi188 ceph-mon[33283]: osdmap e497: 8 total, 8 up, 8 in 2024-02-05T07:29:16.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:29:16.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:16 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:29:16.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:16 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:16.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:16 smithi184 ceph-mon[29861]: osdmap e497: 8 total, 8 up, 8 in 2024-02-05T07:29:16.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:29:16.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:16 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:29:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:16 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:16 smithi184 ceph-mon[41609]: osdmap e497: 8 total, 8 up, 8 in 2024-02-05T07:29:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:29:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:16 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:29:17.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:17 smithi188 ceph-mon[33283]: pgmap v769: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:29:17.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:17 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:29:17.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:17 smithi188 ceph-mon[33283]: osdmap e498: 8 total, 8 up, 8 in 2024-02-05T07:29:17.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-98", "mode": "writeback"}]: dispatch 2024-02-05T07:29:17.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:17 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-98", "mode": "writeback"}]: dispatch 2024-02-05T07:29:17.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:17 smithi184 ceph-mon[29861]: pgmap v769: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:29:17.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:17 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:29:17.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:17 smithi184 ceph-mon[29861]: osdmap e498: 8 total, 8 up, 8 in 2024-02-05T07:29:17.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-98", "mode": "writeback"}]: dispatch 2024-02-05T07:29:17.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:17 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-98", "mode": "writeback"}]: dispatch 2024-02-05T07:29:17.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:17 smithi184 ceph-mon[41609]: pgmap v769: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:29:17.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:17 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:29:17.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:17 smithi184 ceph-mon[41609]: osdmap e498: 8 total, 8 up, 8 in 2024-02-05T07:29:17.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-98", "mode": "writeback"}]: dispatch 2024-02-05T07:29:17.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:17 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-98", "mode": "writeback"}]: dispatch 2024-02-05T07:29:18.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:29:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:29:18.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:18 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:29:18.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:18 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-98", "mode": "writeback"}]': finished 2024-02-05T07:29:18.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:18 smithi188 ceph-mon[33283]: osdmap e499: 8 total, 8 up, 8 in 2024-02-05T07:29:18.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-98"}]: dispatch 2024-02-05T07:29:18.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:18 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-98"}]: dispatch 2024-02-05T07:29:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:18 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:29:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:18 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-98", "mode": "writeback"}]': finished 2024-02-05T07:29:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:18 smithi184 ceph-mon[29861]: osdmap e499: 8 total, 8 up, 8 in 2024-02-05T07:29:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-98"}]: dispatch 2024-02-05T07:29:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:18 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-98"}]: dispatch 2024-02-05T07:29:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:18 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:29:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:18 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-98", "mode": "writeback"}]': finished 2024-02-05T07:29:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:18 smithi184 ceph-mon[41609]: osdmap e499: 8 total, 8 up, 8 in 2024-02-05T07:29:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-98"}]: dispatch 2024-02-05T07:29:18.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:18 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-98"}]: dispatch 2024-02-05T07:29:19.127 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c44660 2024-02-05T07:29:19.127 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c464f0 2024-02-05T07:29:19.127 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c46600 2024-02-05T07:29:19.127 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c46860 2024-02-05T07:29:19.127 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c46d10 2024-02-05T07:29:19.127 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c471a0 2024-02-05T07:29:19.127 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c472f0 2024-02-05T07:29:19.127 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c469b0 2024-02-05T07:29:19.127 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c46ae0 2024-02-05T07:29:19.127 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c45c80 2024-02-05T07:29:19.127 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c45dd0 2024-02-05T07:29:19.128 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c45f20 2024-02-05T07:29:19.128 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c47440 2024-02-05T07:29:19.128 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c478d0 2024-02-05T07:29:19.128 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c47a00 2024-02-05T07:29:19.128 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c47ff0 2024-02-05T07:29:19.128 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c47570 2024-02-05T07:29:19.128 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c46bf0 2024-02-05T07:29:19.128 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c40ca0 2024-02-05T07:29:19.128 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c476a0 2024-02-05T07:29:19.128 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c47b50 2024-02-05T07:29:19.128 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c47ca0 2024-02-05T07:29:19.128 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c47df0 2024-02-05T07:29:19.128 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c48100 2024-02-05T07:29:19.128 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c48590 2024-02-05T07:29:19.129 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c486c0 2024-02-05T07:29:19.129 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c48c90 2024-02-05T07:29:19.129 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c48230 2024-02-05T07:29:19.129 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c48360 2024-02-05T07:29:19.129 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c487f0 2024-02-05T07:29:19.129 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c48920 2024-02-05T07:29:19.129 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c48a50 2024-02-05T07:29:19.129 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c48b60 2024-02-05T07:29:19.129 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c49280 2024-02-05T07:29:19.129 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c48de0 2024-02-05T07:29:19.129 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c48f10 2024-02-05T07:29:19.129 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c49060 2024-02-05T07:29:19.129 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c493b0 2024-02-05T07:29:19.129 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c49840 2024-02-05T07:29:19.129 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c49970 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c49170 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c49aa0 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c49bf0 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c494e0 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c49610 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c4a1e0 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c49d40 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c49e70 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c49fa0 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c4a0d0 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 0x560254c4a7b0 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.130 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.131 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.132 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.132 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.132 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.132 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.132 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.132 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.132 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.132 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.132 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.132 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.132 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.132 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.132 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.133 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.133 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.133 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.133 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:29:19.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:19.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:19 smithi188 ceph-mon[33283]: pgmap v772: 324 pgs: 324 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:29:19.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:19 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-98"}]': finished 2024-02-05T07:29:19.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:19 smithi188 ceph-mon[33283]: osdmap e500: 8 total, 8 up, 8 in 2024-02-05T07:29:19.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:29:19.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:19 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:29:19.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:19.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:19 smithi184 ceph-mon[29861]: pgmap v772: 324 pgs: 324 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:29:19.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:19 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-98"}]': finished 2024-02-05T07:29:19.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:19 smithi184 ceph-mon[29861]: osdmap e500: 8 total, 8 up, 8 in 2024-02-05T07:29:19.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:29:19.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:19 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:29:19.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:19.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:19 smithi184 ceph-mon[41609]: pgmap v772: 324 pgs: 324 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:29:19.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:19 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-98"}]': finished 2024-02-05T07:29:19.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:19 smithi184 ceph-mon[41609]: osdmap e500: 8 total, 8 up, 8 in 2024-02-05T07:29:19.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:29:19.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:19 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:29:20.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:20 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:29:20.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:20 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:29:20.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:20 smithi188 ceph-mon[33283]: osdmap e501: 8 total, 8 up, 8 in 2024-02-05T07:29:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_count","val": "1"}]: dispatch 2024-02-05T07:29:20.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:20 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_count","val": "1"}]: dispatch 2024-02-05T07:29:20.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:20 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:29:20.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:20 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:29:20.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:20 smithi184 ceph-mon[29861]: osdmap e501: 8 total, 8 up, 8 in 2024-02-05T07:29:20.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_count","val": "1"}]: dispatch 2024-02-05T07:29:20.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:20 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_count","val": "1"}]: dispatch 2024-02-05T07:29:20.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:20 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:29:20.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:20 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:29:20.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:20 smithi184 ceph-mon[41609]: osdmap e501: 8 total, 8 up, 8 in 2024-02-05T07:29:20.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_count","val": "1"}]: dispatch 2024-02-05T07:29:20.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:20 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_count","val": "1"}]: dispatch 2024-02-05T07:29:21.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:21 smithi188 ceph-mon[33283]: pgmap v775: 324 pgs: 324 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:29:21.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:21 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_count","val": "1"}]': finished 2024-02-05T07:29:21.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:21 smithi188 ceph-mon[33283]: osdmap e502: 8 total, 8 up, 8 in 2024-02-05T07:29:21.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:29:21.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:21 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:29:21.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:21 smithi184 ceph-mon[29861]: pgmap v775: 324 pgs: 324 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:29:21.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:21 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_count","val": "1"}]': finished 2024-02-05T07:29:21.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:21 smithi184 ceph-mon[29861]: osdmap e502: 8 total, 8 up, 8 in 2024-02-05T07:29:21.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:29:21.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:21 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:29:21.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:21 smithi184 ceph-mon[41609]: pgmap v775: 324 pgs: 324 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:29:21.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:21 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_count","val": "1"}]': finished 2024-02-05T07:29:21.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:21 smithi184 ceph-mon[41609]: osdmap e502: 8 total, 8 up, 8 in 2024-02-05T07:29:21.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:29:21.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:21 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:29:22.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:29:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:29:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:29:22.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:22 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:29:22.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:22 smithi188 ceph-mon[33283]: osdmap e503: 8 total, 8 up, 8 in 2024-02-05T07:29:22.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "target_max_objects","val": "250"}]: dispatch 2024-02-05T07:29:22.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:22 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "target_max_objects","val": "250"}]: dispatch 2024-02-05T07:29:22.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:22 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:29:22.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:22 smithi184 ceph-mon[29861]: osdmap e503: 8 total, 8 up, 8 in 2024-02-05T07:29:22.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "target_max_objects","val": "250"}]: dispatch 2024-02-05T07:29:22.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:22 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "target_max_objects","val": "250"}]: dispatch 2024-02-05T07:29:22.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:22 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:29:22.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:22 smithi184 ceph-mon[41609]: osdmap e503: 8 total, 8 up, 8 in 2024-02-05T07:29:22.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "target_max_objects","val": "250"}]: dispatch 2024-02-05T07:29:22.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:22 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "target_max_objects","val": "250"}]: dispatch 2024-02-05T07:29:23.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:23 smithi188 ceph-mon[33283]: pgmap v778: 324 pgs: 324 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:23.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:23 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "target_max_objects","val": "250"}]': finished 2024-02-05T07:29:23.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:23 smithi188 ceph-mon[33283]: osdmap e504: 8 total, 8 up, 8 in 2024-02-05T07:29:23.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:23.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:23 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:23.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:23 smithi184 ceph-mon[29861]: pgmap v778: 324 pgs: 324 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:23.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:23 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "target_max_objects","val": "250"}]': finished 2024-02-05T07:29:23.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:23 smithi184 ceph-mon[29861]: osdmap e504: 8 total, 8 up, 8 in 2024-02-05T07:29:23.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:23.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:23 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:23.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:23 smithi184 ceph-mon[41609]: pgmap v778: 324 pgs: 324 active+clean; 8.4 MiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:23.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:23 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-98","var": "target_max_objects","val": "250"}]': finished 2024-02-05T07:29:23.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:23 smithi184 ceph-mon[41609]: osdmap e504: 8 total, 8 up, 8 in 2024-02-05T07:29:23.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:23.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:23 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:24.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:24 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:29:24.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:24 smithi188 ceph-mon[33283]: osdmap e505: 8 total, 8 up, 8 in 2024-02-05T07:29:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98"}]: dispatch 2024-02-05T07:29:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:24 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98"}]: dispatch 2024-02-05T07:29:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:24 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98"}]': finished 2024-02-05T07:29:24.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:24 smithi188 ceph-mon[33283]: osdmap e506: 8 total, 8 up, 8 in 2024-02-05T07:29:24.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:24 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:29:24.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:24 smithi184 ceph-mon[29861]: osdmap e505: 8 total, 8 up, 8 in 2024-02-05T07:29:24.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98"}]: dispatch 2024-02-05T07:29:24.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:24 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98"}]: dispatch 2024-02-05T07:29:24.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:24 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98"}]': finished 2024-02-05T07:29:24.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:24 smithi184 ceph-mon[29861]: osdmap e506: 8 total, 8 up, 8 in 2024-02-05T07:29:24.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:24 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:29:24.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:24 smithi184 ceph-mon[41609]: osdmap e505: 8 total, 8 up, 8 in 2024-02-05T07:29:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98"}]: dispatch 2024-02-05T07:29:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:24 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98"}]: dispatch 2024-02-05T07:29:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:24 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-98"}]': finished 2024-02-05T07:29:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:24 smithi184 ceph-mon[41609]: osdmap e506: 8 total, 8 up, 8 in 2024-02-05T07:29:25.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:25 smithi188 ceph-mon[33283]: pgmap v781: 324 pgs: 324 active+clean; 8.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:25.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:25 smithi184 ceph-mon[29861]: pgmap v781: 324 pgs: 324 active+clean; 8.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:25.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:25 smithi184 ceph-mon[41609]: pgmap v781: 324 pgs: 324 active+clean; 8.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:26.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:26 smithi188 ceph-mon[33283]: osdmap e507: 8 total, 8 up, 8 in 2024-02-05T07:29:26.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:26 smithi184 ceph-mon[29861]: osdmap e507: 8 total, 8 up, 8 in 2024-02-05T07:29:26.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:26 smithi184 ceph-mon[41609]: osdmap e507: 8 total, 8 up, 8 in 2024-02-05T07:29:27.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:27 smithi188 ceph-mon[33283]: pgmap v784: 292 pgs: 292 active+clean; 8.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:27.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:27 smithi188 ceph-mon[33283]: osdmap e508: 8 total, 8 up, 8 in 2024-02-05T07:29:27.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:27.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:27 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:27.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:27 smithi184 ceph-mon[29861]: pgmap v784: 292 pgs: 292 active+clean; 8.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:27.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:27 smithi184 ceph-mon[29861]: osdmap e508: 8 total, 8 up, 8 in 2024-02-05T07:29:27.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:27.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:27 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:27.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:27 smithi184 ceph-mon[41609]: pgmap v784: 292 pgs: 292 active+clean; 8.4 MiB data, 652 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:27.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:27 smithi184 ceph-mon[41609]: osdmap e508: 8 total, 8 up, 8 in 2024-02-05T07:29:27.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:27.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:27 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:28.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:29:27 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:29:28.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:28 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:28.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:28 smithi188 ceph-mon[33283]: osdmap e509: 8 total, 8 up, 8 in 2024-02-05T07:29:28.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:29:28.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:28 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:29:28.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:28 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:28.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:28 smithi184 ceph-mon[29861]: osdmap e509: 8 total, 8 up, 8 in 2024-02-05T07:29:28.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:29:28.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:28 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:29:28.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:28 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:28.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:28 smithi184 ceph-mon[41609]: osdmap e509: 8 total, 8 up, 8 in 2024-02-05T07:29:28.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:29:28.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:28 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:29:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:29 smithi188 ceph-mon[33283]: pgmap v787: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:29:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:29 smithi188 ceph-mon[33283]: osdmap e510: 8 total, 8 up, 8 in 2024-02-05T07:29:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-100"}]: dispatch 2024-02-05T07:29:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:29 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-100"}]: dispatch 2024-02-05T07:29:29.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:29:29.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:29.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:29 smithi184 ceph-mon[29861]: pgmap v787: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:29.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:29:29.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:29 smithi184 ceph-mon[29861]: osdmap e510: 8 total, 8 up, 8 in 2024-02-05T07:29:29.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-100"}]: dispatch 2024-02-05T07:29:29.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:29 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-100"}]: dispatch 2024-02-05T07:29:29.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:29:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:29 smithi184 ceph-mon[41609]: pgmap v787: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:29:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:29 smithi184 ceph-mon[41609]: osdmap e510: 8 total, 8 up, 8 in 2024-02-05T07:29:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-100"}]: dispatch 2024-02-05T07:29:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:29 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-100"}]: dispatch 2024-02-05T07:29:29.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:29:30.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:30 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-100"}]': finished 2024-02-05T07:29:30.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:30 smithi188 ceph-mon[33283]: osdmap e511: 8 total, 8 up, 8 in 2024-02-05T07:29:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-100", "mode": "writeback"}]: dispatch 2024-02-05T07:29:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:30 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-100", "mode": "writeback"}]: dispatch 2024-02-05T07:29:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:30 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:29:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:30 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-100", "mode": "writeback"}]': finished 2024-02-05T07:29:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:30 smithi188 ceph-mon[33283]: osdmap e512: 8 total, 8 up, 8 in 2024-02-05T07:29:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:29:30.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:30 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:29:30.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-100"}]': finished 2024-02-05T07:29:30.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[29861]: osdmap e511: 8 total, 8 up, 8 in 2024-02-05T07:29:30.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-100", "mode": "writeback"}]: dispatch 2024-02-05T07:29:30.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-100", "mode": "writeback"}]: dispatch 2024-02-05T07:29:30.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:29:30.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-100", "mode": "writeback"}]': finished 2024-02-05T07:29:30.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[29861]: osdmap e512: 8 total, 8 up, 8 in 2024-02-05T07:29:30.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:29:30.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:29:30.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-6", "overlaypool": "test-rados-api-smithi184-81478-100"}]': finished 2024-02-05T07:29:30.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[41609]: osdmap e511: 8 total, 8 up, 8 in 2024-02-05T07:29:30.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-100", "mode": "writeback"}]: dispatch 2024-02-05T07:29:30.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-100", "mode": "writeback"}]: dispatch 2024-02-05T07:29:30.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:29:30.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-100", "mode": "writeback"}]': finished 2024-02-05T07:29:30.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[41609]: osdmap e512: 8 total, 8 up, 8 in 2024-02-05T07:29:30.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:29:30.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:30 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:29:31.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:31 smithi188 ceph-mon[33283]: pgmap v790: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:31.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:31 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:29:31.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:31 smithi188 ceph-mon[33283]: osdmap e513: 8 total, 8 up, 8 in 2024-02-05T07:29:31.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:31 smithi184 ceph-mon[29861]: pgmap v790: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:31.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:31 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:29:31.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:31 smithi184 ceph-mon[29861]: osdmap e513: 8 total, 8 up, 8 in 2024-02-05T07:29:31.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:31 smithi184 ceph-mon[41609]: pgmap v790: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:31.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:31 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:29:31.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:31 smithi184 ceph-mon[41609]: osdmap e513: 8 total, 8 up, 8 in 2024-02-05T07:29:32.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:29:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:29:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:29:32.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:29:32.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:32 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:29:32.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:29:32.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:32 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:29:32.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:29:32.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:32 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:29:33.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:33 smithi188 ceph-mon[33283]: pgmap v793: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:33.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:33 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:29:33.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:33 smithi188 ceph-mon[33283]: osdmap e514: 8 total, 8 up, 8 in 2024-02-05T07:29:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:29:33.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:33 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:29:33.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:33 smithi184 ceph-mon[29861]: pgmap v793: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:33.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:33 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:29:33.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:33 smithi184 ceph-mon[29861]: osdmap e514: 8 total, 8 up, 8 in 2024-02-05T07:29:33.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:29:33.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:33 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:29:33.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:33 smithi184 ceph-mon[41609]: pgmap v793: 324 pgs: 324 active+clean; 8.4 MiB data, 653 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:33.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:33 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:29:33.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:33 smithi184 ceph-mon[41609]: osdmap e514: 8 total, 8 up, 8 in 2024-02-05T07:29:33.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:29:33.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:33 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:29:34.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:34 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:29:34.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:34 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-05T07:29:34.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:34 smithi184 ceph-mon[29861]: osdmap e515: 8 total, 8 up, 8 in 2024-02-05T07:29:34.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-02-05T07:29:34.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:34 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-02-05T07:29:34.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:34 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-02-05T07:29:34.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:34 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:29:34.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:34 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-05T07:29:34.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:34 smithi184 ceph-mon[41609]: osdmap e515: 8 total, 8 up, 8 in 2024-02-05T07:29:34.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-02-05T07:29:34.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:34 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-02-05T07:29:34.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:34 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-02-05T07:29:34.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:34 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:29:34.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:34 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-05T07:29:34.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:34 smithi188 ceph-mon[33283]: osdmap e515: 8 total, 8 up, 8 in 2024-02-05T07:29:34.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-02-05T07:29:34.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:34 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-02-05T07:29:34.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:34 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-02-05T07:29:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:35 smithi184 ceph-mon[29861]: pgmap v796: 324 pgs: 324 active+clean; 8.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:35 smithi184 ceph-mon[29861]: osdmap e516: 8 total, 8 up, 8 in 2024-02-05T07:29:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:35 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:35 smithi184 ceph-mon[41609]: pgmap v796: 324 pgs: 324 active+clean; 8.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:35 smithi184 ceph-mon[41609]: osdmap e516: 8 total, 8 up, 8 in 2024-02-05T07:29:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:35 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:35.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:35 smithi188 ceph-mon[33283]: pgmap v796: 324 pgs: 324 active+clean; 8.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:35.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:35 smithi188 ceph-mon[33283]: osdmap e516: 8 total, 8 up, 8 in 2024-02-05T07:29:35.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:35.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:35 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:36.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:36 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:29:36.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:36 smithi184 ceph-mon[29861]: osdmap e517: 8 total, 8 up, 8 in 2024-02-05T07:29:36.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100"}]: dispatch 2024-02-05T07:29:36.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:36 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100"}]: dispatch 2024-02-05T07:29:36.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:36 smithi184 ceph-mon[29861]: pgmap v799: 324 pgs: 324 active+clean; 8.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:36.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:36 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:29:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:36 smithi184 ceph-mon[41609]: osdmap e517: 8 total, 8 up, 8 in 2024-02-05T07:29:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100"}]: dispatch 2024-02-05T07:29:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:36 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100"}]: dispatch 2024-02-05T07:29:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:36 smithi184 ceph-mon[41609]: pgmap v799: 324 pgs: 324 active+clean; 8.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:36.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:36 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]': finished 2024-02-05T07:29:36.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:36 smithi188 ceph-mon[33283]: osdmap e517: 8 total, 8 up, 8 in 2024-02-05T07:29:36.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100"}]: dispatch 2024-02-05T07:29:36.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:36 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100"}]: dispatch 2024-02-05T07:29:36.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:36 smithi188 ceph-mon[33283]: pgmap v799: 324 pgs: 324 active+clean; 8.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:37.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:37 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100"}]': finished 2024-02-05T07:29:37.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:37 smithi184 ceph-mon[29861]: osdmap e518: 8 total, 8 up, 8 in 2024-02-05T07:29:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:37 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100"}]': finished 2024-02-05T07:29:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:37 smithi184 ceph-mon[41609]: osdmap e518: 8 total, 8 up, 8 in 2024-02-05T07:29:37.989 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:37 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-100"}]': finished 2024-02-05T07:29:37.989 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:37 smithi188 ceph-mon[33283]: osdmap e518: 8 total, 8 up, 8 in 2024-02-05T07:29:38.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:29:37 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:29:38.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:38 smithi188 ceph-mon[33283]: osdmap e519: 8 total, 8 up, 8 in 2024-02-05T07:29:38.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:29:38.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:38 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:38.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:38 smithi188 ceph-mon[33283]: pgmap v802: 292 pgs: 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:38.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:29:38.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:29:38.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:38 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:29:39.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:38 smithi184 ceph-mon[29861]: osdmap e519: 8 total, 8 up, 8 in 2024-02-05T07:29:39.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:29:39.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:38 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:39.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:38 smithi184 ceph-mon[29861]: pgmap v802: 292 pgs: 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:39.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:29:39.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:29:39.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:38 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:29:39.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:38 smithi184 ceph-mon[41609]: osdmap e519: 8 total, 8 up, 8 in 2024-02-05T07:29:39.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:29:39.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:38 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:39.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:38 smithi184 ceph-mon[41609]: pgmap v802: 292 pgs: 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:39.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:29:39.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:29:39.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:38 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:29:39.922 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:39 smithi184 ceph-mon[29861]: osdmap e520: 8 total, 8 up, 8 in 2024-02-05T07:29:39.922 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:39.922 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:39 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:39.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:39 smithi184 ceph-mon[41609]: osdmap e520: 8 total, 8 up, 8 in 2024-02-05T07:29:39.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:39.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:39 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:39.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:39 smithi188 ceph-mon[33283]: osdmap e520: 8 total, 8 up, 8 in 2024-02-05T07:29:39.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:39.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:39 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:40.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:40 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:40.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:40 smithi188 ceph-mon[33283]: osdmap e521: 8 total, 8 up, 8 in 2024-02-05T07:29:40.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:29:40.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:29:40.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:40 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:29:40.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:40 smithi188 ceph-mon[33283]: pgmap v805: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:40.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:40 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:29:40.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:40 smithi188 ceph-mon[33283]: osdmap e522: 8 total, 8 up, 8 in 2024-02-05T07:29:40.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:29:40.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:40 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:29:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[41609]: osdmap e521: 8 total, 8 up, 8 in 2024-02-05T07:29:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:29:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:29:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:29:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[41609]: pgmap v805: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:29:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[41609]: osdmap e522: 8 total, 8 up, 8 in 2024-02-05T07:29:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:29:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:29:41.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:41.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[29861]: osdmap e521: 8 total, 8 up, 8 in 2024-02-05T07:29:41.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-05T07:29:41.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:29:41.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-05T07:29:41.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[29861]: pgmap v805: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:41.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-05T07:29:41.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[29861]: osdmap e522: 8 total, 8 up, 8 in 2024-02-05T07:29:41.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:29:41.023 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:40 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-05T07:29:42.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:29:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:29:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:29:42.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:42 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-05T07:29:42.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:42 smithi188 ceph-mon[33283]: osdmap e523: 8 total, 8 up, 8 in 2024-02-05T07:29:42.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:29:42.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:42 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:29:42.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:42 smithi188 ceph-mon[33283]: pgmap v808: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:43.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:42 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-05T07:29:43.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:42 smithi184 ceph-mon[29861]: osdmap e523: 8 total, 8 up, 8 in 2024-02-05T07:29:43.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:29:43.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:42 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:29:43.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:42 smithi184 ceph-mon[29861]: pgmap v808: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:43.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:42 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-05T07:29:43.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:42 smithi184 ceph-mon[41609]: osdmap e523: 8 total, 8 up, 8 in 2024-02-05T07:29:43.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:29:43.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:42 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-05T07:29:43.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:42 smithi184 ceph-mon[41609]: pgmap v808: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 658 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:43.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:43 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:29:43.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:43 smithi188 ceph-mon[33283]: osdmap e524: 8 total, 8 up, 8 in 2024-02-05T07:29:43.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:43.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:43 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:43.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-102"}]: dispatch 2024-02-05T07:29:43.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:43 smithi188 ceph-mon[33283]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-102"}]: dispatch 2024-02-05T07:29:44.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:43 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:29:44.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:43 smithi184 ceph-mon[29861]: osdmap e524: 8 total, 8 up, 8 in 2024-02-05T07:29:44.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:44.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:43 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:44.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-102"}]: dispatch 2024-02-05T07:29:44.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:43 smithi184 ceph-mon[29861]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-102"}]: dispatch 2024-02-05T07:29:44.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:43 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-05T07:29:44.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:43 smithi184 ceph-mon[41609]: osdmap e524: 8 total, 8 up, 8 in 2024-02-05T07:29:44.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:44.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:43 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-6"}]: dispatch 2024-02-05T07:29:44.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1630307149' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-102"}]: dispatch 2024-02-05T07:29:44.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:43 smithi184 ceph-mon[41609]: from='client.35450 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-6", "tierpool": "test-rados-api-smithi184-81478-102"}]: dispatch 2024-02-05T07:29:44.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:44 smithi188 ceph-mon[33283]: osdmap e525: 8 total, 8 up, 8 in 2024-02-05T07:29:44.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:29:44.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:44 smithi188 ceph-mon[33283]: pgmap v811: 292 pgs: 292 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:45.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:44 smithi184 ceph-mon[29861]: osdmap e525: 8 total, 8 up, 8 in 2024-02-05T07:29:45.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:29:45.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:44 smithi184 ceph-mon[29861]: pgmap v811: 292 pgs: 292 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:45.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:44 smithi184 ceph-mon[41609]: osdmap e525: 8 total, 8 up, 8 in 2024-02-05T07:29:45.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:29:45.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:44 smithi184 ceph-mon[41609]: pgmap v811: 292 pgs: 292 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:45 smithi188 ceph-mon[33283]: osdmap e526: 8 total, 8 up, 8 in 2024-02-05T07:29:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi184-81478-104"}]: dispatch 2024-02-05T07:29:45.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi184-81478-104"}]: dispatch 2024-02-05T07:29:45.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi184-81478-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:29:46.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:45 smithi184 ceph-mon[29861]: osdmap e526: 8 total, 8 up, 8 in 2024-02-05T07:29:46.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi184-81478-104"}]: dispatch 2024-02-05T07:29:46.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi184-81478-104"}]: dispatch 2024-02-05T07:29:46.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi184-81478-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:29:46.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:45 smithi184 ceph-mon[41609]: osdmap e526: 8 total, 8 up, 8 in 2024-02-05T07:29:46.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi184-81478-104"}]: dispatch 2024-02-05T07:29:46.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi184-81478-104"}]: dispatch 2024-02-05T07:29:46.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi184-81478-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:29:46.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi184-81478-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:29:46.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:46 smithi188 ceph-mon[33283]: osdmap e527: 8 total, 8 up, 8 in 2024-02-05T07:29:46.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi184-81478-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi184-81478-104"}]: dispatch 2024-02-05T07:29:46.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:46 smithi188 ceph-mon[33283]: pgmap v814: 260 pgs: 260 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:47.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi184-81478-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:29:47.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:46 smithi184 ceph-mon[29861]: osdmap e527: 8 total, 8 up, 8 in 2024-02-05T07:29:47.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi184-81478-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi184-81478-104"}]: dispatch 2024-02-05T07:29:47.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:46 smithi184 ceph-mon[29861]: pgmap v814: 260 pgs: 260 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:47.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi184-81478-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:29:47.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:46 smithi184 ceph-mon[41609]: osdmap e527: 8 total, 8 up, 8 in 2024-02-05T07:29:47.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi184-81478-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi184-81478-104"}]: dispatch 2024-02-05T07:29:47.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:46 smithi184 ceph-mon[41609]: pgmap v814: 260 pgs: 260 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:47.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:47 smithi188 ceph-mon[33283]: osdmap e528: 8 total, 8 up, 8 in 2024-02-05T07:29:48.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:47 smithi184 ceph-mon[29861]: osdmap e528: 8 total, 8 up, 8 in 2024-02-05T07:29:48.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:47 smithi184 ceph-mon[41609]: osdmap e528: 8 total, 8 up, 8 in 2024-02-05T07:29:48.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:29:47 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:29:48.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:48 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi184-81478-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi184-81478-104"}]': finished 2024-02-05T07:29:48.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:48 smithi188 ceph-mon[33283]: osdmap e529: 8 total, 8 up, 8 in 2024-02-05T07:29:48.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:48 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:48.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:48 smithi188 ceph-mon[33283]: pgmap v817: 268 pgs: 8 unknown, 260 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:49.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:48 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi184-81478-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi184-81478-104"}]': finished 2024-02-05T07:29:49.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:48 smithi184 ceph-mon[29861]: osdmap e529: 8 total, 8 up, 8 in 2024-02-05T07:29:49.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:48 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:49.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:48 smithi184 ceph-mon[29861]: pgmap v817: 268 pgs: 8 unknown, 260 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:49.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:48 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi184-81478-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi184-81478-104"}]': finished 2024-02-05T07:29:49.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:48 smithi184 ceph-mon[41609]: osdmap e529: 8 total, 8 up, 8 in 2024-02-05T07:29:49.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:48 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:49.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:48 smithi184 ceph-mon[41609]: pgmap v817: 268 pgs: 8 unknown, 260 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:49 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:29:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:49 smithi188 ceph-mon[33283]: osdmap e530: 8 total, 8 up, 8 in 2024-02-05T07:29:50.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:49 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:29:50.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:49 smithi184 ceph-mon[29861]: osdmap e530: 8 total, 8 up, 8 in 2024-02-05T07:29:50.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:49 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:29:50.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:49 smithi184 ceph-mon[41609]: osdmap e530: 8 total, 8 up, 8 in 2024-02-05T07:29:50.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:50 smithi188 ceph-mon[33283]: osdmap e531: 8 total, 8 up, 8 in 2024-02-05T07:29:50.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:50.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:50 smithi188 ceph-mon[33283]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:50.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:50 smithi188 ceph-mon[33283]: pgmap v820: 300 pgs: 40 unknown, 260 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:51.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:50 smithi184 ceph-mon[29861]: osdmap e531: 8 total, 8 up, 8 in 2024-02-05T07:29:51.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:51.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:50 smithi184 ceph-mon[29861]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:51.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:50 smithi184 ceph-mon[29861]: pgmap v820: 300 pgs: 40 unknown, 260 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:51.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:50 smithi184 ceph-mon[41609]: osdmap e531: 8 total, 8 up, 8 in 2024-02-05T07:29:51.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:51.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:50 smithi184 ceph-mon[41609]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:51.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:50 smithi184 ceph-mon[41609]: pgmap v820: 300 pgs: 40 unknown, 260 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:29:51.881 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:51 smithi184 ceph-mon[29861]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:51.882 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:51 smithi184 ceph-mon[29861]: osdmap e532: 8 total, 8 up, 8 in 2024-02-05T07:29:51.882 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:51 smithi184 ceph-mon[41609]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:51.882 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:51 smithi184 ceph-mon[41609]: osdmap e532: 8 total, 8 up, 8 in 2024-02-05T07:29:51.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:51 smithi188 ceph-mon[33283]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:51.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:51 smithi188 ceph-mon[33283]: osdmap e532: 8 total, 8 up, 8 in 2024-02-05T07:29:52.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:29:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:29:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:29:52.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:52 smithi188 ceph-mon[33283]: osdmap e533: 8 total, 8 up, 8 in 2024-02-05T07:29:52.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:52.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:52 smithi188 ceph-mon[33283]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:52.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:52 smithi188 ceph-mon[33283]: pgmap v823: 332 pgs: 72 unknown, 260 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:53.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:52 smithi184 ceph-mon[29861]: osdmap e533: 8 total, 8 up, 8 in 2024-02-05T07:29:53.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:53.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:52 smithi184 ceph-mon[29861]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:53.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:52 smithi184 ceph-mon[29861]: pgmap v823: 332 pgs: 72 unknown, 260 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:53.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:52 smithi184 ceph-mon[41609]: osdmap e533: 8 total, 8 up, 8 in 2024-02-05T07:29:53.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:53.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:52 smithi184 ceph-mon[41609]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:29:53.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:52 smithi184 ceph-mon[41609]: pgmap v823: 332 pgs: 72 unknown, 260 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:29:53.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:53 smithi188 ceph-mon[33283]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:54.025 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:53 smithi188 ceph-mon[33283]: osdmap e534: 8 total, 8 up, 8 in 2024-02-05T07:29:54.025 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:53 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:54.025 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:53 smithi188 ceph-mon[33283]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:54.026 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:53 smithi184 ceph-mon[29861]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:54.026 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:53 smithi184 ceph-mon[29861]: osdmap e534: 8 total, 8 up, 8 in 2024-02-05T07:29:54.026 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:54.026 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:53 smithi184 ceph-mon[29861]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:54.026 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:53 smithi184 ceph-mon[41609]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:29:54.026 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:53 smithi184 ceph-mon[41609]: osdmap e534: 8 total, 8 up, 8 in 2024-02-05T07:29:54.027 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:53 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:54.027 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:53 smithi184 ceph-mon[41609]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:54.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:54 smithi188 ceph-mon[33283]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]': finished 2024-02-05T07:29:54.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:54 smithi188 ceph-mon[33283]: osdmap e535: 8 total, 8 up, 8 in 2024-02-05T07:29:54.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-107", "overlaypool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:54.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:54 smithi188 ceph-mon[33283]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-107", "overlaypool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:54.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:54 smithi188 ceph-mon[33283]: pgmap v826: 332 pgs: 32 creating+peering, 300 active+clean; 582 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:55.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:54 smithi184 ceph-mon[29861]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]': finished 2024-02-05T07:29:55.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:54 smithi184 ceph-mon[29861]: osdmap e535: 8 total, 8 up, 8 in 2024-02-05T07:29:55.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-107", "overlaypool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:55.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:54 smithi184 ceph-mon[29861]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-107", "overlaypool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:55.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:54 smithi184 ceph-mon[29861]: pgmap v826: 332 pgs: 32 creating+peering, 300 active+clean; 582 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:55.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:54 smithi184 ceph-mon[41609]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]': finished 2024-02-05T07:29:55.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:54 smithi184 ceph-mon[41609]: osdmap e535: 8 total, 8 up, 8 in 2024-02-05T07:29:55.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-107", "overlaypool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:55.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:54 smithi184 ceph-mon[41609]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-107", "overlaypool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:55.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:54 smithi184 ceph-mon[41609]: pgmap v826: 332 pgs: 32 creating+peering, 300 active+clean; 582 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:55.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:55 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:29:55.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:55 smithi188 ceph-mon[33283]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-107", "overlaypool": "test-rados-api-smithi184-81478-107-cache"}]': finished 2024-02-05T07:29:55.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:55 smithi188 ceph-mon[33283]: osdmap e536: 8 total, 8 up, 8 in 2024-02-05T07:29:55.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:55 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-107-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:29:55.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:55 smithi188 ceph-mon[33283]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-107-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:29:56.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:55 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:29:56.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:55 smithi184 ceph-mon[29861]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-107", "overlaypool": "test-rados-api-smithi184-81478-107-cache"}]': finished 2024-02-05T07:29:56.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:55 smithi184 ceph-mon[29861]: osdmap e536: 8 total, 8 up, 8 in 2024-02-05T07:29:56.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:55 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-107-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:29:56.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:55 smithi184 ceph-mon[29861]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-107-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:29:56.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:55 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:29:56.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:55 smithi184 ceph-mon[41609]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-107", "overlaypool": "test-rados-api-smithi184-81478-107-cache"}]': finished 2024-02-05T07:29:56.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:55 smithi184 ceph-mon[41609]: osdmap e536: 8 total, 8 up, 8 in 2024-02-05T07:29:56.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:55 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-107-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:29:56.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:55 smithi184 ceph-mon[41609]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-107-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:29:56.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:56 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:29:56.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:56 smithi188 ceph-mon[33283]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-107-cache", "mode": "writeback"}]': finished 2024-02-05T07:29:56.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:56 smithi188 ceph-mon[33283]: osdmap e537: 8 total, 8 up, 8 in 2024-02-05T07:29:56.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:56 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-107"}]: dispatch 2024-02-05T07:29:56.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:56 smithi188 ceph-mon[33283]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-107"}]: dispatch 2024-02-05T07:29:56.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:56 smithi188 ceph-mon[33283]: pgmap v829: 332 pgs: 32 creating+peering, 300 active+clean; 582 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:57.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:56 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:29:57.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:56 smithi184 ceph-mon[29861]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-107-cache", "mode": "writeback"}]': finished 2024-02-05T07:29:57.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:56 smithi184 ceph-mon[29861]: osdmap e537: 8 total, 8 up, 8 in 2024-02-05T07:29:57.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:56 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-107"}]: dispatch 2024-02-05T07:29:57.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:56 smithi184 ceph-mon[29861]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-107"}]: dispatch 2024-02-05T07:29:57.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:56 smithi184 ceph-mon[29861]: pgmap v829: 332 pgs: 32 creating+peering, 300 active+clean; 582 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:57.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:56 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:29:57.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:56 smithi184 ceph-mon[41609]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-107-cache", "mode": "writeback"}]': finished 2024-02-05T07:29:57.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:56 smithi184 ceph-mon[41609]: osdmap e537: 8 total, 8 up, 8 in 2024-02-05T07:29:57.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:56 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-107"}]: dispatch 2024-02-05T07:29:57.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:56 smithi184 ceph-mon[41609]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-107"}]: dispatch 2024-02-05T07:29:57.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:56 smithi184 ceph-mon[41609]: pgmap v829: 332 pgs: 32 creating+peering, 300 active+clean; 582 KiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:29:57.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:57 smithi188 ceph-mon[33283]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-107"}]': finished 2024-02-05T07:29:57.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:57 smithi188 ceph-mon[33283]: osdmap e538: 8 total, 8 up, 8 in 2024-02-05T07:29:57.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:57.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:57 smithi188 ceph-mon[33283]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:58.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:57 smithi184 ceph-mon[29861]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-107"}]': finished 2024-02-05T07:29:58.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:57 smithi184 ceph-mon[29861]: osdmap e538: 8 total, 8 up, 8 in 2024-02-05T07:29:58.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:58.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:57 smithi184 ceph-mon[29861]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:58.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:57 smithi184 ceph-mon[41609]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-107"}]': finished 2024-02-05T07:29:58.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:57 smithi184 ceph-mon[41609]: osdmap e538: 8 total, 8 up, 8 in 2024-02-05T07:29:58.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/282997819' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:58.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:57 smithi184 ceph-mon[41609]: from='client.26299 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]: dispatch 2024-02-05T07:29:58.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:29:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:29:58.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:58 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:29:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:58 smithi188 ceph-mon[33283]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]': finished 2024-02-05T07:29:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:58 smithi188 ceph-mon[33283]: osdmap e539: 8 total, 8 up, 8 in 2024-02-05T07:29:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:58 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:58 smithi188 ceph-mon[33283]: pgmap v832: 332 pgs: 332 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:29:58.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:58 smithi188 ceph-mon[33283]: osdmap e540: 8 total, 8 up, 8 in 2024-02-05T07:29:59.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:58 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:29:59.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:58 smithi184 ceph-mon[29861]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]': finished 2024-02-05T07:29:59.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:58 smithi184 ceph-mon[29861]: osdmap e539: 8 total, 8 up, 8 in 2024-02-05T07:29:59.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:58 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:59.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:58 smithi184 ceph-mon[29861]: pgmap v832: 332 pgs: 332 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:29:59.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:58 smithi184 ceph-mon[29861]: osdmap e540: 8 total, 8 up, 8 in 2024-02-05T07:29:59.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:58 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:29:59.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:58 smithi184 ceph-mon[41609]: from='client.26299 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-107", "tierpool": "test-rados-api-smithi184-81478-107-cache"}]': finished 2024-02-05T07:29:59.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:58 smithi184 ceph-mon[41609]: osdmap e539: 8 total, 8 up, 8 in 2024-02-05T07:29:59.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:58 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:29:59.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:58 smithi184 ceph-mon[41609]: pgmap v832: 332 pgs: 332 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:29:59.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:58 smithi184 ceph-mon[41609]: osdmap e540: 8 total, 8 up, 8 in 2024-02-05T07:29:59.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:29:59.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:29:59 smithi188 ceph-mon[33283]: osdmap e541: 8 total, 8 up, 8 in 2024-02-05T07:30:00.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:30:00.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:29:59 smithi184 ceph-mon[29861]: osdmap e541: 8 total, 8 up, 8 in 2024-02-05T07:30:00.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:30:00.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:29:59 smithi184 ceph-mon[41609]: osdmap e541: 8 total, 8 up, 8 in 2024-02-05T07:30:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81478-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:30:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:00 smithi188 ceph-mon[33283]: Health detail: HEALTH_WARN 5 pool(s) do not have an application enabled 2024-02-05T07:30:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:00 smithi188 ceph-mon[33283]: [WRN] POOL_APP_NOT_ENABLED: 5 pool(s) do not have an application enabled 2024-02-05T07:30:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:00 smithi188 ceph-mon[33283]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-05T07:30:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:00 smithi188 ceph-mon[33283]: application not enabled on pool 'poolrace.1804289383' 2024-02-05T07:30:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:00 smithi188 ceph-mon[33283]: application not enabled on pool 'SnapListsmithi184-82555-1' 2024-02-05T07:30:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:00 smithi188 ceph-mon[33283]: application not enabled on pool 'poolrace2.846930886' 2024-02-05T07:30:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:00 smithi188 ceph-mon[33283]: application not enabled on pool 'LibRadosTierECPP_smithi184-81478-104' 2024-02-05T07:30:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:00 smithi188 ceph-mon[33283]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-05T07:30:00.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:00 smithi188 ceph-mon[33283]: pgmap v835: 268 pgs: 268 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81478-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:30:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[29861]: Health detail: HEALTH_WARN 5 pool(s) do not have an application enabled 2024-02-05T07:30:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[29861]: [WRN] POOL_APP_NOT_ENABLED: 5 pool(s) do not have an application enabled 2024-02-05T07:30:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[29861]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-05T07:30:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[29861]: application not enabled on pool 'poolrace.1804289383' 2024-02-05T07:30:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[29861]: application not enabled on pool 'SnapListsmithi184-82555-1' 2024-02-05T07:30:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[29861]: application not enabled on pool 'poolrace2.846930886' 2024-02-05T07:30:01.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[29861]: application not enabled on pool 'LibRadosTierECPP_smithi184-81478-104' 2024-02-05T07:30:01.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[29861]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-05T07:30:01.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[29861]: pgmap v835: 268 pgs: 268 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:01.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:01.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:01.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81478-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:30:01.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[41609]: Health detail: HEALTH_WARN 5 pool(s) do not have an application enabled 2024-02-05T07:30:01.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[41609]: [WRN] POOL_APP_NOT_ENABLED: 5 pool(s) do not have an application enabled 2024-02-05T07:30:01.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[41609]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-05T07:30:01.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[41609]: application not enabled on pool 'poolrace.1804289383' 2024-02-05T07:30:01.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[41609]: application not enabled on pool 'SnapListsmithi184-82555-1' 2024-02-05T07:30:01.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[41609]: application not enabled on pool 'poolrace2.846930886' 2024-02-05T07:30:01.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[41609]: application not enabled on pool 'LibRadosTierECPP_smithi184-81478-104' 2024-02-05T07:30:01.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[41609]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-05T07:30:01.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:00 smithi184 ceph-mon[41609]: pgmap v835: 268 pgs: 268 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:02.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81478-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:30:02.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:01 smithi188 ceph-mon[33283]: osdmap e542: 8 total, 8 up, 8 in 2024-02-05T07:30:02.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81478-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:02.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81478-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:30:02.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:01 smithi184 ceph-mon[29861]: osdmap e542: 8 total, 8 up, 8 in 2024-02-05T07:30:02.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81478-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:02.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:30:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:30:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:30:02.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81478-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:30:02.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:01 smithi184 ceph-mon[41609]: osdmap e542: 8 total, 8 up, 8 in 2024-02-05T07:30:02.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81478-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:03.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:02 smithi188 ceph-mon[33283]: osdmap e543: 8 total, 8 up, 8 in 2024-02-05T07:30:03.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:02 smithi188 ceph-mon[33283]: pgmap v838: 268 pgs: 268 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:30:03.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81478-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81478-109"}]': finished 2024-02-05T07:30:03.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:02 smithi188 ceph-mon[33283]: osdmap e544: 8 total, 8 up, 8 in 2024-02-05T07:30:03.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:02 smithi184 ceph-mon[29861]: osdmap e543: 8 total, 8 up, 8 in 2024-02-05T07:30:03.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:02 smithi184 ceph-mon[29861]: pgmap v838: 268 pgs: 268 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:30:03.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81478-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81478-109"}]': finished 2024-02-05T07:30:03.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:02 smithi184 ceph-mon[29861]: osdmap e544: 8 total, 8 up, 8 in 2024-02-05T07:30:03.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:02 smithi184 ceph-mon[41609]: osdmap e543: 8 total, 8 up, 8 in 2024-02-05T07:30:03.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:02 smithi184 ceph-mon[41609]: pgmap v838: 268 pgs: 268 active+clean; 582 KiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:30:03.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81478-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81478-109"}]': finished 2024-02-05T07:30:03.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:02 smithi184 ceph-mon[41609]: osdmap e544: 8 total, 8 up, 8 in 2024-02-05T07:30:05.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:04 smithi188 ceph-mon[33283]: osdmap e545: 8 total, 8 up, 8 in 2024-02-05T07:30:05.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:04 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:30:05.000 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:04 smithi188 ceph-mon[33283]: pgmap v841: 308 pgs: 40 unknown, 268 active+clean; 582 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:05.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:04 smithi184 ceph-mon[29861]: osdmap e545: 8 total, 8 up, 8 in 2024-02-05T07:30:05.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:04 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:30:05.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:04 smithi184 ceph-mon[29861]: pgmap v841: 308 pgs: 40 unknown, 268 active+clean; 582 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:05.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:04 smithi184 ceph-mon[41609]: osdmap e545: 8 total, 8 up, 8 in 2024-02-05T07:30:05.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:04 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:30:05.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:04 smithi184 ceph-mon[41609]: pgmap v841: 308 pgs: 40 unknown, 268 active+clean; 582 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:05.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:05 smithi188 ceph-mon[33283]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:05.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:30:05.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:05 smithi188 ceph-mon[33283]: osdmap e546: 8 total, 8 up, 8 in 2024-02-05T07:30:05.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-109", "tierpool": "test-rados-api-smithi184-81478-109-cache"}]: dispatch 2024-02-05T07:30:06.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:05 smithi184 ceph-mon[29861]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:06.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:30:06.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:05 smithi184 ceph-mon[29861]: osdmap e546: 8 total, 8 up, 8 in 2024-02-05T07:30:06.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-109", "tierpool": "test-rados-api-smithi184-81478-109-cache"}]: dispatch 2024-02-05T07:30:06.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:05 smithi184 ceph-mon[41609]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:06.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:30:06.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:05 smithi184 ceph-mon[41609]: osdmap e546: 8 total, 8 up, 8 in 2024-02-05T07:30:06.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-109", "tierpool": "test-rados-api-smithi184-81478-109-cache"}]: dispatch 2024-02-05T07:30:06.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-109", "tierpool": "test-rados-api-smithi184-81478-109-cache"}]': finished 2024-02-05T07:30:06.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:06 smithi188 ceph-mon[33283]: osdmap e547: 8 total, 8 up, 8 in 2024-02-05T07:30:06.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-109", "overlaypool": "test-rados-api-smithi184-81478-109-cache"}]: dispatch 2024-02-05T07:30:06.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:06 smithi188 ceph-mon[33283]: pgmap v844: 308 pgs: 40 unknown, 268 active+clean; 582 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:06.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-109", "overlaypool": "test-rados-api-smithi184-81478-109-cache"}]': finished 2024-02-05T07:30:07.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-109", "tierpool": "test-rados-api-smithi184-81478-109-cache"}]': finished 2024-02-05T07:30:07.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:06 smithi184 ceph-mon[29861]: osdmap e547: 8 total, 8 up, 8 in 2024-02-05T07:30:07.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-109", "overlaypool": "test-rados-api-smithi184-81478-109-cache"}]: dispatch 2024-02-05T07:30:07.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:06 smithi184 ceph-mon[29861]: pgmap v844: 308 pgs: 40 unknown, 268 active+clean; 582 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:07.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-109", "overlaypool": "test-rados-api-smithi184-81478-109-cache"}]': finished 2024-02-05T07:30:07.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-109", "tierpool": "test-rados-api-smithi184-81478-109-cache"}]': finished 2024-02-05T07:30:07.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:06 smithi184 ceph-mon[41609]: osdmap e547: 8 total, 8 up, 8 in 2024-02-05T07:30:07.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-109", "overlaypool": "test-rados-api-smithi184-81478-109-cache"}]: dispatch 2024-02-05T07:30:07.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:06 smithi184 ceph-mon[41609]: pgmap v844: 308 pgs: 40 unknown, 268 active+clean; 582 KiB data, 603 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:07.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-109", "overlaypool": "test-rados-api-smithi184-81478-109-cache"}]': finished 2024-02-05T07:30:07.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:07 smithi188 ceph-mon[33283]: osdmap e548: 8 total, 8 up, 8 in 2024-02-05T07:30:07.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-109-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:30:07.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:07 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:30:07.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-109-cache", "mode": "writeback"}]': finished 2024-02-05T07:30:07.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:07 smithi188 ceph-mon[33283]: osdmap e549: 8 total, 8 up, 8 in 2024-02-05T07:30:07.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:30:08.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:07 smithi184 ceph-mon[29861]: osdmap e548: 8 total, 8 up, 8 in 2024-02-05T07:30:08.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-109-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:30:08.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:07 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:30:08.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-109-cache", "mode": "writeback"}]': finished 2024-02-05T07:30:08.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:07 smithi184 ceph-mon[29861]: osdmap e549: 8 total, 8 up, 8 in 2024-02-05T07:30:08.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:30:08.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:07 smithi184 ceph-mon[41609]: osdmap e548: 8 total, 8 up, 8 in 2024-02-05T07:30:08.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-109-cache", "mode": "writeback"}]: dispatch 2024-02-05T07:30:08.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:07 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:30:08.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-109-cache", "mode": "writeback"}]': finished 2024-02-05T07:30:08.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:07 smithi184 ceph-mon[41609]: osdmap e549: 8 total, 8 up, 8 in 2024-02-05T07:30:08.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:30:08.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:30:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:30:08.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:08 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:08.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:08 smithi188 ceph-mon[33283]: pgmap v847: 308 pgs: 308 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:08.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:30:08.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:08 smithi188 ceph-mon[33283]: osdmap e550: 8 total, 8 up, 8 in 2024-02-05T07:30:08.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:30:09.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:08 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:09.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:08 smithi184 ceph-mon[29861]: pgmap v847: 308 pgs: 308 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:09.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:30:09.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:08 smithi184 ceph-mon[29861]: osdmap e550: 8 total, 8 up, 8 in 2024-02-05T07:30:09.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:30:09.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:08 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:09.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:08 smithi184 ceph-mon[41609]: pgmap v847: 308 pgs: 308 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:09.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:30:09.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:08 smithi184 ceph-mon[41609]: osdmap e550: 8 total, 8 up, 8 in 2024-02-05T07:30:09.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:30:10.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:30:10.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:10 smithi188 ceph-mon[33283]: osdmap e551: 8 total, 8 up, 8 in 2024-02-05T07:30:10.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:30:10.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:10 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:10.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:10 smithi188 ceph-mon[33283]: pgmap v850: 308 pgs: 308 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:11.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:30:11.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:10 smithi184 ceph-mon[29861]: osdmap e551: 8 total, 8 up, 8 in 2024-02-05T07:30:11.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:30:11.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:10 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:11.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:10 smithi184 ceph-mon[29861]: pgmap v850: 308 pgs: 308 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:11.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:30:11.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:10 smithi184 ceph-mon[41609]: osdmap e551: 8 total, 8 up, 8 in 2024-02-05T07:30:11.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:30:11.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:10 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:11.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:10 smithi184 ceph-mon[41609]: pgmap v850: 308 pgs: 308 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:11 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:30:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-05T07:30:11.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:11 smithi188 ceph-mon[33283]: osdmap e552: 8 total, 8 up, 8 in 2024-02-05T07:30:11.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-02-05T07:30:11.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-02-05T07:30:12.021 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:30:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:30:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:30:12.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:11 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:30:12.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-05T07:30:12.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:11 smithi184 ceph-mon[29861]: osdmap e552: 8 total, 8 up, 8 in 2024-02-05T07:30:12.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-02-05T07:30:12.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-02-05T07:30:12.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:11 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:30:12.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-05T07:30:12.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:11 smithi184 ceph-mon[41609]: osdmap e552: 8 total, 8 up, 8 in 2024-02-05T07:30:12.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-02-05T07:30:12.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-02-05T07:30:12.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:12 smithi188 ceph-mon[33283]: osdmap e553: 8 total, 8 up, 8 in 2024-02-05T07:30:12.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:12.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:12 smithi188 ceph-mon[33283]: pgmap v853: 308 pgs: 308 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:30:13.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:12 smithi184 ceph-mon[29861]: osdmap e553: 8 total, 8 up, 8 in 2024-02-05T07:30:13.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:13.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:12 smithi184 ceph-mon[29861]: pgmap v853: 308 pgs: 308 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:30:13.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:12 smithi184 ceph-mon[41609]: osdmap e553: 8 total, 8 up, 8 in 2024-02-05T07:30:13.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:13.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:12 smithi184 ceph-mon[41609]: pgmap v853: 308 pgs: 308 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:30:13.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-109"}]': finished 2024-02-05T07:30:13.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:13 smithi188 ceph-mon[33283]: osdmap e554: 8 total, 8 up, 8 in 2024-02-05T07:30:13.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-109", "tierpool": "test-rados-api-smithi184-81478-109-cache"}]: dispatch 2024-02-05T07:30:14.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-109"}]': finished 2024-02-05T07:30:14.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:13 smithi184 ceph-mon[29861]: osdmap e554: 8 total, 8 up, 8 in 2024-02-05T07:30:14.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-109", "tierpool": "test-rados-api-smithi184-81478-109-cache"}]: dispatch 2024-02-05T07:30:14.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-109"}]': finished 2024-02-05T07:30:14.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:13 smithi184 ceph-mon[41609]: osdmap e554: 8 total, 8 up, 8 in 2024-02-05T07:30:14.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-109", "tierpool": "test-rados-api-smithi184-81478-109-cache"}]: dispatch 2024-02-05T07:30:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-109", "tierpool": "test-rados-api-smithi184-81478-109-cache"}]': finished 2024-02-05T07:30:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:14 smithi188 ceph-mon[33283]: osdmap e555: 8 total, 8 up, 8 in 2024-02-05T07:30:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:14 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:30:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:14 smithi188 ceph-mon[33283]: pgmap v856: 308 pgs: 308 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:30:15.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-109", "tierpool": "test-rados-api-smithi184-81478-109-cache"}]': finished 2024-02-05T07:30:15.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:14 smithi184 ceph-mon[29861]: osdmap e555: 8 total, 8 up, 8 in 2024-02-05T07:30:15.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:14 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:30:15.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:14 smithi184 ceph-mon[29861]: pgmap v856: 308 pgs: 308 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:30:15.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-109", "tierpool": "test-rados-api-smithi184-81478-109-cache"}]': finished 2024-02-05T07:30:15.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:14 smithi184 ceph-mon[41609]: osdmap e555: 8 total, 8 up, 8 in 2024-02-05T07:30:15.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:14 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:30:15.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:14 smithi184 ceph-mon[41609]: pgmap v856: 308 pgs: 308 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:30:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:15 smithi188 ceph-mon[33283]: osdmap e556: 8 total, 8 up, 8 in 2024-02-05T07:30:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:15 smithi188 ceph-mon[33283]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:15 smithi188 ceph-mon[33283]: osdmap e557: 8 total, 8 up, 8 in 2024-02-05T07:30:15.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:16.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:15 smithi184 ceph-mon[29861]: osdmap e556: 8 total, 8 up, 8 in 2024-02-05T07:30:16.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:15 smithi184 ceph-mon[29861]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:16.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:15 smithi184 ceph-mon[29861]: osdmap e557: 8 total, 8 up, 8 in 2024-02-05T07:30:16.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:15 smithi184 ceph-mon[41609]: osdmap e556: 8 total, 8 up, 8 in 2024-02-05T07:30:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:15 smithi184 ceph-mon[41609]: Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:15 smithi184 ceph-mon[41609]: osdmap e557: 8 total, 8 up, 8 in 2024-02-05T07:30:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:16 smithi188 ceph-mon[33283]: pgmap v859: 268 pgs: 268 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-109"}]': finished 2024-02-05T07:30:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:16 smithi188 ceph-mon[33283]: osdmap e558: 8 total, 8 up, 8 in 2024-02-05T07:30:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:17.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:16 smithi184 ceph-mon[29861]: pgmap v859: 268 pgs: 268 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:17.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-109"}]': finished 2024-02-05T07:30:17.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:16 smithi184 ceph-mon[29861]: osdmap e558: 8 total, 8 up, 8 in 2024-02-05T07:30:17.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:17.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:16 smithi184 ceph-mon[41609]: pgmap v859: 268 pgs: 268 active+clean; 582 KiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:17.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-109"}]': finished 2024-02-05T07:30:17.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:16 smithi184 ceph-mon[41609]: osdmap e558: 8 total, 8 up, 8 in 2024-02-05T07:30:17.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-109"}]: dispatch 2024-02-05T07:30:18.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:30:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:30:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-109"}]': finished 2024-02-05T07:30:18.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:18 smithi188 ceph-mon[33283]: osdmap e559: 8 total, 8 up, 8 in 2024-02-05T07:30:18.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:18 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:18.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:18 smithi188 ceph-mon[33283]: pgmap v862: 268 pgs: 268 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-05T07:30:19.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-109"}]': finished 2024-02-05T07:30:19.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:18 smithi184 ceph-mon[29861]: osdmap e559: 8 total, 8 up, 8 in 2024-02-05T07:30:19.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:18 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:19.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:18 smithi184 ceph-mon[29861]: pgmap v862: 268 pgs: 268 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-05T07:30:19.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3180723086' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-109"}]': finished 2024-02-05T07:30:19.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:18 smithi184 ceph-mon[41609]: osdmap e559: 8 total, 8 up, 8 in 2024-02-05T07:30:19.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:18 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:19.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:18 smithi184 ceph-mon[41609]: pgmap v862: 268 pgs: 268 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-05T07:30:19.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:19 smithi188 ceph-mon[33283]: osdmap e560: 8 total, 8 up, 8 in 2024-02-05T07:30:19.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi184-81478-104"}]: dispatch 2024-02-05T07:30:20.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:19 smithi184 ceph-mon[29861]: osdmap e560: 8 total, 8 up, 8 in 2024-02-05T07:30:20.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi184-81478-104"}]: dispatch 2024-02-05T07:30:20.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:19 smithi184 ceph-mon[41609]: osdmap e560: 8 total, 8 up, 8 in 2024-02-05T07:30:20.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi184-81478-104"}]: dispatch 2024-02-05T07:30:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi184-81478-104"}]': finished 2024-02-05T07:30:20.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:20 smithi188 ceph-mon[33283]: osdmap e561: 8 total, 8 up, 8 in 2024-02-05T07:30:20.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi184-81478-104"}]: dispatch 2024-02-05T07:30:20.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:20 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:20.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:20 smithi188 ceph-mon[33283]: pgmap v865: 260 pgs: 260 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-05T07:30:20.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi184-81478-104"}]': finished 2024-02-05T07:30:21.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi184-81478-104"}]': finished 2024-02-05T07:30:21.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:20 smithi184 ceph-mon[29861]: osdmap e561: 8 total, 8 up, 8 in 2024-02-05T07:30:21.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi184-81478-104"}]: dispatch 2024-02-05T07:30:21.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:20 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:21.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:20 smithi184 ceph-mon[29861]: pgmap v865: 260 pgs: 260 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-05T07:30:21.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi184-81478-104"}]': finished 2024-02-05T07:30:21.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi184-81478-104"}]': finished 2024-02-05T07:30:21.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:20 smithi184 ceph-mon[41609]: osdmap e561: 8 total, 8 up, 8 in 2024-02-05T07:30:21.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi184-81478-104"}]: dispatch 2024-02-05T07:30:21.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:20 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:21.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:20 smithi184 ceph-mon[41609]: pgmap v865: 260 pgs: 260 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-05T07:30:21.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/328631999' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi184-81478-104"}]': finished 2024-02-05T07:30:21.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:21 smithi188 ceph-mon[33283]: osdmap e562: 8 total, 8 up, 8 in 2024-02-05T07:30:21.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:30:21.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:30:21.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81478-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:30:22.021 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:30:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:30:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:30:22.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:21 smithi184 ceph-mon[29861]: osdmap e562: 8 total, 8 up, 8 in 2024-02-05T07:30:22.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:30:22.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:30:22.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81478-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:30:22.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:21 smithi184 ceph-mon[41609]: osdmap e562: 8 total, 8 up, 8 in 2024-02-05T07:30:22.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:30:22.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:30:22.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81478-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-05T07:30:23.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81478-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:30:23.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:22 smithi184 ceph-mon[29861]: osdmap e563: 8 total, 8 up, 8 in 2024-02-05T07:30:23.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81478-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:30:23.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:22 smithi184 ceph-mon[29861]: pgmap v868: 260 pgs: 260 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:30:23.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81478-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:30:23.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:22 smithi184 ceph-mon[41609]: osdmap e563: 8 total, 8 up, 8 in 2024-02-05T07:30:23.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81478-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:30:23.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:22 smithi184 ceph-mon[41609]: pgmap v868: 260 pgs: 260 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:30:23.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi184-81478-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-05T07:30:23.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:22 smithi188 ceph-mon[33283]: osdmap e563: 8 total, 8 up, 8 in 2024-02-05T07:30:23.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81478-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:30:23.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:22 smithi188 ceph-mon[33283]: pgmap v868: 260 pgs: 260 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:30:24.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:23 smithi184 ceph-mon[29861]: osdmap e564: 8 total, 8 up, 8 in 2024-02-05T07:30:24.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:23 smithi184 ceph-mon[41609]: osdmap e564: 8 total, 8 up, 8 in 2024-02-05T07:30:24.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:23 smithi188 ceph-mon[33283]: osdmap e564: 8 total, 8 up, 8 in 2024-02-05T07:30:25.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81478-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:30:25.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:24 smithi188 ceph-mon[33283]: osdmap e565: 8 total, 8 up, 8 in 2024-02-05T07:30:25.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:24 smithi188 ceph-mon[33283]: pgmap v871: 268 pgs: 8 unknown, 260 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:25.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81478-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:30:25.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:24 smithi184 ceph-mon[29861]: osdmap e565: 8 total, 8 up, 8 in 2024-02-05T07:30:25.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:24 smithi184 ceph-mon[29861]: pgmap v871: 268 pgs: 8 unknown, 260 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:25.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi184-81478-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:30:25.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:24 smithi184 ceph-mon[41609]: osdmap e565: 8 total, 8 up, 8 in 2024-02-05T07:30:25.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:24 smithi184 ceph-mon[41609]: pgmap v871: 268 pgs: 8 unknown, 260 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:26.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:25 smithi188 ceph-mon[33283]: osdmap e566: 8 total, 8 up, 8 in 2024-02-05T07:30:26.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:30:26.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:30:26.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:25 smithi188 ceph-mon[33283]: osdmap e567: 8 total, 8 up, 8 in 2024-02-05T07:30:26.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:25 smithi184 ceph-mon[29861]: osdmap e566: 8 total, 8 up, 8 in 2024-02-05T07:30:26.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:30:26.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:30:26.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:25 smithi184 ceph-mon[29861]: osdmap e567: 8 total, 8 up, 8 in 2024-02-05T07:30:26.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:25 smithi184 ceph-mon[41609]: osdmap e566: 8 total, 8 up, 8 in 2024-02-05T07:30:26.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:30:26.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:30:26.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:25 smithi184 ceph-mon[41609]: osdmap e567: 8 total, 8 up, 8 in 2024-02-05T07:30:27.149 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:30:27.149 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:26 smithi188 ceph-mon[33283]: pgmap v874: 300 pgs: 40 unknown, 260 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:27.149 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-112", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:30:27.149 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:26 smithi188 ceph-mon[33283]: osdmap e568: 8 total, 8 up, 8 in 2024-02-05T07:30:27.149 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-112"}]: dispatch 2024-02-05T07:30:27.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:30:27.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:26 smithi184 ceph-mon[29861]: pgmap v874: 300 pgs: 40 unknown, 260 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:27.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-112", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:30:27.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:26 smithi184 ceph-mon[29861]: osdmap e568: 8 total, 8 up, 8 in 2024-02-05T07:30:27.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-112"}]: dispatch 2024-02-05T07:30:27.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:30:27.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:26 smithi184 ceph-mon[41609]: pgmap v874: 300 pgs: 40 unknown, 260 active+clean; 582 KiB data, 605 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:27.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-112", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:30:27.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:26 smithi184 ceph-mon[41609]: osdmap e568: 8 total, 8 up, 8 in 2024-02-05T07:30:27.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-112"}]: dispatch 2024-02-05T07:30:28.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:30:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:30:29.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-112"}]': finished 2024-02-05T07:30:29.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:28 smithi184 ceph-mon[29861]: osdmap e569: 8 total, 8 up, 8 in 2024-02-05T07:30:29.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:30:29.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:28 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:29.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:28 smithi184 ceph-mon[29861]: pgmap v877: 300 pgs: 300 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-05T07:30:29.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-112"}]': finished 2024-02-05T07:30:29.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:28 smithi184 ceph-mon[41609]: osdmap e569: 8 total, 8 up, 8 in 2024-02-05T07:30:29.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:30:29.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:28 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:29.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:28 smithi184 ceph-mon[41609]: pgmap v877: 300 pgs: 300 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-05T07:30:29.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-112"}]': finished 2024-02-05T07:30:29.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:28 smithi188 ceph-mon[33283]: osdmap e569: 8 total, 8 up, 8 in 2024-02-05T07:30:29.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:30:29.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:28 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:29.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:28 smithi188 ceph-mon[33283]: pgmap v877: 300 pgs: 300 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-05T07:30:30.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:30:30.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:29 smithi188 ceph-mon[33283]: osdmap e570: 8 total, 8 up, 8 in 2024-02-05T07:30:30.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:29 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-112"}]: dispatch 2024-02-05T07:30:30.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:30:30.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:30:30.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:29 smithi184 ceph-mon[29861]: osdmap e570: 8 total, 8 up, 8 in 2024-02-05T07:30:30.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:29 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-112"}]: dispatch 2024-02-05T07:30:30.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:30:30.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:30:30.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:29 smithi184 ceph-mon[41609]: osdmap e570: 8 total, 8 up, 8 in 2024-02-05T07:30:30.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:29 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-112"}]: dispatch 2024-02-05T07:30:30.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:30:31.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-112"}]': finished 2024-02-05T07:30:31.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:30 smithi188 ceph-mon[33283]: osdmap e571: 8 total, 8 up, 8 in 2024-02-05T07:30:31.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:30 smithi188 ceph-mon[33283]: pgmap v880: 300 pgs: 300 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-05T07:30:31.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-112"}]': finished 2024-02-05T07:30:31.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:30 smithi184 ceph-mon[29861]: osdmap e571: 8 total, 8 up, 8 in 2024-02-05T07:30:31.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:30 smithi184 ceph-mon[29861]: pgmap v880: 300 pgs: 300 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-05T07:30:31.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-112"}]': finished 2024-02-05T07:30:31.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:30 smithi184 ceph-mon[41609]: osdmap e571: 8 total, 8 up, 8 in 2024-02-05T07:30:31.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:30 smithi184 ceph-mon[41609]: pgmap v880: 300 pgs: 300 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-05T07:30:32.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:31 smithi188 ceph-mon[33283]: osdmap e572: 8 total, 8 up, 8 in 2024-02-05T07:30:32.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:31 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:32.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:31 smithi184 ceph-mon[29861]: osdmap e572: 8 total, 8 up, 8 in 2024-02-05T07:30:32.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:31 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:32.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:31 smithi184 ceph-mon[41609]: osdmap e572: 8 total, 8 up, 8 in 2024-02-05T07:30:32.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:31 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:32.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:30:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:30:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:30:33.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:32 smithi188 ceph-mon[33283]: osdmap e573: 8 total, 8 up, 8 in 2024-02-05T07:30:33.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:30:33.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:32 smithi188 ceph-mon[33283]: pgmap v883: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:30:33.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:32 smithi184 ceph-mon[29861]: osdmap e573: 8 total, 8 up, 8 in 2024-02-05T07:30:33.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:30:33.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:32 smithi184 ceph-mon[29861]: pgmap v883: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:30:33.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:32 smithi184 ceph-mon[41609]: osdmap e573: 8 total, 8 up, 8 in 2024-02-05T07:30:33.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:30:33.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:32 smithi184 ceph-mon[41609]: pgmap v883: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:30:34.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:30:34.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:33 smithi188 ceph-mon[33283]: osdmap e574: 8 total, 8 up, 8 in 2024-02-05T07:30:34.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:30:34.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-114", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:30:34.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:33 smithi188 ceph-mon[33283]: osdmap e575: 8 total, 8 up, 8 in 2024-02-05T07:30:34.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-114"}]: dispatch 2024-02-05T07:30:34.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:30:34.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:33 smithi184 ceph-mon[29861]: osdmap e574: 8 total, 8 up, 8 in 2024-02-05T07:30:34.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:30:34.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-114", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:30:34.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:33 smithi184 ceph-mon[29861]: osdmap e575: 8 total, 8 up, 8 in 2024-02-05T07:30:34.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-114"}]: dispatch 2024-02-05T07:30:34.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:30:34.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:33 smithi184 ceph-mon[41609]: osdmap e574: 8 total, 8 up, 8 in 2024-02-05T07:30:34.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:30:34.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-114", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:30:34.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:33 smithi184 ceph-mon[41609]: osdmap e575: 8 total, 8 up, 8 in 2024-02-05T07:30:34.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-114"}]: dispatch 2024-02-05T07:30:35.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:34 smithi188 ceph-mon[33283]: pgmap v886: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-05T07:30:35.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-114"}]': finished 2024-02-05T07:30:35.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:34 smithi188 ceph-mon[33283]: osdmap e576: 8 total, 8 up, 8 in 2024-02-05T07:30:35.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-114", "mode": "writeback"}]: dispatch 2024-02-05T07:30:35.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:34 smithi184 ceph-mon[29861]: pgmap v886: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-05T07:30:35.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-114"}]': finished 2024-02-05T07:30:35.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:34 smithi184 ceph-mon[29861]: osdmap e576: 8 total, 8 up, 8 in 2024-02-05T07:30:35.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-114", "mode": "writeback"}]: dispatch 2024-02-05T07:30:35.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:34 smithi184 ceph-mon[41609]: pgmap v886: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-05T07:30:35.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-114"}]': finished 2024-02-05T07:30:35.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:34 smithi184 ceph-mon[41609]: osdmap e576: 8 total, 8 up, 8 in 2024-02-05T07:30:35.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-114", "mode": "writeback"}]: dispatch 2024-02-05T07:30:36.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:35 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:30:36.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-114", "mode": "writeback"}]': finished 2024-02-05T07:30:36.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:35 smithi188 ceph-mon[33283]: osdmap e577: 8 total, 8 up, 8 in 2024-02-05T07:30:36.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:30:36.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:35 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:30:36.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-114", "mode": "writeback"}]': finished 2024-02-05T07:30:36.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:35 smithi184 ceph-mon[29861]: osdmap e577: 8 total, 8 up, 8 in 2024-02-05T07:30:36.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:30:36.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:35 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:30:36.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-114", "mode": "writeback"}]': finished 2024-02-05T07:30:36.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:35 smithi184 ceph-mon[41609]: osdmap e577: 8 total, 8 up, 8 in 2024-02-05T07:30:36.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:30:37.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:36 smithi188 ceph-mon[33283]: pgmap v889: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-05T07:30:37.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:30:37.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:36 smithi188 ceph-mon[33283]: osdmap e578: 8 total, 8 up, 8 in 2024-02-05T07:30:37.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-114"}]: dispatch 2024-02-05T07:30:37.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:36 smithi184 ceph-mon[29861]: pgmap v889: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-05T07:30:37.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:30:37.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:36 smithi184 ceph-mon[29861]: osdmap e578: 8 total, 8 up, 8 in 2024-02-05T07:30:37.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-114"}]: dispatch 2024-02-05T07:30:37.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:36 smithi184 ceph-mon[41609]: pgmap v889: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-05T07:30:37.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:30:37.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:36 smithi184 ceph-mon[41609]: osdmap e578: 8 total, 8 up, 8 in 2024-02-05T07:30:37.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-114"}]: dispatch 2024-02-05T07:30:37.924 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:37 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:30:37.924 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-114"}]': finished 2024-02-05T07:30:37.925 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:37 smithi184 ceph-mon[29861]: osdmap e579: 8 total, 8 up, 8 in 2024-02-05T07:30:37.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:37 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:30:37.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-114"}]': finished 2024-02-05T07:30:37.925 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:37 smithi184 ceph-mon[41609]: osdmap e579: 8 total, 8 up, 8 in 2024-02-05T07:30:38.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:37 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:30:38.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-114"}]': finished 2024-02-05T07:30:38.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:37 smithi188 ceph-mon[33283]: osdmap e579: 8 total, 8 up, 8 in 2024-02-05T07:30:38.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:30:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:30:39.387 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:39.387 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:39 smithi188 ceph-mon[33283]: pgmap v892: 300 pgs: 300 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:30:39.387 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:39 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:30:39.387 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:39 smithi188 ceph-mon[33283]: osdmap e580: 8 total, 8 up, 8 in 2024-02-05T07:30:39.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:39.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:39 smithi184 ceph-mon[29861]: pgmap v892: 300 pgs: 300 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:30:39.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:39 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:30:39.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:39 smithi184 ceph-mon[29861]: osdmap e580: 8 total, 8 up, 8 in 2024-02-05T07:30:39.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:39.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:39 smithi184 ceph-mon[41609]: pgmap v892: 300 pgs: 300 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-05T07:30:39.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:39 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:30:39.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:39 smithi184 ceph-mon[41609]: osdmap e580: 8 total, 8 up, 8 in 2024-02-05T07:30:40.334 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:40 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:40.334 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:40 smithi184 ceph-mon[29861]: osdmap e581: 8 total, 8 up, 8 in 2024-02-05T07:30:40.334 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:30:40.334 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:40 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:40.334 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:40 smithi184 ceph-mon[41609]: osdmap e581: 8 total, 8 up, 8 in 2024-02-05T07:30:40.334 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:30:40.399 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:40 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:40.400 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:40 smithi188 ceph-mon[33283]: osdmap e581: 8 total, 8 up, 8 in 2024-02-05T07:30:40.400 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:30:41.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:41 smithi188 ceph-mon[33283]: pgmap v895: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:30:41.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:30:41.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:41 smithi188 ceph-mon[33283]: osdmap e582: 8 total, 8 up, 8 in 2024-02-05T07:30:41.338 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:41 smithi184 ceph-mon[29861]: pgmap v895: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:30:41.338 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:30:41.338 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:41 smithi184 ceph-mon[29861]: osdmap e582: 8 total, 8 up, 8 in 2024-02-05T07:30:41.338 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:41 smithi184 ceph-mon[41609]: pgmap v895: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:30:41.339 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:30:41.339 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:41 smithi184 ceph-mon[41609]: osdmap e582: 8 total, 8 up, 8 in 2024-02-05T07:30:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:30:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:30:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:30:43.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:42 smithi188 ceph-mon[33283]: osdmap e583: 8 total, 8 up, 8 in 2024-02-05T07:30:43.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:30:43.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:42 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:43.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:42 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:43.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:42 smithi188 ceph-mon[33283]: pgmap v898: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:30:43.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:42 smithi184 ceph-mon[29861]: osdmap e583: 8 total, 8 up, 8 in 2024-02-05T07:30:43.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:30:43.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:42 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:43.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:42 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:43.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:42 smithi184 ceph-mon[29861]: pgmap v898: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:30:43.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:42 smithi184 ceph-mon[41609]: osdmap e583: 8 total, 8 up, 8 in 2024-02-05T07:30:43.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:30:43.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:42 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:43.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:42 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:43.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:42 smithi184 ceph-mon[41609]: pgmap v898: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:30:44.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-116", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:30:44.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:43 smithi188 ceph-mon[33283]: osdmap e584: 8 total, 8 up, 8 in 2024-02-05T07:30:44.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-116"}]: dispatch 2024-02-05T07:30:44.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:43 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:44.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:43 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-116"}]': finished 2024-02-05T07:30:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:43 smithi188 ceph-mon[33283]: osdmap e585: 8 total, 8 up, 8 in 2024-02-05T07:30:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-116", "mode": "writeback"}]: dispatch 2024-02-05T07:30:44.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-116", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:30:44.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[41609]: osdmap e584: 8 total, 8 up, 8 in 2024-02-05T07:30:44.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-116"}]: dispatch 2024-02-05T07:30:44.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:44.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:44.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-116"}]': finished 2024-02-05T07:30:44.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[41609]: osdmap e585: 8 total, 8 up, 8 in 2024-02-05T07:30:44.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-116", "mode": "writeback"}]: dispatch 2024-02-05T07:30:44.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-116", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:30:44.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[29861]: osdmap e584: 8 total, 8 up, 8 in 2024-02-05T07:30:44.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-116"}]: dispatch 2024-02-05T07:30:44.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:44.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:44.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-116"}]': finished 2024-02-05T07:30:44.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[29861]: osdmap e585: 8 total, 8 up, 8 in 2024-02-05T07:30:44.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-116", "mode": "writeback"}]: dispatch 2024-02-05T07:30:45.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:30:45.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:30:45.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:30:45.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:45.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:44 smithi188 ceph-mon[33283]: pgmap v901: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-05T07:30:45.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:44 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:30:45.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:44 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-116", "mode": "writeback"}]': finished 2024-02-05T07:30:45.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:44 smithi188 ceph-mon[33283]: osdmap e586: 8 total, 8 up, 8 in 2024-02-05T07:30:45.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:30:45.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:30:45.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:30:45.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:45.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[29861]: pgmap v901: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-05T07:30:45.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:30:45.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-116", "mode": "writeback"}]': finished 2024-02-05T07:30:45.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[29861]: osdmap e586: 8 total, 8 up, 8 in 2024-02-05T07:30:45.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:30:45.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:30:45.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:30:45.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:45.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[41609]: pgmap v901: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-05T07:30:45.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:30:45.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-116", "mode": "writeback"}]': finished 2024-02-05T07:30:45.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:44 smithi184 ceph-mon[41609]: osdmap e586: 8 total, 8 up, 8 in 2024-02-05T07:30:46.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "315.5"}]: dispatch 2024-02-05T07:30:46.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:45 smithi188 ceph-mon[33283]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "315.5"}]: dispatch 2024-02-05T07:30:46.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:45 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:46.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "315.5"}]: dispatch 2024-02-05T07:30:46.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:45 smithi184 ceph-mon[29861]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "315.5"}]: dispatch 2024-02-05T07:30:46.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:45 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:46.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "315.5"}]: dispatch 2024-02-05T07:30:46.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:45 smithi184 ceph-mon[41609]: from='mon.0 v1:172.21.15.184:0/3472040155' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "315.5"}]: dispatch 2024-02-05T07:30:46.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:45 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:30:47.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:46 smithi188 ceph-mon[33283]: 315.5 scrub starts 2024-02-05T07:30:47.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:46 smithi188 ceph-mon[33283]: 315.5 scrub ok 2024-02-05T07:30:47.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:46 smithi188 ceph-mon[33283]: pgmap v903: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-02-05T07:30:47.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:46 smithi184 ceph-mon[29861]: 315.5 scrub starts 2024-02-05T07:30:47.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:46 smithi184 ceph-mon[29861]: 315.5 scrub ok 2024-02-05T07:30:47.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:46 smithi184 ceph-mon[29861]: pgmap v903: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-02-05T07:30:47.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:46 smithi184 ceph-mon[41609]: 315.5 scrub starts 2024-02-05T07:30:47.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:46 smithi184 ceph-mon[41609]: 315.5 scrub ok 2024-02-05T07:30:47.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:46 smithi184 ceph-mon[41609]: pgmap v903: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.6 KiB/s wr, 2 op/s 2024-02-05T07:30:48.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:30:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:30:49.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:49.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:49 smithi188 ceph-mon[33283]: pgmap v904: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-02-05T07:30:49.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:49.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:49 smithi184 ceph-mon[29861]: pgmap v904: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-02-05T07:30:49.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:49.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:49 smithi184 ceph-mon[41609]: pgmap v904: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-02-05T07:30:51.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:50 smithi188 ceph-mon[33283]: pgmap v905: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 956 B/s rd, 1 op/s 2024-02-05T07:30:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:50 smithi184 ceph-mon[29861]: pgmap v905: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 956 B/s rd, 1 op/s 2024-02-05T07:30:51.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:50 smithi184 ceph-mon[41609]: pgmap v905: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 956 B/s rd, 1 op/s 2024-02-05T07:30:52.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:30:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:30:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:30:53.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:53 smithi188 ceph-mon[33283]: pgmap v906: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 843 B/s rd, 1 op/s 2024-02-05T07:30:53.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:53 smithi184 ceph-mon[29861]: pgmap v906: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 843 B/s rd, 1 op/s 2024-02-05T07:30:53.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:53 smithi184 ceph-mon[41609]: pgmap v906: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 843 B/s rd, 1 op/s 2024-02-05T07:30:55.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:55 smithi188 ceph-mon[33283]: pgmap v907: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:55.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:55 smithi184 ceph-mon[29861]: pgmap v907: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:55.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:55 smithi184 ceph-mon[41609]: pgmap v907: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:30:57.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:57 smithi188 ceph-mon[33283]: pgmap v908: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-05T07:30:57.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.14", "id": [2, 1]}]: dispatch 2024-02-05T07:30:57.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.16", "id": [2, 0]}]: dispatch 2024-02-05T07:30:57.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.18", "id": [7, 1]}]: dispatch 2024-02-05T07:30:57.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.1a", "id": [2, 0]}]: dispatch 2024-02-05T07:30:57.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:57 smithi184 ceph-mon[29861]: pgmap v908: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-05T07:30:57.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.14", "id": [2, 1]}]: dispatch 2024-02-05T07:30:57.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.16", "id": [2, 0]}]: dispatch 2024-02-05T07:30:57.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.18", "id": [7, 1]}]: dispatch 2024-02-05T07:30:57.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.1a", "id": [2, 0]}]: dispatch 2024-02-05T07:30:57.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:57 smithi184 ceph-mon[41609]: pgmap v908: 300 pgs: 300 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-05T07:30:57.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.14", "id": [2, 1]}]: dispatch 2024-02-05T07:30:57.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.16", "id": [2, 0]}]: dispatch 2024-02-05T07:30:57.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.18", "id": [7, 1]}]: dispatch 2024-02-05T07:30:57.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.1a", "id": [2, 0]}]: dispatch 2024-02-05T07:30:58.138 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.138 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.139 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.139 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.139 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.139 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.139 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.139 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.139 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.139 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.139 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.139 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.139 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.139 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.139 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.140 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.140 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.140 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.140 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.140 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.140 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.140 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.140 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.140 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.140 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.140 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.140 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.140 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.141 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.142 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.142 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.142 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.142 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.142 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.142 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.142 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.142 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.142 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.142 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.142 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.142 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.142 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.142 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.143 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.144 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.144 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.144 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.144 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.144 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.144 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.144 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.144 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.144 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.144 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.144 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.144 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.144 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.145 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.145 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.145 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.145 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.145 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.145 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.145 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.145 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.145 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.145 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.146 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.146 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:30:58.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:30:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:30:58.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.14", "id": [2, 1]}]': finished 2024-02-05T07:30:58.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.16", "id": [2, 0]}]': finished 2024-02-05T07:30:58.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.18", "id": [7, 1]}]': finished 2024-02-05T07:30:58.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.1a", "id": [2, 0]}]': finished 2024-02-05T07:30:58.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:58 smithi188 ceph-mon[33283]: osdmap e587: 8 total, 8 up, 8 in 2024-02-05T07:30:58.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.14", "id": [2, 1]}]': finished 2024-02-05T07:30:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.16", "id": [2, 0]}]': finished 2024-02-05T07:30:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.18", "id": [7, 1]}]': finished 2024-02-05T07:30:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.1a", "id": [2, 0]}]': finished 2024-02-05T07:30:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:58 smithi184 ceph-mon[29861]: osdmap e587: 8 total, 8 up, 8 in 2024-02-05T07:30:58.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.14", "id": [2, 1]}]': finished 2024-02-05T07:30:58.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.16", "id": [2, 0]}]': finished 2024-02-05T07:30:58.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.18", "id": [7, 1]}]': finished 2024-02-05T07:30:58.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "315.1a", "id": [2, 0]}]': finished 2024-02-05T07:30:58.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:58 smithi184 ceph-mon[41609]: osdmap e587: 8 total, 8 up, 8 in 2024-02-05T07:30:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:59 smithi188 ceph-mon[33283]: pgmap v910: 300 pgs: 4 peering, 296 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:30:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:59 smithi188 ceph-mon[33283]: osdmap e588: 8 total, 8 up, 8 in 2024-02-05T07:30:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:59.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:30:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:30:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:59 smithi184 ceph-mon[29861]: pgmap v910: 300 pgs: 4 peering, 296 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:30:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:59 smithi184 ceph-mon[29861]: osdmap e588: 8 total, 8 up, 8 in 2024-02-05T07:30:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:30:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:30:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:30:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:59 smithi184 ceph-mon[41609]: pgmap v910: 300 pgs: 4 peering, 296 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:30:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:59 smithi184 ceph-mon[41609]: osdmap e588: 8 total, 8 up, 8 in 2024-02-05T07:30:59.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:30:59.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:30:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:31:01.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:01 smithi188 ceph-mon[33283]: pgmap v912: 300 pgs: 4 peering, 296 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:01.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:01 smithi188 ceph-mon[33283]: osdmap e589: 8 total, 8 up, 8 in 2024-02-05T07:31:01.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:01.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:01 smithi184 ceph-mon[41609]: pgmap v912: 300 pgs: 4 peering, 296 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:01.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:01 smithi184 ceph-mon[41609]: osdmap e589: 8 total, 8 up, 8 in 2024-02-05T07:31:01.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:01.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:01 smithi184 ceph-mon[29861]: pgmap v912: 300 pgs: 4 peering, 296 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:01.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:01 smithi184 ceph-mon[29861]: osdmap e589: 8 total, 8 up, 8 in 2024-02-05T07:31:01.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:02.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:31:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:31:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:31:02.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:02.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:02 smithi188 ceph-mon[33283]: osdmap e590: 8 total, 8 up, 8 in 2024-02-05T07:31:02.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-116"}]: dispatch 2024-02-05T07:31:02.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:02 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-116"}]': finished 2024-02-05T07:31:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:02 smithi188 ceph-mon[33283]: osdmap e591: 8 total, 8 up, 8 in 2024-02-05T07:31:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:02 smithi184 ceph-mon[29861]: osdmap e590: 8 total, 8 up, 8 in 2024-02-05T07:31:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-116"}]: dispatch 2024-02-05T07:31:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:02 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-116"}]': finished 2024-02-05T07:31:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:02 smithi184 ceph-mon[29861]: osdmap e591: 8 total, 8 up, 8 in 2024-02-05T07:31:02.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:02.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:02 smithi184 ceph-mon[41609]: osdmap e590: 8 total, 8 up, 8 in 2024-02-05T07:31:02.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-116"}]: dispatch 2024-02-05T07:31:02.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:02 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:02.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-116"}]': finished 2024-02-05T07:31:02.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:02 smithi184 ceph-mon[41609]: osdmap e591: 8 total, 8 up, 8 in 2024-02-05T07:31:03.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:03 smithi188 ceph-mon[33283]: pgmap v915: 300 pgs: 4 peering, 296 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-05T07:31:03.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:03 smithi184 ceph-mon[29861]: pgmap v915: 300 pgs: 4 peering, 296 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-05T07:31:03.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:03 smithi184 ceph-mon[41609]: pgmap v915: 300 pgs: 4 peering, 296 active+clean; 582 KiB data, 630 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-05T07:31:04.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:04 smithi188 ceph-mon[33283]: osdmap e592: 8 total, 8 up, 8 in 2024-02-05T07:31:04.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:04 smithi184 ceph-mon[29861]: osdmap e592: 8 total, 8 up, 8 in 2024-02-05T07:31:04.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:04 smithi184 ceph-mon[41609]: osdmap e592: 8 total, 8 up, 8 in 2024-02-05T07:31:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:05 smithi188 ceph-mon[33283]: pgmap v918: 268 pgs: 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-02-05T07:31:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:05 smithi188 ceph-mon[33283]: osdmap e593: 8 total, 8 up, 8 in 2024-02-05T07:31:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:05 smithi188 ceph-mon[33283]: osdmap e594: 8 total, 8 up, 8 in 2024-02-05T07:31:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:05 smithi184 ceph-mon[29861]: pgmap v918: 268 pgs: 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-02-05T07:31:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:05 smithi184 ceph-mon[29861]: osdmap e593: 8 total, 8 up, 8 in 2024-02-05T07:31:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:05 smithi184 ceph-mon[29861]: osdmap e594: 8 total, 8 up, 8 in 2024-02-05T07:31:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:05 smithi184 ceph-mon[41609]: pgmap v918: 268 pgs: 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-02-05T07:31:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:05 smithi184 ceph-mon[41609]: osdmap e593: 8 total, 8 up, 8 in 2024-02-05T07:31:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:05.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:05.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:05 smithi184 ceph-mon[41609]: osdmap e594: 8 total, 8 up, 8 in 2024-02-05T07:31:07.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:06 smithi188 ceph-mon[33283]: osdmap e595: 8 total, 8 up, 8 in 2024-02-05T07:31:07.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:07.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:06 smithi188 ceph-mon[33283]: pgmap v922: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 783 B/s rd, 1 op/s 2024-02-05T07:31:07.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:06 smithi184 ceph-mon[29861]: osdmap e595: 8 total, 8 up, 8 in 2024-02-05T07:31:07.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:07.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:06 smithi184 ceph-mon[29861]: pgmap v922: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 783 B/s rd, 1 op/s 2024-02-05T07:31:07.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:06 smithi184 ceph-mon[41609]: osdmap e595: 8 total, 8 up, 8 in 2024-02-05T07:31:07.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:07.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:06 smithi184 ceph-mon[41609]: pgmap v922: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 783 B/s rd, 1 op/s 2024-02-05T07:31:08.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:31:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:31:08.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-118", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:08.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:07 smithi188 ceph-mon[33283]: osdmap e596: 8 total, 8 up, 8 in 2024-02-05T07:31:08.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-118"}]: dispatch 2024-02-05T07:31:08.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-118", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:08.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:07 smithi184 ceph-mon[29861]: osdmap e596: 8 total, 8 up, 8 in 2024-02-05T07:31:08.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-118"}]: dispatch 2024-02-05T07:31:08.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-118", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:08.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:07 smithi184 ceph-mon[41609]: osdmap e596: 8 total, 8 up, 8 in 2024-02-05T07:31:08.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-118"}]: dispatch 2024-02-05T07:31:09.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-118"}]': finished 2024-02-05T07:31:09.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:08 smithi188 ceph-mon[33283]: osdmap e597: 8 total, 8 up, 8 in 2024-02-05T07:31:09.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-118", "mode": "writeback"}]: dispatch 2024-02-05T07:31:09.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:08 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:09.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:08 smithi188 ceph-mon[33283]: pgmap v925: 300 pgs: 300 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 527 B/s wr, 1 op/s 2024-02-05T07:31:09.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-118"}]': finished 2024-02-05T07:31:09.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:08 smithi184 ceph-mon[29861]: osdmap e597: 8 total, 8 up, 8 in 2024-02-05T07:31:09.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-118", "mode": "writeback"}]: dispatch 2024-02-05T07:31:09.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:08 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:09.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:08 smithi184 ceph-mon[29861]: pgmap v925: 300 pgs: 300 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 527 B/s wr, 1 op/s 2024-02-05T07:31:09.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-118"}]': finished 2024-02-05T07:31:09.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:08 smithi184 ceph-mon[41609]: osdmap e597: 8 total, 8 up, 8 in 2024-02-05T07:31:09.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-118", "mode": "writeback"}]: dispatch 2024-02-05T07:31:09.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:08 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:09.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:08 smithi184 ceph-mon[41609]: pgmap v925: 300 pgs: 300 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 527 B/s wr, 1 op/s 2024-02-05T07:31:10.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:09 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:10.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-118", "mode": "writeback"}]': finished 2024-02-05T07:31:10.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:09 smithi188 ceph-mon[33283]: osdmap e598: 8 total, 8 up, 8 in 2024-02-05T07:31:10.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:09 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:10.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-118", "mode": "writeback"}]': finished 2024-02-05T07:31:10.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:09 smithi184 ceph-mon[29861]: osdmap e598: 8 total, 8 up, 8 in 2024-02-05T07:31:10.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:09 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:10.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-118", "mode": "writeback"}]': finished 2024-02-05T07:31:10.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:09 smithi184 ceph-mon[41609]: osdmap e598: 8 total, 8 up, 8 in 2024-02-05T07:31:11.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:10 smithi188 ceph-mon[33283]: osdmap e599: 8 total, 8 up, 8 in 2024-02-05T07:31:11.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:11.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:10 smithi188 ceph-mon[33283]: pgmap v928: 300 pgs: 300 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-05T07:31:11.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:10 smithi184 ceph-mon[29861]: osdmap e599: 8 total, 8 up, 8 in 2024-02-05T07:31:11.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:11.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:10 smithi184 ceph-mon[29861]: pgmap v928: 300 pgs: 300 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-05T07:31:11.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:10 smithi184 ceph-mon[41609]: osdmap e599: 8 total, 8 up, 8 in 2024-02-05T07:31:11.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:11.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:10 smithi184 ceph-mon[41609]: pgmap v928: 300 pgs: 300 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-05T07:31:12.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:12.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:11 smithi188 ceph-mon[33283]: osdmap e600: 8 total, 8 up, 8 in 2024-02-05T07:31:12.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-118"}]: dispatch 2024-02-05T07:31:12.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:11 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:12.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-118"}]': finished 2024-02-05T07:31:12.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:12.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:11 smithi184 ceph-mon[29861]: osdmap e600: 8 total, 8 up, 8 in 2024-02-05T07:31:12.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-118"}]: dispatch 2024-02-05T07:31:12.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:11 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:12.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-118"}]': finished 2024-02-05T07:31:12.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:31:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:31:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:31:12.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:12.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:11 smithi184 ceph-mon[41609]: osdmap e600: 8 total, 8 up, 8 in 2024-02-05T07:31:12.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-118"}]: dispatch 2024-02-05T07:31:12.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:11 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:12.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-118"}]': finished 2024-02-05T07:31:13.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:12 smithi188 ceph-mon[33283]: osdmap e601: 8 total, 8 up, 8 in 2024-02-05T07:31:13.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:12 smithi188 ceph-mon[33283]: pgmap v931: 300 pgs: 300 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:31:13.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:12 smithi184 ceph-mon[29861]: osdmap e601: 8 total, 8 up, 8 in 2024-02-05T07:31:13.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:12 smithi184 ceph-mon[29861]: pgmap v931: 300 pgs: 300 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:31:13.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:12 smithi184 ceph-mon[41609]: osdmap e601: 8 total, 8 up, 8 in 2024-02-05T07:31:13.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:12 smithi184 ceph-mon[41609]: pgmap v931: 300 pgs: 300 active+clean; 582 KiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:31:14.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:13 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:14.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:13 smithi188 ceph-mon[33283]: osdmap e602: 8 total, 8 up, 8 in 2024-02-05T07:31:14.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:13 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:31:14.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:13 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:31:14.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:13 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:14.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:13 smithi184 ceph-mon[29861]: osdmap e602: 8 total, 8 up, 8 in 2024-02-05T07:31:14.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:13 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:31:14.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:13 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:31:14.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:13 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:14.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:13 smithi184 ceph-mon[41609]: osdmap e602: 8 total, 8 up, 8 in 2024-02-05T07:31:14.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:13 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:31:14.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:13 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:31:15.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:14 smithi188 ceph-mon[33283]: osdmap e603: 8 total, 8 up, 8 in 2024-02-05T07:31:15.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:15.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:14 smithi188 ceph-mon[33283]: pgmap v934: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:15.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:14 smithi184 ceph-mon[29861]: osdmap e603: 8 total, 8 up, 8 in 2024-02-05T07:31:15.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:15.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:14 smithi184 ceph-mon[29861]: pgmap v934: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:15.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:14 smithi184 ceph-mon[41609]: osdmap e603: 8 total, 8 up, 8 in 2024-02-05T07:31:15.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:15.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:14 smithi184 ceph-mon[41609]: pgmap v934: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:16.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:16.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:15 smithi188 ceph-mon[33283]: osdmap e604: 8 total, 8 up, 8 in 2024-02-05T07:31:16.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:16.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:16.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:15 smithi184 ceph-mon[29861]: osdmap e604: 8 total, 8 up, 8 in 2024-02-05T07:31:16.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:16.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:16.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:15 smithi184 ceph-mon[41609]: osdmap e604: 8 total, 8 up, 8 in 2024-02-05T07:31:16.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:17.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-120", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:17 smithi184 ceph-mon[29861]: osdmap e605: 8 total, 8 up, 8 in 2024-02-05T07:31:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-120"}]: dispatch 2024-02-05T07:31:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:17 smithi184 ceph-mon[29861]: pgmap v937: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-120"}]': finished 2024-02-05T07:31:17.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-120", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:17.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:17 smithi184 ceph-mon[41609]: osdmap e605: 8 total, 8 up, 8 in 2024-02-05T07:31:17.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-120"}]: dispatch 2024-02-05T07:31:17.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:17 smithi184 ceph-mon[41609]: pgmap v937: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:17.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-120"}]': finished 2024-02-05T07:31:17.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-120", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:17.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:17 smithi188 ceph-mon[33283]: osdmap e605: 8 total, 8 up, 8 in 2024-02-05T07:31:17.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-120"}]: dispatch 2024-02-05T07:31:17.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:17 smithi188 ceph-mon[33283]: pgmap v937: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:17.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-120"}]': finished 2024-02-05T07:31:18.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:18 smithi184 ceph-mon[29861]: osdmap e606: 8 total, 8 up, 8 in 2024-02-05T07:31:18.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-120", "mode": "writeback"}]: dispatch 2024-02-05T07:31:18.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:18 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:18.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-120", "mode": "writeback"}]': finished 2024-02-05T07:31:18.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:18 smithi184 ceph-mon[29861]: osdmap e607: 8 total, 8 up, 8 in 2024-02-05T07:31:18.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:18 smithi184 ceph-mon[41609]: osdmap e606: 8 total, 8 up, 8 in 2024-02-05T07:31:18.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-120", "mode": "writeback"}]: dispatch 2024-02-05T07:31:18.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:18 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:18.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-120", "mode": "writeback"}]': finished 2024-02-05T07:31:18.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:18 smithi184 ceph-mon[41609]: osdmap e607: 8 total, 8 up, 8 in 2024-02-05T07:31:18.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:31:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:31:18.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:18 smithi188 ceph-mon[33283]: osdmap e606: 8 total, 8 up, 8 in 2024-02-05T07:31:18.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-120", "mode": "writeback"}]: dispatch 2024-02-05T07:31:18.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:18 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:18.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-120", "mode": "writeback"}]': finished 2024-02-05T07:31:18.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:18 smithi188 ceph-mon[33283]: osdmap e607: 8 total, 8 up, 8 in 2024-02-05T07:31:19.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:19.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:19.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:19 smithi184 ceph-mon[29861]: pgmap v940: 300 pgs: 300 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:19.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:19.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:19.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:19 smithi184 ceph-mon[41609]: pgmap v940: 300 pgs: 300 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:19.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:19.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:19.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:19 smithi188 ceph-mon[33283]: pgmap v940: 300 pgs: 300 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:20.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:20.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:20 smithi184 ceph-mon[29861]: osdmap e608: 8 total, 8 up, 8 in 2024-02-05T07:31:20.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-120"}]: dispatch 2024-02-05T07:31:20.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:20 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:20.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:20 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:20.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-120"}]': finished 2024-02-05T07:31:20.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:20 smithi184 ceph-mon[29861]: osdmap e609: 8 total, 8 up, 8 in 2024-02-05T07:31:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:20 smithi184 ceph-mon[41609]: osdmap e608: 8 total, 8 up, 8 in 2024-02-05T07:31:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-120"}]: dispatch 2024-02-05T07:31:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:20 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:20 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-120"}]': finished 2024-02-05T07:31:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:20 smithi184 ceph-mon[41609]: osdmap e609: 8 total, 8 up, 8 in 2024-02-05T07:31:20.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:20 smithi188 ceph-mon[33283]: osdmap e608: 8 total, 8 up, 8 in 2024-02-05T07:31:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-120"}]: dispatch 2024-02-05T07:31:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:20 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:20 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-120"}]': finished 2024-02-05T07:31:20.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:20 smithi188 ceph-mon[33283]: osdmap e609: 8 total, 8 up, 8 in 2024-02-05T07:31:21.439 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:21 smithi184 ceph-mon[29861]: pgmap v943: 300 pgs: 300 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:21.439 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:21 smithi184 ceph-mon[29861]: osdmap e610: 8 total, 8 up, 8 in 2024-02-05T07:31:21.439 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:21 smithi184 ceph-mon[41609]: pgmap v943: 300 pgs: 300 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:21.439 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:21 smithi184 ceph-mon[41609]: osdmap e610: 8 total, 8 up, 8 in 2024-02-05T07:31:21.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:21 smithi188 ceph-mon[33283]: pgmap v943: 300 pgs: 300 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:21.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:21 smithi188 ceph-mon[33283]: osdmap e610: 8 total, 8 up, 8 in 2024-02-05T07:31:22.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:31:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:31:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:31:23.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:22 smithi188 ceph-mon[33283]: osdmap e611: 8 total, 8 up, 8 in 2024-02-05T07:31:23.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:23.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:22 smithi188 ceph-mon[33283]: pgmap v946: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:31:23.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:22 smithi184 ceph-mon[29861]: osdmap e611: 8 total, 8 up, 8 in 2024-02-05T07:31:23.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:23.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:22 smithi184 ceph-mon[29861]: pgmap v946: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:31:23.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:22 smithi184 ceph-mon[41609]: osdmap e611: 8 total, 8 up, 8 in 2024-02-05T07:31:23.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:23.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:22 smithi184 ceph-mon[41609]: pgmap v946: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:31:24.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:24.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:23 smithi188 ceph-mon[33283]: osdmap e612: 8 total, 8 up, 8 in 2024-02-05T07:31:24.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:24.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:24.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:23 smithi184 ceph-mon[29861]: osdmap e612: 8 total, 8 up, 8 in 2024-02-05T07:31:24.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:24.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:24.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:23 smithi184 ceph-mon[41609]: osdmap e612: 8 total, 8 up, 8 in 2024-02-05T07:31:24.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:25.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-122", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:25.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:24 smithi188 ceph-mon[33283]: osdmap e613: 8 total, 8 up, 8 in 2024-02-05T07:31:25.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-122"}]: dispatch 2024-02-05T07:31:25.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:24 smithi188 ceph-mon[33283]: pgmap v949: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:25.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:24 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-122"}]': finished 2024-02-05T07:31:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:24 smithi188 ceph-mon[33283]: osdmap e614: 8 total, 8 up, 8 in 2024-02-05T07:31:25.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-122", "mode": "writeback"}]: dispatch 2024-02-05T07:31:25.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-122", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:25.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[29861]: osdmap e613: 8 total, 8 up, 8 in 2024-02-05T07:31:25.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-122"}]: dispatch 2024-02-05T07:31:25.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[29861]: pgmap v949: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:25.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:25.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-122"}]': finished 2024-02-05T07:31:25.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[29861]: osdmap e614: 8 total, 8 up, 8 in 2024-02-05T07:31:25.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-122", "mode": "writeback"}]: dispatch 2024-02-05T07:31:25.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-122", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:25.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[41609]: osdmap e613: 8 total, 8 up, 8 in 2024-02-05T07:31:25.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-122"}]: dispatch 2024-02-05T07:31:25.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[41609]: pgmap v949: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:25.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:25.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-122"}]': finished 2024-02-05T07:31:25.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[41609]: osdmap e614: 8 total, 8 up, 8 in 2024-02-05T07:31:25.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-122", "mode": "writeback"}]: dispatch 2024-02-05T07:31:26.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:25 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:26.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-122", "mode": "writeback"}]': finished 2024-02-05T07:31:26.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:25 smithi188 ceph-mon[33283]: osdmap e615: 8 total, 8 up, 8 in 2024-02-05T07:31:26.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:25 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:26.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-122", "mode": "writeback"}]': finished 2024-02-05T07:31:26.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:25 smithi184 ceph-mon[29861]: osdmap e615: 8 total, 8 up, 8 in 2024-02-05T07:31:26.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:25 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:26.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-122", "mode": "writeback"}]': finished 2024-02-05T07:31:26.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:25 smithi184 ceph-mon[41609]: osdmap e615: 8 total, 8 up, 8 in 2024-02-05T07:31:27.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:27.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:26 smithi188 ceph-mon[33283]: pgmap v952: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:27.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:27.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:26 smithi184 ceph-mon[29861]: pgmap v952: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:27.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:27.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:26 smithi184 ceph-mon[41609]: pgmap v952: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:28.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:31:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:31:28.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:28.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:27 smithi188 ceph-mon[33283]: osdmap e616: 8 total, 8 up, 8 in 2024-02-05T07:31:28.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-122"}]: dispatch 2024-02-05T07:31:28.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:28.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:27 smithi184 ceph-mon[29861]: osdmap e616: 8 total, 8 up, 8 in 2024-02-05T07:31:28.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-122"}]: dispatch 2024-02-05T07:31:28.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:28.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:27 smithi184 ceph-mon[41609]: osdmap e616: 8 total, 8 up, 8 in 2024-02-05T07:31:28.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-122"}]: dispatch 2024-02-05T07:31:29.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:28 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:29.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-122"}]': finished 2024-02-05T07:31:29.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:28 smithi188 ceph-mon[33283]: osdmap e617: 8 total, 8 up, 8 in 2024-02-05T07:31:29.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:28 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:29.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:28 smithi188 ceph-mon[33283]: pgmap v955: 300 pgs: 300 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-05T07:31:29.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:28 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:31:29.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:28 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:29.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-122"}]': finished 2024-02-05T07:31:29.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:28 smithi184 ceph-mon[29861]: osdmap e617: 8 total, 8 up, 8 in 2024-02-05T07:31:29.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:28 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:29.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:28 smithi184 ceph-mon[29861]: pgmap v955: 300 pgs: 300 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-05T07:31:29.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:28 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:31:29.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:28 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:29.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-122"}]': finished 2024-02-05T07:31:29.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:28 smithi184 ceph-mon[41609]: osdmap e617: 8 total, 8 up, 8 in 2024-02-05T07:31:29.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:28 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:29.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:28 smithi184 ceph-mon[41609]: pgmap v955: 300 pgs: 300 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 3 op/s 2024-02-05T07:31:29.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:28 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:31:30.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:29 smithi188 ceph-mon[33283]: osdmap e618: 8 total, 8 up, 8 in 2024-02-05T07:31:30.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:29 smithi184 ceph-mon[29861]: osdmap e618: 8 total, 8 up, 8 in 2024-02-05T07:31:30.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:29 smithi184 ceph-mon[41609]: osdmap e618: 8 total, 8 up, 8 in 2024-02-05T07:31:31.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:31 smithi184 ceph-mon[29861]: osdmap e619: 8 total, 8 up, 8 in 2024-02-05T07:31:31.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:31.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:31 smithi184 ceph-mon[29861]: pgmap v958: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-05T07:31:31.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:31 smithi184 ceph-mon[41609]: osdmap e619: 8 total, 8 up, 8 in 2024-02-05T07:31:31.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:31.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:31 smithi184 ceph-mon[41609]: pgmap v958: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-05T07:31:31.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:31 smithi188 ceph-mon[33283]: osdmap e619: 8 total, 8 up, 8 in 2024-02-05T07:31:31.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:31.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:31 smithi188 ceph-mon[33283]: pgmap v958: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-05T07:31:32.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:32.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:32 smithi184 ceph-mon[29861]: osdmap e620: 8 total, 8 up, 8 in 2024-02-05T07:31:32.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:32.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:32 smithi184 ceph-mon[41609]: osdmap e620: 8 total, 8 up, 8 in 2024-02-05T07:31:32.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:31:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:31:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:31:32.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:32.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:32 smithi188 ceph-mon[33283]: osdmap e620: 8 total, 8 up, 8 in 2024-02-05T07:31:33.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:33 smithi188 ceph-mon[33283]: osdmap e621: 8 total, 8 up, 8 in 2024-02-05T07:31:33.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:33.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:33 smithi188 ceph-mon[33283]: pgmap v961: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:31:33.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:33 smithi184 ceph-mon[29861]: osdmap e621: 8 total, 8 up, 8 in 2024-02-05T07:31:33.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:33.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:33 smithi184 ceph-mon[29861]: pgmap v961: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:31:33.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:33 smithi184 ceph-mon[41609]: osdmap e621: 8 total, 8 up, 8 in 2024-02-05T07:31:33.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:33.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:33 smithi184 ceph-mon[41609]: pgmap v961: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:31:34.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:34 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:34.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-124", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:34.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:34 smithi188 ceph-mon[33283]: osdmap e622: 8 total, 8 up, 8 in 2024-02-05T07:31:34.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-124"}]: dispatch 2024-02-05T07:31:34.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:34 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:34.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-124", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:34.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:34 smithi184 ceph-mon[29861]: osdmap e622: 8 total, 8 up, 8 in 2024-02-05T07:31:34.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-124"}]: dispatch 2024-02-05T07:31:34.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:34 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:34.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-124", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:34.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:34 smithi184 ceph-mon[41609]: osdmap e622: 8 total, 8 up, 8 in 2024-02-05T07:31:34.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-124"}]: dispatch 2024-02-05T07:31:35.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-124"}]': finished 2024-02-05T07:31:35.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:35 smithi188 ceph-mon[33283]: osdmap e623: 8 total, 8 up, 8 in 2024-02-05T07:31:35.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-124", "mode": "writeback"}]: dispatch 2024-02-05T07:31:35.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:35 smithi188 ceph-mon[33283]: pgmap v964: 300 pgs: 300 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-05T07:31:35.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:35 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:35.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-124", "mode": "writeback"}]': finished 2024-02-05T07:31:35.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:35 smithi188 ceph-mon[33283]: osdmap e624: 8 total, 8 up, 8 in 2024-02-05T07:31:35.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-124"}]': finished 2024-02-05T07:31:35.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:35 smithi184 ceph-mon[29861]: osdmap e623: 8 total, 8 up, 8 in 2024-02-05T07:31:35.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-124", "mode": "writeback"}]: dispatch 2024-02-05T07:31:35.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:35 smithi184 ceph-mon[29861]: pgmap v964: 300 pgs: 300 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-05T07:31:35.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:35 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:35.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-124", "mode": "writeback"}]': finished 2024-02-05T07:31:35.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:35 smithi184 ceph-mon[29861]: osdmap e624: 8 total, 8 up, 8 in 2024-02-05T07:31:35.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-124"}]': finished 2024-02-05T07:31:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:35 smithi184 ceph-mon[41609]: osdmap e623: 8 total, 8 up, 8 in 2024-02-05T07:31:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-124", "mode": "writeback"}]: dispatch 2024-02-05T07:31:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:35 smithi184 ceph-mon[41609]: pgmap v964: 300 pgs: 300 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-05T07:31:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:35 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-124", "mode": "writeback"}]': finished 2024-02-05T07:31:35.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:35 smithi184 ceph-mon[41609]: osdmap e624: 8 total, 8 up, 8 in 2024-02-05T07:31:37.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:37 smithi188 ceph-mon[33283]: osdmap e625: 8 total, 8 up, 8 in 2024-02-05T07:31:37.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:37.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:37 smithi188 ceph-mon[33283]: pgmap v967: 300 pgs: 300 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-05T07:31:37.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:37 smithi184 ceph-mon[29861]: osdmap e625: 8 total, 8 up, 8 in 2024-02-05T07:31:37.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:37.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:37 smithi184 ceph-mon[29861]: pgmap v967: 300 pgs: 300 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-05T07:31:37.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:37 smithi184 ceph-mon[41609]: osdmap e625: 8 total, 8 up, 8 in 2024-02-05T07:31:37.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:37.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:37 smithi184 ceph-mon[41609]: pgmap v967: 300 pgs: 300 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-05T07:31:38.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:31:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:31:38.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:38 smithi188 ceph-mon[33283]: osdmap e626: 8 total, 8 up, 8 in 2024-02-05T07:31:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-124"}]: dispatch 2024-02-05T07:31:38.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:38.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:38 smithi184 ceph-mon[29861]: osdmap e626: 8 total, 8 up, 8 in 2024-02-05T07:31:38.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-124"}]: dispatch 2024-02-05T07:31:38.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:38.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:38 smithi184 ceph-mon[41609]: osdmap e626: 8 total, 8 up, 8 in 2024-02-05T07:31:38.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-124"}]: dispatch 2024-02-05T07:31:39.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:39 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:39.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-124"}]': finished 2024-02-05T07:31:39.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:39 smithi188 ceph-mon[33283]: osdmap e627: 8 total, 8 up, 8 in 2024-02-05T07:31:39.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:39.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:39 smithi188 ceph-mon[33283]: pgmap v970: 300 pgs: 300 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-05T07:31:39.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:39 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:39.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-124"}]': finished 2024-02-05T07:31:39.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:39 smithi184 ceph-mon[29861]: osdmap e627: 8 total, 8 up, 8 in 2024-02-05T07:31:39.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:39.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:39 smithi184 ceph-mon[29861]: pgmap v970: 300 pgs: 300 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-05T07:31:39.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:39 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:39.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-124"}]': finished 2024-02-05T07:31:39.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:39 smithi184 ceph-mon[41609]: osdmap e627: 8 total, 8 up, 8 in 2024-02-05T07:31:39.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:39.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:39 smithi184 ceph-mon[41609]: pgmap v970: 300 pgs: 300 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-05T07:31:40.422 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:40 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:40.422 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:40 smithi184 ceph-mon[29861]: osdmap e628: 8 total, 8 up, 8 in 2024-02-05T07:31:40.422 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:40 smithi184 ceph-mon[29861]: osdmap e629: 8 total, 8 up, 8 in 2024-02-05T07:31:40.422 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:40.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:40 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:40.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:40 smithi184 ceph-mon[41609]: osdmap e628: 8 total, 8 up, 8 in 2024-02-05T07:31:40.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:40 smithi184 ceph-mon[41609]: osdmap e629: 8 total, 8 up, 8 in 2024-02-05T07:31:40.423 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:40.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:40 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:40.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:40 smithi188 ceph-mon[33283]: osdmap e628: 8 total, 8 up, 8 in 2024-02-05T07:31:40.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:40 smithi188 ceph-mon[33283]: osdmap e629: 8 total, 8 up, 8 in 2024-02-05T07:31:40.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:41.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:41 smithi188 ceph-mon[33283]: pgmap v973: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:41.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:41.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:41 smithi188 ceph-mon[33283]: osdmap e630: 8 total, 8 up, 8 in 2024-02-05T07:31:41.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:41.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:41 smithi184 ceph-mon[29861]: pgmap v973: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:41.555 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:41.556 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:41 smithi184 ceph-mon[29861]: osdmap e630: 8 total, 8 up, 8 in 2024-02-05T07:31:41.556 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:41.556 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:41 smithi184 ceph-mon[41609]: pgmap v973: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:41.556 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:41.556 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:41 smithi184 ceph-mon[41609]: osdmap e630: 8 total, 8 up, 8 in 2024-02-05T07:31:41.556 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:31:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:31:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:31:43.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-126", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:43.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:42 smithi188 ceph-mon[33283]: osdmap e631: 8 total, 8 up, 8 in 2024-02-05T07:31:43.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-126"}]: dispatch 2024-02-05T07:31:43.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:42 smithi188 ceph-mon[33283]: pgmap v976: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:31:43.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-126", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:43.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:42 smithi184 ceph-mon[29861]: osdmap e631: 8 total, 8 up, 8 in 2024-02-05T07:31:43.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-126"}]: dispatch 2024-02-05T07:31:43.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:42 smithi184 ceph-mon[29861]: pgmap v976: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:31:43.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-126", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:43.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:42 smithi184 ceph-mon[41609]: osdmap e631: 8 total, 8 up, 8 in 2024-02-05T07:31:43.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-126"}]: dispatch 2024-02-05T07:31:43.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:42 smithi184 ceph-mon[41609]: pgmap v976: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:31:44.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-126"}]': finished 2024-02-05T07:31:44.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:43 smithi188 ceph-mon[33283]: osdmap e632: 8 total, 8 up, 8 in 2024-02-05T07:31:44.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-126", "mode": "writeback"}]: dispatch 2024-02-05T07:31:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:43 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:44.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-126", "mode": "writeback"}]': finished 2024-02-05T07:31:44.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-126"}]': finished 2024-02-05T07:31:44.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:43 smithi184 ceph-mon[29861]: osdmap e632: 8 total, 8 up, 8 in 2024-02-05T07:31:44.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-126", "mode": "writeback"}]: dispatch 2024-02-05T07:31:44.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:43 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:44.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-126", "mode": "writeback"}]': finished 2024-02-05T07:31:44.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-126"}]': finished 2024-02-05T07:31:44.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:43 smithi184 ceph-mon[41609]: osdmap e632: 8 total, 8 up, 8 in 2024-02-05T07:31:44.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-126", "mode": "writeback"}]: dispatch 2024-02-05T07:31:44.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:43 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:44.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-126", "mode": "writeback"}]': finished 2024-02-05T07:31:45.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:44 smithi188 ceph-mon[33283]: osdmap e633: 8 total, 8 up, 8 in 2024-02-05T07:31:45.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:31:45.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:31:45.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:44 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:45.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:44 smithi188 ceph-mon[33283]: pgmap v979: 300 pgs: 300 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:45.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:31:45.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:44 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:45.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:44 smithi184 ceph-mon[29861]: osdmap e633: 8 total, 8 up, 8 in 2024-02-05T07:31:45.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:31:45.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:31:45.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:44 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:45.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:44 smithi184 ceph-mon[29861]: pgmap v979: 300 pgs: 300 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:45.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:31:45.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:44 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:45.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:44 smithi184 ceph-mon[41609]: osdmap e633: 8 total, 8 up, 8 in 2024-02-05T07:31:45.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:31:45.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:31:45.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:44 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:45.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:44 smithi184 ceph-mon[41609]: pgmap v979: 300 pgs: 300 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:45.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:31:45.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:44 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:46.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:46.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:45 smithi188 ceph-mon[33283]: osdmap e634: 8 total, 8 up, 8 in 2024-02-05T07:31:46.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-126"}]: dispatch 2024-02-05T07:31:46.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:31:46.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:31:46.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:31:46.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:46.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:45 smithi184 ceph-mon[29861]: osdmap e634: 8 total, 8 up, 8 in 2024-02-05T07:31:46.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-126"}]: dispatch 2024-02-05T07:31:46.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:31:46.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:31:46.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:31:46.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:46.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:45 smithi184 ceph-mon[41609]: osdmap e634: 8 total, 8 up, 8 in 2024-02-05T07:31:46.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-126"}]: dispatch 2024-02-05T07:31:46.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:31:46.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:31:46.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:31:46.984 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 seapi_tier_pp: require_osd_release = squid 2024-02-05T07:31:46.984 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (9057 ms) 2024-02-05T07:31:46.984 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-02-05T07:31:46.985 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:31:46.985 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (6053 ms) 2024-02-05T07:31:46.985 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-02-05T07:31:46.985 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:31:46.985 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (5027 ms) 2024-02-05T07:31:46.985 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-02-05T07:31:46.985 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:31:46.985 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (25108 ms) 2024-02-05T07:31:46.985 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-02-05T07:31:46.985 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:31:46.985 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (14002 ms) 2024-02-05T07:31:46.985 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-02-05T07:31:46.985 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12112 ms) 2024-02-05T07:31:46.985 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-02-05T07:31:46.986 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-02-05T07:31:46.986 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: 00000010 69 73 |is| 2024-02-05T07:31:46.986 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: 00000012 2024-02-05T07:31:46.986 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (12075 ms) 2024-02-05T07:31:46.986 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-02-05T07:31:46.986 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: require_osd_release = squid 2024-02-05T07:31:46.986 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (6030 ms) 2024-02-05T07:31:46.986 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (556764 ms total) 2024-02-05T07:31:46.986 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: 2024-02-05T07:31:46.986 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-02-05T07:31:46.986 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-02-05T07:31:46.986 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1353 ms) 2024-02-05T07:31:46.986 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-02-05T07:31:46.986 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (10733 ms) 2024-02-05T07:31:46.987 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-02-05T07:31:46.987 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (18068 ms) 2024-02-05T07:31:46.987 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-02-05T07:31:46.987 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (2 ms) 2024-02-05T07:31:46.987 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (30156 ms total) 2024-02-05T07:31:46.987 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: 2024-02-05T07:31:46.987 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-02-05T07:31:46.987 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-02-05T07:31:46.987 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (7027 ms) 2024-02-05T07:31:46.987 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-02-05T07:31:46.987 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8018 ms) 2024-02-05T07:31:46.987 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-02-05T07:31:46.987 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: waiting for scrub... 2024-02-05T07:31:46.987 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: done waiting 2024-02-05T07:31:46.987 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (24614 ms) 2024-02-05T07:31:46.988 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-02-05T07:31:46.988 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (9565 ms) 2024-02-05T07:31:46.988 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-02-05T07:31:46.988 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (7958 ms) 2024-02-05T07:31:46.988 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-02-05T07:31:46.988 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8056 ms) 2024-02-05T07:31:46.988 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-02-05T07:31:46.988 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10072 ms) 2024-02-05T07:31:46.988 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-02-05T07:31:47.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:46 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:47.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-126"}]': finished 2024-02-05T07:31:47.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:46 smithi188 ceph-mon[33283]: osdmap e635: 8 total, 8 up, 8 in 2024-02-05T07:31:47.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:46 smithi188 ceph-mon[33283]: pgmap v982: 300 pgs: 300 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:47.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:46 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:47.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-126"}]': finished 2024-02-05T07:31:47.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:46 smithi184 ceph-mon[29861]: osdmap e635: 8 total, 8 up, 8 in 2024-02-05T07:31:47.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:46 smithi184 ceph-mon[29861]: pgmap v982: 300 pgs: 300 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:47.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:46 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:47.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-126"}]': finished 2024-02-05T07:31:47.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:46 smithi184 ceph-mon[41609]: osdmap e635: 8 total, 8 up, 8 in 2024-02-05T07:31:47.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:46 smithi184 ceph-mon[41609]: pgmap v982: 300 pgs: 300 active+clean; 582 KiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:31:48.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:47 smithi188 ceph-mon[33283]: osdmap e636: 8 total, 8 up, 8 in 2024-02-05T07:31:48.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:31:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:31:48.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:47 smithi184 ceph-mon[29861]: osdmap e636: 8 total, 8 up, 8 in 2024-02-05T07:31:48.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:47 smithi184 ceph-mon[41609]: osdmap e636: 8 total, 8 up, 8 in 2024-02-05T07:31:49.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:48 smithi188 ceph-mon[33283]: osdmap e637: 8 total, 8 up, 8 in 2024-02-05T07:31:49.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:48 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:49.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:48 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:49.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:48 smithi188 ceph-mon[33283]: pgmap v985: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:49.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:48 smithi184 ceph-mon[29861]: osdmap e637: 8 total, 8 up, 8 in 2024-02-05T07:31:49.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:48 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:49.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:48 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:49.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:48 smithi184 ceph-mon[29861]: pgmap v985: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:49.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:48 smithi184 ceph-mon[41609]: osdmap e637: 8 total, 8 up, 8 in 2024-02-05T07:31:49.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:48 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:31:49.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:48 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:49.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:48 smithi184 ceph-mon[41609]: pgmap v985: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:50.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:49 smithi184 ceph-mon[29861]: osdmap e638: 8 total, 8 up, 8 in 2024-02-05T07:31:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:50.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:49 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:50.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:50.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:49 smithi184 ceph-mon[41609]: osdmap e638: 8 total, 8 up, 8 in 2024-02-05T07:31:50.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:50.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:49 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:50.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:31:50.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:49 smithi188 ceph-mon[33283]: osdmap e638: 8 total, 8 up, 8 in 2024-02-05T07:31:50.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:31:50.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:49 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-128", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:51 smithi184 ceph-mon[29861]: osdmap e639: 8 total, 8 up, 8 in 2024-02-05T07:31:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-128"}]: dispatch 2024-02-05T07:31:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:51 smithi184 ceph-mon[29861]: pgmap v988: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-128"}]': finished 2024-02-05T07:31:51.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-128", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:51.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:51 smithi184 ceph-mon[41609]: osdmap e639: 8 total, 8 up, 8 in 2024-02-05T07:31:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-128"}]: dispatch 2024-02-05T07:31:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:51 smithi184 ceph-mon[41609]: pgmap v988: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:51.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-128"}]': finished 2024-02-05T07:31:51.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-128", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:31:51.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:51 smithi188 ceph-mon[33283]: osdmap e639: 8 total, 8 up, 8 in 2024-02-05T07:31:51.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-128"}]: dispatch 2024-02-05T07:31:51.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:51 smithi188 ceph-mon[33283]: pgmap v988: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:31:51.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-128"}]': finished 2024-02-05T07:31:52.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:52 smithi184 ceph-mon[29861]: osdmap e640: 8 total, 8 up, 8 in 2024-02-05T07:31:52.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-128", "mode": "writeback"}]: dispatch 2024-02-05T07:31:52.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:52 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:52.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:52 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-128", "mode": "writeback"}]': finished 2024-02-05T07:31:52.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:52 smithi184 ceph-mon[29861]: osdmap e641: 8 total, 8 up, 8 in 2024-02-05T07:31:52.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:31:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:31:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:31:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:52 smithi184 ceph-mon[41609]: osdmap e640: 8 total, 8 up, 8 in 2024-02-05T07:31:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-128", "mode": "writeback"}]: dispatch 2024-02-05T07:31:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:52 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:52 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-128", "mode": "writeback"}]': finished 2024-02-05T07:31:52.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:52 smithi184 ceph-mon[41609]: osdmap e641: 8 total, 8 up, 8 in 2024-02-05T07:31:52.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:52 smithi188 ceph-mon[33283]: osdmap e640: 8 total, 8 up, 8 in 2024-02-05T07:31:52.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-128", "mode": "writeback"}]: dispatch 2024-02-05T07:31:52.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:52 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:31:52.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:52 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-128", "mode": "writeback"}]': finished 2024-02-05T07:31:52.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:52 smithi188 ceph-mon[33283]: osdmap e641: 8 total, 8 up, 8 in 2024-02-05T07:31:53.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:53 smithi184 ceph-mon[29861]: pgmap v991: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:31:53.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:53 smithi184 ceph-mon[41609]: pgmap v991: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:31:53.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:53 smithi188 ceph-mon[33283]: pgmap v991: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:31:55.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:55 smithi188 ceph-mon[33283]: pgmap v992: 300 pgs: 300 active+clean; 582 KiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 384 B/s wr, 1 op/s 2024-02-05T07:31:55.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:55 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:55.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:55 smithi184 ceph-mon[29861]: pgmap v992: 300 pgs: 300 active+clean; 582 KiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 384 B/s wr, 1 op/s 2024-02-05T07:31:55.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:55 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:55.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:55 smithi184 ceph-mon[41609]: pgmap v992: 300 pgs: 300 active+clean; 582 KiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 384 B/s wr, 1 op/s 2024-02-05T07:31:55.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:55 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:31:57.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:57 smithi188 ceph-mon[33283]: pgmap v993: 300 pgs: 300 active+clean; 582 KiB data, 645 MiB used, 715 GiB / 715 GiB avail; 970 B/s rd, 323 B/s wr, 1 op/s 2024-02-05T07:31:57.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:57.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:57 smithi184 ceph-mon[29861]: pgmap v993: 300 pgs: 300 active+clean; 582 KiB data, 645 MiB used, 715 GiB / 715 GiB avail; 970 B/s rd, 323 B/s wr, 1 op/s 2024-02-05T07:31:57.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:57.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:57 smithi184 ceph-mon[41609]: pgmap v993: 300 pgs: 300 active+clean; 582 KiB data, 645 MiB used, 715 GiB / 715 GiB avail; 970 B/s rd, 323 B/s wr, 1 op/s 2024-02-05T07:31:57.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:31:58.400 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:31:58.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:58.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: osdmap e642: 8 total, 8 up, 8 in 2024-02-05T07:31:58.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-128"}]: dispatch 2024-02-05T07:31:58.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.6", "id": [5, 3]}]: dispatch 2024-02-05T07:31:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.9", "id": [2, 3]}]: dispatch 2024-02-05T07:31:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.16", "id": [5, 4]}]: dispatch 2024-02-05T07:31:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.1d", "id": [2, 3]}]: dispatch 2024-02-05T07:31:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.1f", "id": [2, 0]}]: dispatch 2024-02-05T07:31:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-128"}]': finished 2024-02-05T07:31:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.6", "id": [5, 3]}]': finished 2024-02-05T07:31:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.9", "id": [2, 3]}]': finished 2024-02-05T07:31:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.16", "id": [5, 4]}]': finished 2024-02-05T07:31:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.1d", "id": [2, 3]}]': finished 2024-02-05T07:31:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.1f", "id": [2, 0]}]': finished 2024-02-05T07:31:58.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:58 smithi188 ceph-mon[33283]: osdmap e643: 8 total, 8 up, 8 in 2024-02-05T07:31:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: osdmap e642: 8 total, 8 up, 8 in 2024-02-05T07:31:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-128"}]: dispatch 2024-02-05T07:31:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.6", "id": [5, 3]}]: dispatch 2024-02-05T07:31:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.9", "id": [2, 3]}]: dispatch 2024-02-05T07:31:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.16", "id": [5, 4]}]: dispatch 2024-02-05T07:31:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.1d", "id": [2, 3]}]: dispatch 2024-02-05T07:31:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.1f", "id": [2, 0]}]: dispatch 2024-02-05T07:31:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-128"}]': finished 2024-02-05T07:31:58.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.6", "id": [5, 3]}]': finished 2024-02-05T07:31:58.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.9", "id": [2, 3]}]': finished 2024-02-05T07:31:58.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.16", "id": [5, 4]}]': finished 2024-02-05T07:31:58.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.1d", "id": [2, 3]}]': finished 2024-02-05T07:31:58.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.1f", "id": [2, 0]}]': finished 2024-02-05T07:31:58.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[29861]: osdmap e643: 8 total, 8 up, 8 in 2024-02-05T07:31:58.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:31:58.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: osdmap e642: 8 total, 8 up, 8 in 2024-02-05T07:31:58.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-128"}]: dispatch 2024-02-05T07:31:58.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.6", "id": [5, 3]}]: dispatch 2024-02-05T07:31:58.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.9", "id": [2, 3]}]: dispatch 2024-02-05T07:31:58.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.16", "id": [5, 4]}]: dispatch 2024-02-05T07:31:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.1d", "id": [2, 3]}]: dispatch 2024-02-05T07:31:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.1f", "id": [2, 0]}]: dispatch 2024-02-05T07:31:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:31:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-128"}]': finished 2024-02-05T07:31:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.6", "id": [5, 3]}]': finished 2024-02-05T07:31:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.9", "id": [2, 3]}]': finished 2024-02-05T07:31:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.16", "id": [5, 4]}]': finished 2024-02-05T07:31:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.1d", "id": [2, 3]}]': finished 2024-02-05T07:31:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "321.1f", "id": [2, 0]}]': finished 2024-02-05T07:31:58.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:58 smithi184 ceph-mon[41609]: osdmap e643: 8 total, 8 up, 8 in 2024-02-05T07:31:59.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:59.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:59 smithi188 ceph-mon[33283]: pgmap v995: 300 pgs: 300 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 279 B/s wr, 2 op/s 2024-02-05T07:31:59.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:31:59.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:31:59.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:31:59 smithi188 ceph-mon[33283]: osdmap e644: 8 total, 8 up, 8 in 2024-02-05T07:31:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:59 smithi184 ceph-mon[29861]: pgmap v995: 300 pgs: 300 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 279 B/s wr, 2 op/s 2024-02-05T07:31:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:31:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:31:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:31:59 smithi184 ceph-mon[29861]: osdmap e644: 8 total, 8 up, 8 in 2024-02-05T07:31:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:31:59.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:59 smithi184 ceph-mon[41609]: pgmap v995: 300 pgs: 300 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 279 B/s wr, 2 op/s 2024-02-05T07:31:59.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:31:59.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:31:59.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:31:59 smithi184 ceph-mon[41609]: osdmap e644: 8 total, 8 up, 8 in 2024-02-05T07:32:01.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:01 smithi188 ceph-mon[33283]: pgmap v998: 300 pgs: 300 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:32:01.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:01 smithi188 ceph-mon[33283]: osdmap e645: 8 total, 8 up, 8 in 2024-02-05T07:32:01.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:01 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:01.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:01 smithi184 ceph-mon[29861]: pgmap v998: 300 pgs: 300 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:32:01.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:01 smithi184 ceph-mon[29861]: osdmap e645: 8 total, 8 up, 8 in 2024-02-05T07:32:01.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:01 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:01.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:01 smithi184 ceph-mon[41609]: pgmap v998: 300 pgs: 300 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:32:01.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:01 smithi184 ceph-mon[41609]: osdmap e645: 8 total, 8 up, 8 in 2024-02-05T07:32:01.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:01 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:32:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:32:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:32:02.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:02 smithi188 ceph-mon[33283]: osdmap e646: 8 total, 8 up, 8 in 2024-02-05T07:32:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:02 smithi188 ceph-mon[33283]: osdmap e647: 8 total, 8 up, 8 in 2024-02-05T07:32:02.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:02 smithi184 ceph-mon[29861]: osdmap e646: 8 total, 8 up, 8 in 2024-02-05T07:32:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:02 smithi184 ceph-mon[29861]: osdmap e647: 8 total, 8 up, 8 in 2024-02-05T07:32:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:02.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:02 smithi184 ceph-mon[41609]: osdmap e646: 8 total, 8 up, 8 in 2024-02-05T07:32:02.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:02.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:02.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:02 smithi184 ceph-mon[41609]: osdmap e647: 8 total, 8 up, 8 in 2024-02-05T07:32:02.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:03.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:03 smithi188 ceph-mon[33283]: pgmap v1001: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:03.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:03 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-130", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:03.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:03 smithi188 ceph-mon[33283]: osdmap e648: 8 total, 8 up, 8 in 2024-02-05T07:32:03.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:03 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-130"}]: dispatch 2024-02-05T07:32:03.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:03 smithi184 ceph-mon[29861]: pgmap v1001: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:03.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:03 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-130", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:03.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:03 smithi184 ceph-mon[29861]: osdmap e648: 8 total, 8 up, 8 in 2024-02-05T07:32:03.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:03 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-130"}]: dispatch 2024-02-05T07:32:03.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:03 smithi184 ceph-mon[41609]: pgmap v1001: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:03.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:03 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-130", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:03.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:03 smithi184 ceph-mon[41609]: osdmap e648: 8 total, 8 up, 8 in 2024-02-05T07:32:03.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:03 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-130"}]: dispatch 2024-02-05T07:32:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:05 smithi188 ceph-mon[33283]: pgmap v1004: 300 pgs: 300 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:32:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-130"}]': finished 2024-02-05T07:32:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:05 smithi188 ceph-mon[33283]: osdmap e649: 8 total, 8 up, 8 in 2024-02-05T07:32:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-130", "mode": "writeback"}]: dispatch 2024-02-05T07:32:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:05 smithi184 ceph-mon[29861]: pgmap v1004: 300 pgs: 300 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:32:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-130"}]': finished 2024-02-05T07:32:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:05 smithi184 ceph-mon[29861]: osdmap e649: 8 total, 8 up, 8 in 2024-02-05T07:32:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-130", "mode": "writeback"}]: dispatch 2024-02-05T07:32:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:05 smithi184 ceph-mon[41609]: pgmap v1004: 300 pgs: 300 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:32:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-130"}]': finished 2024-02-05T07:32:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:05 smithi184 ceph-mon[41609]: osdmap e649: 8 total, 8 up, 8 in 2024-02-05T07:32:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-130", "mode": "writeback"}]: dispatch 2024-02-05T07:32:06.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:06 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:32:06.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-130", "mode": "writeback"}]': finished 2024-02-05T07:32:06.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:06 smithi188 ceph-mon[33283]: osdmap e650: 8 total, 8 up, 8 in 2024-02-05T07:32:06.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:06.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:06 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:32:06.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-130", "mode": "writeback"}]': finished 2024-02-05T07:32:06.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:06 smithi184 ceph-mon[29861]: osdmap e650: 8 total, 8 up, 8 in 2024-02-05T07:32:06.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:06.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:06 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:32:06.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-130", "mode": "writeback"}]': finished 2024-02-05T07:32:06.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:06 smithi184 ceph-mon[41609]: osdmap e650: 8 total, 8 up, 8 in 2024-02-05T07:32:06.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:07.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:07 smithi188 ceph-mon[33283]: pgmap v1007: 300 pgs: 300 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:07.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:32:07.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:07 smithi188 ceph-mon[33283]: osdmap e651: 8 total, 8 up, 8 in 2024-02-05T07:32:07.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:07 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-130"}]: dispatch 2024-02-05T07:32:07.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:07 smithi184 ceph-mon[29861]: pgmap v1007: 300 pgs: 300 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:07.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:32:07.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:07 smithi184 ceph-mon[29861]: osdmap e651: 8 total, 8 up, 8 in 2024-02-05T07:32:07.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:07 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-130"}]: dispatch 2024-02-05T07:32:07.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:07 smithi184 ceph-mon[41609]: pgmap v1007: 300 pgs: 300 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:07.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:32:07.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:07 smithi184 ceph-mon[41609]: osdmap e651: 8 total, 8 up, 8 in 2024-02-05T07:32:07.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:07 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-130"}]: dispatch 2024-02-05T07:32:08.440 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:32:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:32:08.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:08 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:32:08.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-130"}]': finished 2024-02-05T07:32:08.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:08 smithi188 ceph-mon[33283]: osdmap e652: 8 total, 8 up, 8 in 2024-02-05T07:32:08.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:08 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:32:08.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-130"}]': finished 2024-02-05T07:32:08.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:08 smithi184 ceph-mon[29861]: osdmap e652: 8 total, 8 up, 8 in 2024-02-05T07:32:08.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:08 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:32:08.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-130"}]': finished 2024-02-05T07:32:08.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:08 smithi184 ceph-mon[41609]: osdmap e652: 8 total, 8 up, 8 in 2024-02-05T07:32:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:09 smithi188 ceph-mon[33283]: pgmap v1010: 300 pgs: 300 active+clean; 582 KiB data, 668 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-05T07:32:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:09 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:09 smithi188 ceph-mon[33283]: osdmap e653: 8 total, 8 up, 8 in 2024-02-05T07:32:09.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:09.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:09 smithi184 ceph-mon[29861]: pgmap v1010: 300 pgs: 300 active+clean; 582 KiB data, 668 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-05T07:32:09.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:09 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:09.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:09 smithi184 ceph-mon[29861]: osdmap e653: 8 total, 8 up, 8 in 2024-02-05T07:32:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:09 smithi184 ceph-mon[41609]: pgmap v1010: 300 pgs: 300 active+clean; 582 KiB data, 668 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-05T07:32:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:09 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:09 smithi184 ceph-mon[41609]: osdmap e653: 8 total, 8 up, 8 in 2024-02-05T07:32:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:10 smithi188 ceph-mon[33283]: osdmap e654: 8 total, 8 up, 8 in 2024-02-05T07:32:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:10 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:10.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:10 smithi184 ceph-mon[29861]: osdmap e654: 8 total, 8 up, 8 in 2024-02-05T07:32:10.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:10 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:10 smithi184 ceph-mon[41609]: osdmap e654: 8 total, 8 up, 8 in 2024-02-05T07:32:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:10 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:11.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:11 smithi188 ceph-mon[33283]: pgmap v1013: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 668 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:32:11.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:11.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:11 smithi188 ceph-mon[33283]: osdmap e655: 8 total, 8 up, 8 in 2024-02-05T07:32:11.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:11.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-132", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:11 smithi188 ceph-mon[33283]: osdmap e656: 8 total, 8 up, 8 in 2024-02-05T07:32:11.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-132"}]: dispatch 2024-02-05T07:32:11.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:11 smithi184 ceph-mon[29861]: pgmap v1013: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 668 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:32:11.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:11.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:11 smithi184 ceph-mon[29861]: osdmap e655: 8 total, 8 up, 8 in 2024-02-05T07:32:11.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:11.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-132", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:11.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:11 smithi184 ceph-mon[29861]: osdmap e656: 8 total, 8 up, 8 in 2024-02-05T07:32:11.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-132"}]: dispatch 2024-02-05T07:32:11.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:11 smithi184 ceph-mon[41609]: pgmap v1013: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 668 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:32:11.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:11.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:11 smithi184 ceph-mon[41609]: osdmap e655: 8 total, 8 up, 8 in 2024-02-05T07:32:11.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:11.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-132", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:11.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:11 smithi184 ceph-mon[41609]: osdmap e656: 8 total, 8 up, 8 in 2024-02-05T07:32:11.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-132"}]: dispatch 2024-02-05T07:32:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:32:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:32:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:32:13.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:13 smithi188 ceph-mon[33283]: pgmap v1016: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 668 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:13.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-132"}]': finished 2024-02-05T07:32:13.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:13 smithi188 ceph-mon[33283]: osdmap e657: 8 total, 8 up, 8 in 2024-02-05T07:32:13.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-132", "mode": "writeback"}]: dispatch 2024-02-05T07:32:13.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:13 smithi184 ceph-mon[29861]: pgmap v1016: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 668 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:13.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-132"}]': finished 2024-02-05T07:32:13.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:13 smithi184 ceph-mon[29861]: osdmap e657: 8 total, 8 up, 8 in 2024-02-05T07:32:13.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-132", "mode": "writeback"}]: dispatch 2024-02-05T07:32:13.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:13 smithi184 ceph-mon[41609]: pgmap v1016: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 668 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:13.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-132"}]': finished 2024-02-05T07:32:13.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:13 smithi184 ceph-mon[41609]: osdmap e657: 8 total, 8 up, 8 in 2024-02-05T07:32:13.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-132", "mode": "writeback"}]: dispatch 2024-02-05T07:32:14.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:14 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:32:14.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-132", "mode": "writeback"}]': finished 2024-02-05T07:32:14.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:14 smithi188 ceph-mon[33283]: osdmap e658: 8 total, 8 up, 8 in 2024-02-05T07:32:14.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:14 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:32:14.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:14 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:32:14.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:14 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:32:14.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-132", "mode": "writeback"}]': finished 2024-02-05T07:32:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:14 smithi184 ceph-mon[29861]: osdmap e658: 8 total, 8 up, 8 in 2024-02-05T07:32:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:14 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:32:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:14 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:32:14.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:14 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:32:14.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-132", "mode": "writeback"}]': finished 2024-02-05T07:32:14.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:14 smithi184 ceph-mon[41609]: osdmap e658: 8 total, 8 up, 8 in 2024-02-05T07:32:14.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:14 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:32:14.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:14 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:32:15.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:15 smithi188 ceph-mon[33283]: pgmap v1019: 300 pgs: 300 active+clean; 582 KiB data, 669 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:15.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:15 smithi188 ceph-mon[33283]: osdmap e659: 8 total, 8 up, 8 in 2024-02-05T07:32:15.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:15 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:15.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:15 smithi184 ceph-mon[29861]: pgmap v1019: 300 pgs: 300 active+clean; 582 KiB data, 669 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:15.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:15 smithi184 ceph-mon[29861]: osdmap e659: 8 total, 8 up, 8 in 2024-02-05T07:32:15.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:15 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:15.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:15 smithi184 ceph-mon[41609]: pgmap v1019: 300 pgs: 300 active+clean; 582 KiB data, 669 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:15.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:15 smithi184 ceph-mon[41609]: osdmap e659: 8 total, 8 up, 8 in 2024-02-05T07:32:15.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:15 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:16.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:16 smithi188 ceph-mon[33283]: osdmap e660: 8 total, 8 up, 8 in 2024-02-05T07:32:16.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:16.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:16 smithi184 ceph-mon[29861]: osdmap e660: 8 total, 8 up, 8 in 2024-02-05T07:32:16.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:16 smithi184 ceph-mon[41609]: osdmap e660: 8 total, 8 up, 8 in 2024-02-05T07:32:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:17.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:17 smithi188 ceph-mon[33283]: pgmap v1022: 300 pgs: 300 active+clean; 582 KiB data, 669 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:17.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:32:17.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:17 smithi188 ceph-mon[33283]: osdmap e661: 8 total, 8 up, 8 in 2024-02-05T07:32:17.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-132"}]: dispatch 2024-02-05T07:32:17.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:17 smithi184 ceph-mon[29861]: pgmap v1022: 300 pgs: 300 active+clean; 582 KiB data, 669 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:17.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:32:17.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:17 smithi184 ceph-mon[29861]: osdmap e661: 8 total, 8 up, 8 in 2024-02-05T07:32:17.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-132"}]: dispatch 2024-02-05T07:32:17.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:17 smithi184 ceph-mon[41609]: pgmap v1022: 300 pgs: 300 active+clean; 582 KiB data, 669 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:17.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:32:17.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:17 smithi184 ceph-mon[41609]: osdmap e661: 8 total, 8 up, 8 in 2024-02-05T07:32:17.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-132"}]: dispatch 2024-02-05T07:32:18.497 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:32:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:32:18.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-132"}]': finished 2024-02-05T07:32:18.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:18 smithi188 ceph-mon[33283]: osdmap e662: 8 total, 8 up, 8 in 2024-02-05T07:32:18.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-132"}]': finished 2024-02-05T07:32:18.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:18 smithi184 ceph-mon[29861]: osdmap e662: 8 total, 8 up, 8 in 2024-02-05T07:32:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-132"}]': finished 2024-02-05T07:32:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:18 smithi184 ceph-mon[41609]: osdmap e662: 8 total, 8 up, 8 in 2024-02-05T07:32:19.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:19.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:19 smithi188 ceph-mon[33283]: pgmap v1025: 300 pgs: 300 active+clean; 582 KiB data, 670 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-05T07:32:19.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:19 smithi188 ceph-mon[33283]: osdmap e663: 8 total, 8 up, 8 in 2024-02-05T07:32:19.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:19.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:19.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:19 smithi184 ceph-mon[29861]: pgmap v1025: 300 pgs: 300 active+clean; 582 KiB data, 670 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-05T07:32:19.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:19 smithi184 ceph-mon[29861]: osdmap e663: 8 total, 8 up, 8 in 2024-02-05T07:32:19.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:19.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:19.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:19 smithi184 ceph-mon[41609]: pgmap v1025: 300 pgs: 300 active+clean; 582 KiB data, 670 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-05T07:32:19.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:19 smithi184 ceph-mon[41609]: osdmap e663: 8 total, 8 up, 8 in 2024-02-05T07:32:19.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:20.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:32:20.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:20 smithi184 ceph-mon[29861]: osdmap e664: 8 total, 8 up, 8 in 2024-02-05T07:32:20.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-132"}]: dispatch 2024-02-05T07:32:20.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:32:20.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:20 smithi184 ceph-mon[41609]: osdmap e664: 8 total, 8 up, 8 in 2024-02-05T07:32:20.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-132"}]: dispatch 2024-02-05T07:32:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:32:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:20 smithi188 ceph-mon[33283]: osdmap e664: 8 total, 8 up, 8 in 2024-02-05T07:32:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-132"}]: dispatch 2024-02-05T07:32:22.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:21 smithi184 ceph-mon[29861]: pgmap v1028: 300 pgs: 300 active+clean; 582 KiB data, 670 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-05T07:32:22.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:21 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:32:22.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-132"}]': finished 2024-02-05T07:32:22.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:21 smithi184 ceph-mon[29861]: osdmap e665: 8 total, 8 up, 8 in 2024-02-05T07:32:22.021 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:32:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:32:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:32:22.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:21 smithi184 ceph-mon[41609]: pgmap v1028: 300 pgs: 300 active+clean; 582 KiB data, 670 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-05T07:32:22.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:21 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:32:22.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-132"}]': finished 2024-02-05T07:32:22.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:21 smithi184 ceph-mon[41609]: osdmap e665: 8 total, 8 up, 8 in 2024-02-05T07:32:22.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:21 smithi188 ceph-mon[33283]: pgmap v1028: 300 pgs: 300 active+clean; 582 KiB data, 670 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-05T07:32:22.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:21 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:32:22.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-132"}]': finished 2024-02-05T07:32:22.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:21 smithi188 ceph-mon[33283]: osdmap e665: 8 total, 8 up, 8 in 2024-02-05T07:32:23.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:22 smithi184 ceph-mon[29861]: osdmap e666: 8 total, 8 up, 8 in 2024-02-05T07:32:23.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:22 smithi184 ceph-mon[29861]: pgmap v1031: 268 pgs: 268 active+clean; 582 KiB data, 670 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:23.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:22 smithi184 ceph-mon[29861]: osdmap e667: 8 total, 8 up, 8 in 2024-02-05T07:32:23.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:23.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:22 smithi184 ceph-mon[41609]: osdmap e666: 8 total, 8 up, 8 in 2024-02-05T07:32:23.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:22 smithi184 ceph-mon[41609]: pgmap v1031: 268 pgs: 268 active+clean; 582 KiB data, 670 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:23.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:22 smithi184 ceph-mon[41609]: osdmap e667: 8 total, 8 up, 8 in 2024-02-05T07:32:23.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:23.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:22 smithi188 ceph-mon[33283]: osdmap e666: 8 total, 8 up, 8 in 2024-02-05T07:32:23.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:22 smithi188 ceph-mon[33283]: pgmap v1031: 268 pgs: 268 active+clean; 582 KiB data, 670 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:23.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:22 smithi188 ceph-mon[33283]: osdmap e667: 8 total, 8 up, 8 in 2024-02-05T07:32:23.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:24.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:24.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:24 smithi188 ceph-mon[33283]: osdmap e668: 8 total, 8 up, 8 in 2024-02-05T07:32:24.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:24.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:24 smithi188 ceph-mon[33283]: pgmap v1034: 300 pgs: 22 creating+peering, 10 unknown, 268 active+clean; 582 KiB data, 670 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-05T07:32:25.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:25.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:24 smithi184 ceph-mon[29861]: osdmap e668: 8 total, 8 up, 8 in 2024-02-05T07:32:25.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:25.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:24 smithi184 ceph-mon[29861]: pgmap v1034: 300 pgs: 22 creating+peering, 10 unknown, 268 active+clean; 582 KiB data, 670 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-05T07:32:25.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:25.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:24 smithi184 ceph-mon[41609]: osdmap e668: 8 total, 8 up, 8 in 2024-02-05T07:32:25.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:25.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:24 smithi184 ceph-mon[41609]: pgmap v1034: 300 pgs: 22 creating+peering, 10 unknown, 268 active+clean; 582 KiB data, 670 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-05T07:32:25.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-134", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:25.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:25 smithi188 ceph-mon[33283]: osdmap e669: 8 total, 8 up, 8 in 2024-02-05T07:32:25.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-134"}]: dispatch 2024-02-05T07:32:25.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-134"}]': finished 2024-02-05T07:32:25.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:25 smithi188 ceph-mon[33283]: osdmap e670: 8 total, 8 up, 8 in 2024-02-05T07:32:25.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-134", "mode": "writeback"}]: dispatch 2024-02-05T07:32:26.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-134", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:26.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:25 smithi184 ceph-mon[29861]: osdmap e669: 8 total, 8 up, 8 in 2024-02-05T07:32:26.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-134"}]: dispatch 2024-02-05T07:32:26.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-134"}]': finished 2024-02-05T07:32:26.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:25 smithi184 ceph-mon[29861]: osdmap e670: 8 total, 8 up, 8 in 2024-02-05T07:32:26.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-134", "mode": "writeback"}]: dispatch 2024-02-05T07:32:26.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-134", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:26.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:25 smithi184 ceph-mon[41609]: osdmap e669: 8 total, 8 up, 8 in 2024-02-05T07:32:26.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-134"}]: dispatch 2024-02-05T07:32:26.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-134"}]': finished 2024-02-05T07:32:26.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:25 smithi184 ceph-mon[41609]: osdmap e670: 8 total, 8 up, 8 in 2024-02-05T07:32:26.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-134", "mode": "writeback"}]: dispatch 2024-02-05T07:32:26.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:26 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:32:26.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-134", "mode": "writeback"}]': finished 2024-02-05T07:32:26.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:26 smithi188 ceph-mon[33283]: osdmap e671: 8 total, 8 up, 8 in 2024-02-05T07:32:26.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:26.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:26 smithi188 ceph-mon[33283]: pgmap v1038: 300 pgs: 22 creating+peering, 10 unknown, 268 active+clean; 582 KiB data, 670 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-05T07:32:27.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:26 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:32:27.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-134", "mode": "writeback"}]': finished 2024-02-05T07:32:27.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:26 smithi184 ceph-mon[29861]: osdmap e671: 8 total, 8 up, 8 in 2024-02-05T07:32:27.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:27.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:26 smithi184 ceph-mon[29861]: pgmap v1038: 300 pgs: 22 creating+peering, 10 unknown, 268 active+clean; 582 KiB data, 670 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-05T07:32:27.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:26 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:32:27.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-134", "mode": "writeback"}]': finished 2024-02-05T07:32:27.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:26 smithi184 ceph-mon[41609]: osdmap e671: 8 total, 8 up, 8 in 2024-02-05T07:32:27.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:27.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:26 smithi184 ceph-mon[41609]: pgmap v1038: 300 pgs: 22 creating+peering, 10 unknown, 268 active+clean; 582 KiB data, 670 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-05T07:32:28.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:32:28.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:27 smithi188 ceph-mon[33283]: osdmap e672: 8 total, 8 up, 8 in 2024-02-05T07:32:28.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:27 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-134"}]: dispatch 2024-02-05T07:32:28.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:32:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:32:28.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:32:28.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:27 smithi184 ceph-mon[29861]: osdmap e672: 8 total, 8 up, 8 in 2024-02-05T07:32:28.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:27 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-134"}]: dispatch 2024-02-05T07:32:28.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:32:28.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:27 smithi184 ceph-mon[41609]: osdmap e672: 8 total, 8 up, 8 in 2024-02-05T07:32:28.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:27 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-134"}]: dispatch 2024-02-05T07:32:29.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:28 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:32:29.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:28 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-134"}]': finished 2024-02-05T07:32:29.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:28 smithi188 ceph-mon[33283]: osdmap e673: 8 total, 8 up, 8 in 2024-02-05T07:32:29.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:28 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:29.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:28 smithi188 ceph-mon[33283]: pgmap v1041: 300 pgs: 300 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-02-05T07:32:29.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:28 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:32:29.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:28 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-134"}]': finished 2024-02-05T07:32:29.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:28 smithi184 ceph-mon[29861]: osdmap e673: 8 total, 8 up, 8 in 2024-02-05T07:32:29.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:28 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:29.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:28 smithi184 ceph-mon[29861]: pgmap v1041: 300 pgs: 300 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-02-05T07:32:29.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:28 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:32:29.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:28 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-134"}]': finished 2024-02-05T07:32:29.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:28 smithi184 ceph-mon[41609]: osdmap e673: 8 total, 8 up, 8 in 2024-02-05T07:32:29.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:28 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:29.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:28 smithi184 ceph-mon[41609]: pgmap v1041: 300 pgs: 300 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.4 KiB/s wr, 3 op/s 2024-02-05T07:32:30.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:29 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:30.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:29 smithi188 ceph-mon[33283]: osdmap e674: 8 total, 8 up, 8 in 2024-02-05T07:32:30.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:32:30.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:32:30.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:29 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:30.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:29 smithi184 ceph-mon[29861]: osdmap e674: 8 total, 8 up, 8 in 2024-02-05T07:32:30.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:32:30.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:32:30.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:29 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:30.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:29 smithi184 ceph-mon[41609]: osdmap e674: 8 total, 8 up, 8 in 2024-02-05T07:32:30.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:32:30.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:32:31.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:30 smithi188 ceph-mon[33283]: osdmap e675: 8 total, 8 up, 8 in 2024-02-05T07:32:31.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:30 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:31.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:30 smithi188 ceph-mon[33283]: pgmap v1044: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:32:31.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:30 smithi184 ceph-mon[29861]: osdmap e675: 8 total, 8 up, 8 in 2024-02-05T07:32:31.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:30 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:31.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:30 smithi184 ceph-mon[29861]: pgmap v1044: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:32:31.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:30 smithi184 ceph-mon[41609]: osdmap e675: 8 total, 8 up, 8 in 2024-02-05T07:32:31.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:30 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:31.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:30 smithi184 ceph-mon[41609]: pgmap v1044: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:32:32.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:32.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:31 smithi188 ceph-mon[33283]: osdmap e676: 8 total, 8 up, 8 in 2024-02-05T07:32:32.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:31 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:32.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:32.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:31 smithi184 ceph-mon[29861]: osdmap e676: 8 total, 8 up, 8 in 2024-02-05T07:32:32.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:31 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:32.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:32:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:32:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:32:32.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:32.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:31 smithi184 ceph-mon[41609]: osdmap e676: 8 total, 8 up, 8 in 2024-02-05T07:32:32.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:31 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:33.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-136", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:33.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:32 smithi188 ceph-mon[33283]: osdmap e677: 8 total, 8 up, 8 in 2024-02-05T07:32:33.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-136"}]: dispatch 2024-02-05T07:32:33.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:32 smithi188 ceph-mon[33283]: pgmap v1047: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:33.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:32 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-136"}]': finished 2024-02-05T07:32:33.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-136", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:33.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:32 smithi184 ceph-mon[29861]: osdmap e677: 8 total, 8 up, 8 in 2024-02-05T07:32:33.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-136"}]: dispatch 2024-02-05T07:32:33.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:32 smithi184 ceph-mon[29861]: pgmap v1047: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:33.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:32 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-136"}]': finished 2024-02-05T07:32:33.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-136", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:33.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:32 smithi184 ceph-mon[41609]: osdmap e677: 8 total, 8 up, 8 in 2024-02-05T07:32:33.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-136"}]: dispatch 2024-02-05T07:32:33.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:32 smithi184 ceph-mon[41609]: pgmap v1047: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 671 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:33.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:32 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-136"}]': finished 2024-02-05T07:32:34.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:33 smithi188 ceph-mon[33283]: osdmap e678: 8 total, 8 up, 8 in 2024-02-05T07:32:34.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-136", "mode": "writeback"}]: dispatch 2024-02-05T07:32:34.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:33 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:32:34.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-136", "mode": "writeback"}]': finished 2024-02-05T07:32:34.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:33 smithi184 ceph-mon[29861]: osdmap e678: 8 total, 8 up, 8 in 2024-02-05T07:32:34.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-136", "mode": "writeback"}]: dispatch 2024-02-05T07:32:34.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:33 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:32:34.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-136", "mode": "writeback"}]': finished 2024-02-05T07:32:34.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:33 smithi184 ceph-mon[41609]: osdmap e678: 8 total, 8 up, 8 in 2024-02-05T07:32:34.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-136", "mode": "writeback"}]: dispatch 2024-02-05T07:32:34.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:33 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:32:34.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-136", "mode": "writeback"}]': finished 2024-02-05T07:32:35.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:34 smithi184 ceph-mon[29861]: osdmap e679: 8 total, 8 up, 8 in 2024-02-05T07:32:35.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:35.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:34 smithi184 ceph-mon[29861]: pgmap v1050: 300 pgs: 300 active+clean; 582 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:35.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:34 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:35.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:34 smithi184 ceph-mon[41609]: osdmap e679: 8 total, 8 up, 8 in 2024-02-05T07:32:35.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:35.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:34 smithi184 ceph-mon[41609]: pgmap v1050: 300 pgs: 300 active+clean; 582 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:35.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:34 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:35.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:34 smithi188 ceph-mon[33283]: osdmap e679: 8 total, 8 up, 8 in 2024-02-05T07:32:35.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:35.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:34 smithi188 ceph-mon[33283]: pgmap v1050: 300 pgs: 300 active+clean; 582 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:35.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:34 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:36.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:32:36.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:36 smithi184 ceph-mon[29861]: osdmap e680: 8 total, 8 up, 8 in 2024-02-05T07:32:36.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-136"}]: dispatch 2024-02-05T07:32:36.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:32:36.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:36 smithi184 ceph-mon[41609]: osdmap e680: 8 total, 8 up, 8 in 2024-02-05T07:32:36.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-136"}]: dispatch 2024-02-05T07:32:36.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:32:36.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:36 smithi188 ceph-mon[33283]: osdmap e680: 8 total, 8 up, 8 in 2024-02-05T07:32:36.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-136"}]: dispatch 2024-02-05T07:32:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:37 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:32:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-136"}]': finished 2024-02-05T07:32:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:37 smithi188 ceph-mon[33283]: osdmap e681: 8 total, 8 up, 8 in 2024-02-05T07:32:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:37 smithi188 ceph-mon[33283]: pgmap v1053: 300 pgs: 300 active+clean; 582 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:37.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:37 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:32:37.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-136"}]': finished 2024-02-05T07:32:37.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:37 smithi184 ceph-mon[29861]: osdmap e681: 8 total, 8 up, 8 in 2024-02-05T07:32:37.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:37 smithi184 ceph-mon[29861]: pgmap v1053: 300 pgs: 300 active+clean; 582 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:37 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:32:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-136"}]': finished 2024-02-05T07:32:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:37 smithi184 ceph-mon[41609]: osdmap e681: 8 total, 8 up, 8 in 2024-02-05T07:32:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:37 smithi184 ceph-mon[41609]: pgmap v1053: 300 pgs: 300 active+clean; 582 KiB data, 672 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:38.150 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] c 2024-02-05T07:32:38.150 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.150 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.150 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.150 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.150 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.150 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.150 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.151 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.152 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.152 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.152 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.152 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.152 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.152 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.152 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.152 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.152 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.152 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.152 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.152 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.152 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.152 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.153 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.154 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.155 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.155 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.155 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.155 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.155 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.155 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.155 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.155 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.155 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.155 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.155 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.155 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.155 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.155 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.155 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.156 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.156 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.156 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.156 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.156 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.156 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.156 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.156 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.156 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.156 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.156 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.156 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.156 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.156 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.156 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:32:38.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:32:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:32:38.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:38 smithi188 ceph-mon[33283]: osdmap e682: 8 total, 8 up, 8 in 2024-02-05T07:32:38.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:38 smithi188 ceph-mon[33283]: osdmap e683: 8 total, 8 up, 8 in 2024-02-05T07:32:38.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:38.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:38 smithi184 ceph-mon[29861]: osdmap e682: 8 total, 8 up, 8 in 2024-02-05T07:32:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:38 smithi184 ceph-mon[29861]: osdmap e683: 8 total, 8 up, 8 in 2024-02-05T07:32:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:38.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:38 smithi184 ceph-mon[41609]: osdmap e682: 8 total, 8 up, 8 in 2024-02-05T07:32:38.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:38 smithi184 ceph-mon[41609]: osdmap e683: 8 total, 8 up, 8 in 2024-02-05T07:32:38.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:39 smithi188 ceph-mon[33283]: pgmap v1056: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 682 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-05T07:32:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:39 smithi188 ceph-mon[33283]: osdmap e684: 8 total, 8 up, 8 in 2024-02-05T07:32:39.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:39.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:39.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:39 smithi184 ceph-mon[29861]: pgmap v1056: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 682 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-05T07:32:39.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:39.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:39 smithi184 ceph-mon[29861]: osdmap e684: 8 total, 8 up, 8 in 2024-02-05T07:32:39.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:39.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:39.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:39 smithi184 ceph-mon[41609]: pgmap v1056: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 682 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-05T07:32:39.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:39.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:39 smithi184 ceph-mon[41609]: osdmap e684: 8 total, 8 up, 8 in 2024-02-05T07:32:39.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:40.671 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:40 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:40.671 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-138", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:40.671 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:40 smithi184 ceph-mon[29861]: osdmap e685: 8 total, 8 up, 8 in 2024-02-05T07:32:40.671 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:32:40.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:40 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:40.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-138", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:40.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:40 smithi184 ceph-mon[41609]: osdmap e685: 8 total, 8 up, 8 in 2024-02-05T07:32:40.672 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:32:40.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:40 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:40.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-138", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:40.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:40 smithi188 ceph-mon[33283]: osdmap e685: 8 total, 8 up, 8 in 2024-02-05T07:32:40.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:32:41.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:41 smithi188 ceph-mon[33283]: pgmap v1059: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 682 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-05T07:32:41.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:32:41.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:41 smithi188 ceph-mon[33283]: osdmap e686: 8 total, 8 up, 8 in 2024-02-05T07:32:41.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:32:41.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:41 smithi184 ceph-mon[29861]: pgmap v1059: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 682 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-05T07:32:41.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:32:41.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:41 smithi184 ceph-mon[29861]: osdmap e686: 8 total, 8 up, 8 in 2024-02-05T07:32:41.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:32:41.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:41 smithi184 ceph-mon[41609]: pgmap v1059: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 682 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-05T07:32:41.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:32:41.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:41 smithi184 ceph-mon[41609]: osdmap e686: 8 total, 8 up, 8 in 2024-02-05T07:32:41.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:32:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:32:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:32:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:32:43.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:32:43.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:43 smithi188 ceph-mon[33283]: osdmap e687: 8 total, 8 up, 8 in 2024-02-05T07:32:43.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:32:43.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:43 smithi188 ceph-mon[33283]: pgmap v1062: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 682 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:43.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:32:43.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:43 smithi184 ceph-mon[29861]: osdmap e687: 8 total, 8 up, 8 in 2024-02-05T07:32:43.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:32:43.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:43 smithi184 ceph-mon[29861]: pgmap v1062: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 682 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:43.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:32:43.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:43 smithi184 ceph-mon[41609]: osdmap e687: 8 total, 8 up, 8 in 2024-02-05T07:32:43.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-05T07:32:43.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:43 smithi184 ceph-mon[41609]: pgmap v1062: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 682 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:44.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:44 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-05T07:32:44.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:44 smithi188 ceph-mon[33283]: osdmap e688: 8 total, 8 up, 8 in 2024-02-05T07:32:44.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:44 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-05T07:32:44.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:44 smithi184 ceph-mon[29861]: osdmap e688: 8 total, 8 up, 8 in 2024-02-05T07:32:44.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:44 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-05T07:32:44.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:44 smithi184 ceph-mon[41609]: osdmap e688: 8 total, 8 up, 8 in 2024-02-05T07:32:45.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:45.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-138"}]: dispatch 2024-02-05T07:32:45.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:32:45.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:45 smithi188 ceph-mon[33283]: pgmap v1064: 300 pgs: 300 active+clean; 4.4 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:45.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:45 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:45.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:45.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-138"}]: dispatch 2024-02-05T07:32:45.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:32:45.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:45 smithi184 ceph-mon[29861]: pgmap v1064: 300 pgs: 300 active+clean; 4.4 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:45.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:45 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:45.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:32:45.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-138"}]: dispatch 2024-02-05T07:32:45.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:32:45.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:45 smithi184 ceph-mon[41609]: pgmap v1064: 300 pgs: 300 active+clean; 4.4 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:45.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:45 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:32:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-138"}]': finished 2024-02-05T07:32:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:46 smithi188 ceph-mon[33283]: osdmap e689: 8 total, 8 up, 8 in 2024-02-05T07:32:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:46 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:32:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:46 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:32:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:46 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:32:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:46 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:32:46.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-138"}]': finished 2024-02-05T07:32:46.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:46 smithi184 ceph-mon[29861]: osdmap e689: 8 total, 8 up, 8 in 2024-02-05T07:32:46.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:46 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:32:46.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:46 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:32:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:46 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:32:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:46 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:32:46.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-138"}]': finished 2024-02-05T07:32:46.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:46 smithi184 ceph-mon[41609]: osdmap e689: 8 total, 8 up, 8 in 2024-02-05T07:32:46.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:46 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:32:46.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:46 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:32:46.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:46 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:32:46.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:46 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:32:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:47 smithi188 ceph-mon[33283]: osdmap e690: 8 total, 8 up, 8 in 2024-02-05T07:32:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:47 smithi188 ceph-mon[33283]: pgmap v1067: 268 pgs: 268 active+clean; 4.4 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:47 smithi188 ceph-mon[33283]: osdmap e691: 8 total, 8 up, 8 in 2024-02-05T07:32:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:47 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:47.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:47 smithi184 ceph-mon[29861]: osdmap e690: 8 total, 8 up, 8 in 2024-02-05T07:32:47.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:47 smithi184 ceph-mon[29861]: pgmap v1067: 268 pgs: 268 active+clean; 4.4 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:47.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:47 smithi184 ceph-mon[29861]: osdmap e691: 8 total, 8 up, 8 in 2024-02-05T07:32:47.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:47 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:47.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:47 smithi184 ceph-mon[41609]: osdmap e690: 8 total, 8 up, 8 in 2024-02-05T07:32:47.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:47 smithi184 ceph-mon[41609]: pgmap v1067: 268 pgs: 268 active+clean; 4.4 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:47.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:47 smithi184 ceph-mon[41609]: osdmap e691: 8 total, 8 up, 8 in 2024-02-05T07:32:47.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:47 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:32:48.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:32:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:32:49.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:49.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:49 smithi188 ceph-mon[33283]: osdmap e692: 8 total, 8 up, 8 in 2024-02-05T07:32:49.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:49.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:49.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:49 smithi188 ceph-mon[33283]: pgmap v1070: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:49.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:49.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:49 smithi184 ceph-mon[29861]: osdmap e692: 8 total, 8 up, 8 in 2024-02-05T07:32:49.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:49.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:49.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:49 smithi184 ceph-mon[29861]: pgmap v1070: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:49.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:32:49.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:49 smithi184 ceph-mon[41609]: osdmap e692: 8 total, 8 up, 8 in 2024-02-05T07:32:49.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:32:49.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:49.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:49 smithi184 ceph-mon[41609]: pgmap v1070: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:50.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-140", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:50.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:50 smithi188 ceph-mon[33283]: osdmap e693: 8 total, 8 up, 8 in 2024-02-05T07:32:50.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:50 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_count","val": "3"}]: dispatch 2024-02-05T07:32:50.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-140", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:50.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:50 smithi184 ceph-mon[29861]: osdmap e693: 8 total, 8 up, 8 in 2024-02-05T07:32:50.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:50 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_count","val": "3"}]: dispatch 2024-02-05T07:32:50.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-140", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:32:50.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:50 smithi184 ceph-mon[41609]: osdmap e693: 8 total, 8 up, 8 in 2024-02-05T07:32:50.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:50 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_count","val": "3"}]: dispatch 2024-02-05T07:32:51.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_count","val": "3"}]': finished 2024-02-05T07:32:51.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:51 smithi188 ceph-mon[33283]: osdmap e694: 8 total, 8 up, 8 in 2024-02-05T07:32:51.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_period","val": "3"}]: dispatch 2024-02-05T07:32:51.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:51 smithi188 ceph-mon[33283]: pgmap v1073: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:51.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_period","val": "3"}]': finished 2024-02-05T07:32:51.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:51 smithi188 ceph-mon[33283]: osdmap e695: 8 total, 8 up, 8 in 2024-02-05T07:32:51.500 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:51 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:32:51.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_count","val": "3"}]': finished 2024-02-05T07:32:51.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:51 smithi184 ceph-mon[29861]: osdmap e694: 8 total, 8 up, 8 in 2024-02-05T07:32:51.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_period","val": "3"}]: dispatch 2024-02-05T07:32:51.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:51 smithi184 ceph-mon[29861]: pgmap v1073: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:51.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_period","val": "3"}]': finished 2024-02-05T07:32:51.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:51 smithi184 ceph-mon[29861]: osdmap e695: 8 total, 8 up, 8 in 2024-02-05T07:32:51.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:51 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:32:51.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_count","val": "3"}]': finished 2024-02-05T07:32:51.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:51 smithi184 ceph-mon[41609]: osdmap e694: 8 total, 8 up, 8 in 2024-02-05T07:32:51.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_period","val": "3"}]: dispatch 2024-02-05T07:32:51.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:51 smithi184 ceph-mon[41609]: pgmap v1073: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:51.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_period","val": "3"}]': finished 2024-02-05T07:32:51.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:51 smithi184 ceph-mon[41609]: osdmap e695: 8 total, 8 up, 8 in 2024-02-05T07:32:51.522 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:51 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:32:52.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:32:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:32:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:32:53.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:53 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:32:53.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:53 smithi188 ceph-mon[33283]: osdmap e696: 8 total, 8 up, 8 in 2024-02-05T07:32:53.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:53 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-05T07:32:53.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:53 smithi188 ceph-mon[33283]: pgmap v1076: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 683 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:53.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:32:53.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:53 smithi184 ceph-mon[29861]: osdmap e696: 8 total, 8 up, 8 in 2024-02-05T07:32:53.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:53 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-05T07:32:53.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:53 smithi184 ceph-mon[29861]: pgmap v1076: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 683 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:53.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:53 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:32:53.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:53 smithi184 ceph-mon[41609]: osdmap e696: 8 total, 8 up, 8 in 2024-02-05T07:32:53.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:53 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-05T07:32:53.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:53 smithi184 ceph-mon[41609]: pgmap v1076: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 683 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:32:54.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:54 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-05T07:32:54.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:54 smithi188 ceph-mon[33283]: osdmap e697: 8 total, 8 up, 8 in 2024-02-05T07:32:54.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:54 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-05T07:32:54.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:54 smithi184 ceph-mon[29861]: osdmap e697: 8 total, 8 up, 8 in 2024-02-05T07:32:54.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:54 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-05T07:32:54.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:54 smithi184 ceph-mon[41609]: osdmap e697: 8 total, 8 up, 8 in 2024-02-05T07:32:55.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:55 smithi188 ceph-mon[33283]: pgmap v1078: 300 pgs: 300 active+clean; 4.4 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:55.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:55 smithi184 ceph-mon[29861]: pgmap v1078: 300 pgs: 300 active+clean; 4.4 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:55.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:55 smithi184 ceph-mon[41609]: pgmap v1078: 300 pgs: 300 active+clean; 4.4 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:32:57.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:57 smithi188 ceph-mon[33283]: pgmap v1079: 300 pgs: 300 active+clean; 4.4 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:32:57.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:57 smithi184 ceph-mon[29861]: pgmap v1079: 300 pgs: 300 active+clean; 4.4 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:32:57.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:57 smithi184 ceph-mon[41609]: pgmap v1079: 300 pgs: 300 active+clean; 4.4 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:32:58.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:32:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:32:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:59 smithi188 ceph-mon[33283]: pgmap v1080: 300 pgs: 300 active+clean; 4.4 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 5.6 KiB/s wr, 2 op/s 2024-02-05T07:32:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.3", "id": [0, 2]}]: dispatch 2024-02-05T07:32:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.5", "id": [3, 5]}]: dispatch 2024-02-05T07:32:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.d", "id": [3, 7]}]: dispatch 2024-02-05T07:32:59.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:32:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:32:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:59 smithi184 ceph-mon[29861]: pgmap v1080: 300 pgs: 300 active+clean; 4.4 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 5.6 KiB/s wr, 2 op/s 2024-02-05T07:32:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.3", "id": [0, 2]}]: dispatch 2024-02-05T07:32:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.5", "id": [3, 5]}]: dispatch 2024-02-05T07:32:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.d", "id": [3, 7]}]: dispatch 2024-02-05T07:32:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:32:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:32:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:32:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:59 smithi184 ceph-mon[41609]: pgmap v1080: 300 pgs: 300 active+clean; 4.4 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 5.6 KiB/s wr, 2 op/s 2024-02-05T07:32:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.3", "id": [0, 2]}]: dispatch 2024-02-05T07:32:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.5", "id": [3, 5]}]: dispatch 2024-02-05T07:32:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.d", "id": [3, 7]}]: dispatch 2024-02-05T07:32:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:32:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:33:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.3", "id": [0, 2]}]': finished 2024-02-05T07:33:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.5", "id": [3, 5]}]': finished 2024-02-05T07:33:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.d", "id": [3, 7]}]': finished 2024-02-05T07:33:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:00 smithi188 ceph-mon[33283]: osdmap e698: 8 total, 8 up, 8 in 2024-02-05T07:33:00.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.3", "id": [0, 2]}]': finished 2024-02-05T07:33:00.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.5", "id": [3, 5]}]': finished 2024-02-05T07:33:00.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.d", "id": [3, 7]}]': finished 2024-02-05T07:33:00.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:00 smithi184 ceph-mon[29861]: osdmap e698: 8 total, 8 up, 8 in 2024-02-05T07:33:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.3", "id": [0, 2]}]': finished 2024-02-05T07:33:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.5", "id": [3, 5]}]': finished 2024-02-05T07:33:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "327.d", "id": [3, 7]}]': finished 2024-02-05T07:33:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:00 smithi184 ceph-mon[41609]: osdmap e698: 8 total, 8 up, 8 in 2024-02-05T07:33:01.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:01 smithi188 ceph-mon[33283]: pgmap v1082: 300 pgs: 300 active+clean; 4.4 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2024-02-05T07:33:01.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:01 smithi188 ceph-mon[33283]: osdmap e699: 8 total, 8 up, 8 in 2024-02-05T07:33:01.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:01 smithi184 ceph-mon[29861]: pgmap v1082: 300 pgs: 300 active+clean; 4.4 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2024-02-05T07:33:01.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:01 smithi184 ceph-mon[29861]: osdmap e699: 8 total, 8 up, 8 in 2024-02-05T07:33:01.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:01 smithi184 ceph-mon[41609]: pgmap v1082: 300 pgs: 300 active+clean; 4.4 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.1 KiB/s wr, 1 op/s 2024-02-05T07:33:01.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:01 smithi184 ceph-mon[41609]: osdmap e699: 8 total, 8 up, 8 in 2024-02-05T07:33:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:33:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:33:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:33:03.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:03 smithi188 ceph-mon[33283]: pgmap v1084: 300 pgs: 300 active+clean; 4.4 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 5.1 KiB/s wr, 1 op/s 2024-02-05T07:33:03.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:03 smithi184 ceph-mon[29861]: pgmap v1084: 300 pgs: 300 active+clean; 4.4 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 5.1 KiB/s wr, 1 op/s 2024-02-05T07:33:03.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:03 smithi184 ceph-mon[41609]: pgmap v1084: 300 pgs: 300 active+clean; 4.4 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 5.1 KiB/s wr, 1 op/s 2024-02-05T07:33:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:05 smithi188 ceph-mon[33283]: pgmap v1085: 300 pgs: 300 active+clean; 4.5 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-02-05T07:33:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-140"}]: dispatch 2024-02-05T07:33:05.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:05 smithi184 ceph-mon[29861]: pgmap v1085: 300 pgs: 300 active+clean; 4.5 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-02-05T07:33:05.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:05.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-140"}]: dispatch 2024-02-05T07:33:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:05 smithi184 ceph-mon[41609]: pgmap v1085: 300 pgs: 300 active+clean; 4.5 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-02-05T07:33:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-140"}]: dispatch 2024-02-05T07:33:07.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-140"}]': finished 2024-02-05T07:33:07.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:06 smithi188 ceph-mon[33283]: osdmap e700: 8 total, 8 up, 8 in 2024-02-05T07:33:07.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:06 smithi188 ceph-mon[33283]: pgmap v1087: 300 pgs: 300 active+clean; 4.5 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 737 B/s rd, 6.1 KiB/s wr, 1 op/s 2024-02-05T07:33:07.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-140"}]': finished 2024-02-05T07:33:07.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:06 smithi184 ceph-mon[29861]: osdmap e700: 8 total, 8 up, 8 in 2024-02-05T07:33:07.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:06 smithi184 ceph-mon[29861]: pgmap v1087: 300 pgs: 300 active+clean; 4.5 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 737 B/s rd, 6.1 KiB/s wr, 1 op/s 2024-02-05T07:33:07.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-140"}]': finished 2024-02-05T07:33:07.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:06 smithi184 ceph-mon[41609]: osdmap e700: 8 total, 8 up, 8 in 2024-02-05T07:33:07.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:06 smithi184 ceph-mon[41609]: pgmap v1087: 300 pgs: 300 active+clean; 4.5 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 737 B/s rd, 6.1 KiB/s wr, 1 op/s 2024-02-05T07:33:08.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:07 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:08.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:07 smithi188 ceph-mon[33283]: osdmap e701: 8 total, 8 up, 8 in 2024-02-05T07:33:08.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:33:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:33:08.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:07 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:08.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:07 smithi184 ceph-mon[29861]: osdmap e701: 8 total, 8 up, 8 in 2024-02-05T07:33:08.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:07 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:08.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:07 smithi184 ceph-mon[41609]: osdmap e701: 8 total, 8 up, 8 in 2024-02-05T07:33:09.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:08 smithi188 ceph-mon[33283]: osdmap e702: 8 total, 8 up, 8 in 2024-02-05T07:33:09.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:33:09.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:08 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:09.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:08 smithi188 ceph-mon[33283]: pgmap v1090: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 689 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-05T07:33:09.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:33:09.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:08 smithi188 ceph-mon[33283]: osdmap e703: 8 total, 8 up, 8 in 2024-02-05T07:33:09.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:08 smithi184 ceph-mon[29861]: osdmap e702: 8 total, 8 up, 8 in 2024-02-05T07:33:09.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:33:09.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:08 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:09.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:08 smithi184 ceph-mon[29861]: pgmap v1090: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 689 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-05T07:33:09.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:33:09.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:08 smithi184 ceph-mon[29861]: osdmap e703: 8 total, 8 up, 8 in 2024-02-05T07:33:09.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:08 smithi184 ceph-mon[41609]: osdmap e702: 8 total, 8 up, 8 in 2024-02-05T07:33:09.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:33:09.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:08 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:09.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:08 smithi184 ceph-mon[41609]: pgmap v1090: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 689 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-05T07:33:09.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:33:09.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:08 smithi184 ceph-mon[41609]: osdmap e703: 8 total, 8 up, 8 in 2024-02-05T07:33:10.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:33:10.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-142", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:33:10.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:09 smithi188 ceph-mon[33283]: osdmap e704: 8 total, 8 up, 8 in 2024-02-05T07:33:10.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-142"}]: dispatch 2024-02-05T07:33:10.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:33:10.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-142", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:33:10.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:09 smithi184 ceph-mon[29861]: osdmap e704: 8 total, 8 up, 8 in 2024-02-05T07:33:10.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-142"}]: dispatch 2024-02-05T07:33:10.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:33:10.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-142", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:33:10.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:09 smithi184 ceph-mon[41609]: osdmap e704: 8 total, 8 up, 8 in 2024-02-05T07:33:10.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-142"}]: dispatch 2024-02-05T07:33:11.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:11 smithi184 ceph-mon[29861]: pgmap v1093: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 689 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:33:11.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-142"}]': finished 2024-02-05T07:33:11.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:11 smithi184 ceph-mon[29861]: osdmap e705: 8 total, 8 up, 8 in 2024-02-05T07:33:11.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-142", "mode": "writeback"}]: dispatch 2024-02-05T07:33:11.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:11 smithi184 ceph-mon[41609]: pgmap v1093: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 689 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:33:11.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-142"}]': finished 2024-02-05T07:33:11.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:11 smithi184 ceph-mon[41609]: osdmap e705: 8 total, 8 up, 8 in 2024-02-05T07:33:11.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-142", "mode": "writeback"}]: dispatch 2024-02-05T07:33:11.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:11 smithi188 ceph-mon[33283]: pgmap v1093: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 689 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:33:11.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-142"}]': finished 2024-02-05T07:33:11.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:11 smithi188 ceph-mon[33283]: osdmap e705: 8 total, 8 up, 8 in 2024-02-05T07:33:11.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-142", "mode": "writeback"}]: dispatch 2024-02-05T07:33:12.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:12 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:33:12.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-142", "mode": "writeback"}]': finished 2024-02-05T07:33:12.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:12 smithi184 ceph-mon[29861]: osdmap e706: 8 total, 8 up, 8 in 2024-02-05T07:33:12.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:33:12.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:33:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:33:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:33:12.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:12 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:33:12.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-142", "mode": "writeback"}]': finished 2024-02-05T07:33:12.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:12 smithi184 ceph-mon[41609]: osdmap e706: 8 total, 8 up, 8 in 2024-02-05T07:33:12.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:33:12.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:12 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:33:12.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-142", "mode": "writeback"}]': finished 2024-02-05T07:33:12.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:12 smithi188 ceph-mon[33283]: osdmap e706: 8 total, 8 up, 8 in 2024-02-05T07:33:12.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:33:13.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:13 smithi184 ceph-mon[29861]: pgmap v1096: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 689 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:33:13.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:33:13.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:13 smithi184 ceph-mon[29861]: osdmap e707: 8 total, 8 up, 8 in 2024-02-05T07:33:13.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:33:13.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:13 smithi184 ceph-mon[41609]: pgmap v1096: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 689 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:33:13.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:33:13.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:13 smithi184 ceph-mon[41609]: osdmap e707: 8 total, 8 up, 8 in 2024-02-05T07:33:13.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:33:13.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:13 smithi188 ceph-mon[33283]: pgmap v1096: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 689 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:33:13.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:33:13.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:13 smithi188 ceph-mon[33283]: osdmap e707: 8 total, 8 up, 8 in 2024-02-05T07:33:13.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:33:15.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:33:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:14 smithi188 ceph-mon[33283]: osdmap e708: 8 total, 8 up, 8 in 2024-02-05T07:33:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:33:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:14 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:14 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:33:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:14 smithi188 ceph-mon[33283]: pgmap v1099: 300 pgs: 300 active+clean; 4.4 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-05T07:33:15.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:14 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:15.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:33:15.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:14 smithi184 ceph-mon[29861]: osdmap e708: 8 total, 8 up, 8 in 2024-02-05T07:33:15.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:33:15.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:14 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:14 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:33:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:14 smithi184 ceph-mon[29861]: pgmap v1099: 300 pgs: 300 active+clean; 4.4 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-05T07:33:15.272 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:14 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:15.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:33:15.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:14 smithi184 ceph-mon[41609]: osdmap e708: 8 total, 8 up, 8 in 2024-02-05T07:33:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:33:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:14 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:14 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:33:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:14 smithi184 ceph-mon[41609]: pgmap v1099: 300 pgs: 300 active+clean; 4.4 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-05T07:33:15.273 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:14 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:16.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:15 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:33:16.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:33:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:15 smithi188 ceph-mon[33283]: osdmap e709: 8 total, 8 up, 8 in 2024-02-05T07:33:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:33:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-05T07:33:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:15 smithi188 ceph-mon[33283]: osdmap e710: 8 total, 8 up, 8 in 2024-02-05T07:33:16.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-05T07:33:16.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:15 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:33:16.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:33:16.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:15 smithi184 ceph-mon[29861]: osdmap e709: 8 total, 8 up, 8 in 2024-02-05T07:33:16.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:33:16.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-05T07:33:16.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:15 smithi184 ceph-mon[29861]: osdmap e710: 8 total, 8 up, 8 in 2024-02-05T07:33:16.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-05T07:33:16.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:15 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:33:16.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:33:16.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:15 smithi184 ceph-mon[41609]: osdmap e709: 8 total, 8 up, 8 in 2024-02-05T07:33:16.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:33:16.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-05T07:33:16.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:15 smithi184 ceph-mon[41609]: osdmap e710: 8 total, 8 up, 8 in 2024-02-05T07:33:16.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-05T07:33:17.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:17 smithi184 ceph-mon[29861]: pgmap v1102: 300 pgs: 300 active+clean; 4.4 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-05T07:33:17.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-05T07:33:17.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:17 smithi184 ceph-mon[41609]: pgmap v1102: 300 pgs: 300 active+clean; 4.4 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-05T07:33:17.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-05T07:33:17.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:17 smithi188 ceph-mon[33283]: pgmap v1102: 300 pgs: 300 active+clean; 4.4 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-05T07:33:17.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-05T07:33:18.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:18 smithi184 ceph-mon[29861]: osdmap e711: 8 total, 8 up, 8 in 2024-02-05T07:33:18.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-05T07:33:18.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-05T07:33:18.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:18 smithi184 ceph-mon[29861]: osdmap e712: 8 total, 8 up, 8 in 2024-02-05T07:33:18.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:18 smithi184 ceph-mon[41609]: osdmap e711: 8 total, 8 up, 8 in 2024-02-05T07:33:18.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-05T07:33:18.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-05T07:33:18.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:18 smithi184 ceph-mon[41609]: osdmap e712: 8 total, 8 up, 8 in 2024-02-05T07:33:18.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:33:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:33:18.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:18 smithi188 ceph-mon[33283]: osdmap e711: 8 total, 8 up, 8 in 2024-02-05T07:33:18.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-05T07:33:18.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-05T07:33:18.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:18 smithi188 ceph-mon[33283]: osdmap e712: 8 total, 8 up, 8 in 2024-02-05T07:33:19.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:19.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:19.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:19 smithi184 ceph-mon[29861]: pgmap v1105: 300 pgs: 300 active+clean; 4.4 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:33:19.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:19.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:19.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:19 smithi184 ceph-mon[41609]: pgmap v1105: 300 pgs: 300 active+clean; 4.4 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:33:19.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:19.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:19.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:19 smithi188 ceph-mon[33283]: pgmap v1105: 300 pgs: 300 active+clean; 4.4 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:33:20.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:33:20.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:20 smithi188 ceph-mon[33283]: osdmap e713: 8 total, 8 up, 8 in 2024-02-05T07:33:20.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-142"}]: dispatch 2024-02-05T07:33:20.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:33:20.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:20 smithi184 ceph-mon[29861]: osdmap e713: 8 total, 8 up, 8 in 2024-02-05T07:33:20.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-142"}]: dispatch 2024-02-05T07:33:20.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:33:20.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:20 smithi184 ceph-mon[41609]: osdmap e713: 8 total, 8 up, 8 in 2024-02-05T07:33:20.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-142"}]: dispatch 2024-02-05T07:33:21.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-142"}]': finished 2024-02-05T07:33:21.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:21 smithi188 ceph-mon[33283]: osdmap e714: 8 total, 8 up, 8 in 2024-02-05T07:33:21.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:21.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-142"}]: dispatch 2024-02-05T07:33:21.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:21 smithi188 ceph-mon[33283]: pgmap v1108: 300 pgs: 300 active+clean; 4.4 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:33:21.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-142"}]': finished 2024-02-05T07:33:21.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:21 smithi184 ceph-mon[29861]: osdmap e714: 8 total, 8 up, 8 in 2024-02-05T07:33:21.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:21.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-142"}]: dispatch 2024-02-05T07:33:21.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:21 smithi184 ceph-mon[29861]: pgmap v1108: 300 pgs: 300 active+clean; 4.4 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:33:21.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-142"}]': finished 2024-02-05T07:33:21.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:21 smithi184 ceph-mon[41609]: osdmap e714: 8 total, 8 up, 8 in 2024-02-05T07:33:21.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:21.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-142"}]: dispatch 2024-02-05T07:33:21.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:21 smithi184 ceph-mon[41609]: pgmap v1108: 300 pgs: 300 active+clean; 4.4 MiB data, 690 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:33:22.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:22 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:22.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:22 smithi184 ceph-mon[29861]: osdmap e715: 8 total, 8 up, 8 in 2024-02-05T07:33:22.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:22 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:22.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:22 smithi184 ceph-mon[41609]: osdmap e715: 8 total, 8 up, 8 in 2024-02-05T07:33:22.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:33:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:33:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:33:22.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:22 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:22.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:22 smithi188 ceph-mon[33283]: osdmap e715: 8 total, 8 up, 8 in 2024-02-05T07:33:23.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:23 smithi188 ceph-mon[33283]: osdmap e716: 8 total, 8 up, 8 in 2024-02-05T07:33:23.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:33:23.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:23 smithi188 ceph-mon[33283]: pgmap v1111: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 690 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:33:23.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:23 smithi184 ceph-mon[29861]: osdmap e716: 8 total, 8 up, 8 in 2024-02-05T07:33:23.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:33:23.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:23 smithi184 ceph-mon[29861]: pgmap v1111: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 690 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:33:23.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:23 smithi184 ceph-mon[41609]: osdmap e716: 8 total, 8 up, 8 in 2024-02-05T07:33:23.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:33:23.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:23 smithi184 ceph-mon[41609]: pgmap v1111: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 690 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:33:24.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:33:24.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:24 smithi188 ceph-mon[33283]: osdmap e717: 8 total, 8 up, 8 in 2024-02-05T07:33:24.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:33:24.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:33:24.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:24 smithi184 ceph-mon[29861]: osdmap e717: 8 total, 8 up, 8 in 2024-02-05T07:33:24.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:33:24.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:33:24.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:24 smithi184 ceph-mon[41609]: osdmap e717: 8 total, 8 up, 8 in 2024-02-05T07:33:24.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:33:25.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-144", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:33:25.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:25 smithi188 ceph-mon[33283]: osdmap e718: 8 total, 8 up, 8 in 2024-02-05T07:33:25.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-144"}]: dispatch 2024-02-05T07:33:25.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:25 smithi188 ceph-mon[33283]: pgmap v1114: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 708 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-05T07:33:25.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-144"}]': finished 2024-02-05T07:33:25.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-144", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:33:25.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:25 smithi184 ceph-mon[29861]: osdmap e718: 8 total, 8 up, 8 in 2024-02-05T07:33:25.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-144"}]: dispatch 2024-02-05T07:33:25.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:25 smithi184 ceph-mon[29861]: pgmap v1114: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 708 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-05T07:33:25.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-144"}]': finished 2024-02-05T07:33:25.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-144", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:33:25.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:25 smithi184 ceph-mon[41609]: osdmap e718: 8 total, 8 up, 8 in 2024-02-05T07:33:25.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-144"}]: dispatch 2024-02-05T07:33:25.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:25 smithi184 ceph-mon[41609]: pgmap v1114: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 708 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-05T07:33:25.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-144"}]': finished 2024-02-05T07:33:26.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:26 smithi188 ceph-mon[33283]: osdmap e719: 8 total, 8 up, 8 in 2024-02-05T07:33:26.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-144", "mode": "readproxy"}]: dispatch 2024-02-05T07:33:26.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:26 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:33:26.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:26 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-144", "mode": "readproxy"}]': finished 2024-02-05T07:33:26.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:26 smithi188 ceph-mon[33283]: osdmap e720: 8 total, 8 up, 8 in 2024-02-05T07:33:26.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:26 smithi184 ceph-mon[41609]: osdmap e719: 8 total, 8 up, 8 in 2024-02-05T07:33:26.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-144", "mode": "readproxy"}]: dispatch 2024-02-05T07:33:26.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:26 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:33:26.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:26 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-144", "mode": "readproxy"}]': finished 2024-02-05T07:33:26.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:26 smithi184 ceph-mon[41609]: osdmap e720: 8 total, 8 up, 8 in 2024-02-05T07:33:26.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:26 smithi184 ceph-mon[29861]: osdmap e719: 8 total, 8 up, 8 in 2024-02-05T07:33:26.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-144", "mode": "readproxy"}]: dispatch 2024-02-05T07:33:26.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:26 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:33:26.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:26 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-144", "mode": "readproxy"}]': finished 2024-02-05T07:33:26.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:26 smithi184 ceph-mon[29861]: osdmap e720: 8 total, 8 up, 8 in 2024-02-05T07:33:27.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:27 smithi188 ceph-mon[33283]: pgmap v1117: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 708 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-05T07:33:27.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:27 smithi184 ceph-mon[29861]: pgmap v1117: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 708 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-05T07:33:27.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:27 smithi184 ceph-mon[41609]: pgmap v1117: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 708 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-05T07:33:28.499 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:33:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:33:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:29 smithi188 ceph-mon[33283]: pgmap v1118: 300 pgs: 300 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 192 B/s wr, 1 op/s 2024-02-05T07:33:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:33:29.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:29.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:29 smithi184 ceph-mon[29861]: pgmap v1118: 300 pgs: 300 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 192 B/s wr, 1 op/s 2024-02-05T07:33:29.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:33:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:29 smithi184 ceph-mon[41609]: pgmap v1118: 300 pgs: 300 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 192 B/s wr, 1 op/s 2024-02-05T07:33:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:33:30.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:30 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:30.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:30 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:30.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:30 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:31.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:31 smithi188 ceph-mon[33283]: pgmap v1119: 300 pgs: 300 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 973 B/s rd, 162 B/s wr, 1 op/s 2024-02-05T07:33:31.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:31 smithi184 ceph-mon[29861]: pgmap v1119: 300 pgs: 300 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 973 B/s rd, 162 B/s wr, 1 op/s 2024-02-05T07:33:31.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:31 smithi184 ceph-mon[41609]: pgmap v1119: 300 pgs: 300 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 973 B/s rd, 162 B/s wr, 1 op/s 2024-02-05T07:33:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:33:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:33:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:33:33.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:33 smithi188 ceph-mon[33283]: pgmap v1120: 300 pgs: 300 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 127 B/s wr, 0 op/s 2024-02-05T07:33:33.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:33 smithi184 ceph-mon[29861]: pgmap v1120: 300 pgs: 300 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 127 B/s wr, 0 op/s 2024-02-05T07:33:33.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:33 smithi184 ceph-mon[41609]: pgmap v1120: 300 pgs: 300 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 127 B/s wr, 0 op/s 2024-02-05T07:33:35.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:35 smithi188 ceph-mon[33283]: pgmap v1121: 300 pgs: 300 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 110 B/s wr, 1 op/s 2024-02-05T07:33:35.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:35 smithi184 ceph-mon[29861]: pgmap v1121: 300 pgs: 300 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 110 B/s wr, 1 op/s 2024-02-05T07:33:35.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:35 smithi184 ceph-mon[41609]: pgmap v1121: 300 pgs: 300 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 110 B/s wr, 1 op/s 2024-02-05T07:33:36.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:36.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:36.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:37 smithi188 ceph-mon[33283]: pgmap v1122: 300 pgs: 300 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 99 B/s wr, 1 op/s 2024-02-05T07:33:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:33:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:37 smithi188 ceph-mon[33283]: osdmap e721: 8 total, 8 up, 8 in 2024-02-05T07:33:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-144"}]: dispatch 2024-02-05T07:33:37.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:37 smithi184 ceph-mon[29861]: pgmap v1122: 300 pgs: 300 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 99 B/s wr, 1 op/s 2024-02-05T07:33:37.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:33:37.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:37 smithi184 ceph-mon[29861]: osdmap e721: 8 total, 8 up, 8 in 2024-02-05T07:33:37.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-144"}]: dispatch 2024-02-05T07:33:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:37 smithi184 ceph-mon[41609]: pgmap v1122: 300 pgs: 300 active+clean; 4.4 MiB data, 709 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 99 B/s wr, 1 op/s 2024-02-05T07:33:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:33:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:37 smithi184 ceph-mon[41609]: osdmap e721: 8 total, 8 up, 8 in 2024-02-05T07:33:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-144"}]: dispatch 2024-02-05T07:33:38.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:33:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:33:38.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:38 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:33:38.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-144"}]': finished 2024-02-05T07:33:38.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:38 smithi188 ceph-mon[33283]: osdmap e722: 8 total, 8 up, 8 in 2024-02-05T07:33:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:38.499 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-144"}]: dispatch 2024-02-05T07:33:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:38 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:33:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-144"}]': finished 2024-02-05T07:33:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:38 smithi184 ceph-mon[29861]: osdmap e722: 8 total, 8 up, 8 in 2024-02-05T07:33:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-144"}]: dispatch 2024-02-05T07:33:38.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:38 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:33:38.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-144"}]': finished 2024-02-05T07:33:38.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:38 smithi184 ceph-mon[41609]: osdmap e722: 8 total, 8 up, 8 in 2024-02-05T07:33:38.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:38.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-144"}]: dispatch 2024-02-05T07:33:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:39 smithi188 ceph-mon[33283]: pgmap v1125: 300 pgs: 300 active+clean; 4.4 MiB data, 693 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:33:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:39 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:39 smithi188 ceph-mon[33283]: osdmap e723: 8 total, 8 up, 8 in 2024-02-05T07:33:39.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:39.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:39 smithi184 ceph-mon[29861]: pgmap v1125: 300 pgs: 300 active+clean; 4.4 MiB data, 693 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:33:39.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:39 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:39.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:39 smithi184 ceph-mon[29861]: osdmap e723: 8 total, 8 up, 8 in 2024-02-05T07:33:39.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:39.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:39 smithi184 ceph-mon[41609]: pgmap v1125: 300 pgs: 300 active+clean; 4.4 MiB data, 693 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:33:39.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:39 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:39.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:39 smithi184 ceph-mon[41609]: osdmap e723: 8 total, 8 up, 8 in 2024-02-05T07:33:40.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:40 smithi188 ceph-mon[33283]: osdmap e724: 8 total, 8 up, 8 in 2024-02-05T07:33:40.751 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:33:40.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:40 smithi184 ceph-mon[29861]: osdmap e724: 8 total, 8 up, 8 in 2024-02-05T07:33:40.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:33:40.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:40 smithi184 ceph-mon[41609]: osdmap e724: 8 total, 8 up, 8 in 2024-02-05T07:33:40.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:33:41.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:41 smithi188 ceph-mon[33283]: pgmap v1128: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 693 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:33:41.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:33:41.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:41 smithi188 ceph-mon[33283]: osdmap e725: 8 total, 8 up, 8 in 2024-02-05T07:33:41.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:33:41.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:41 smithi184 ceph-mon[29861]: pgmap v1128: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 693 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:33:41.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:33:41.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:41 smithi184 ceph-mon[29861]: osdmap e725: 8 total, 8 up, 8 in 2024-02-05T07:33:41.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:33:41.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:41 smithi184 ceph-mon[41609]: pgmap v1128: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 693 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:33:41.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:33:41.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:41 smithi184 ceph-mon[41609]: osdmap e725: 8 total, 8 up, 8 in 2024-02-05T07:33:41.773 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:33:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:33:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:33:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:33:42.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-146", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:33:42.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:42 smithi188 ceph-mon[33283]: osdmap e726: 8 total, 8 up, 8 in 2024-02-05T07:33:42.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-146"}]: dispatch 2024-02-05T07:33:42.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-146"}]': finished 2024-02-05T07:33:42.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-146", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:33:42.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:42 smithi184 ceph-mon[29861]: osdmap e726: 8 total, 8 up, 8 in 2024-02-05T07:33:42.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-146"}]: dispatch 2024-02-05T07:33:42.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-146"}]': finished 2024-02-05T07:33:42.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-146", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:33:42.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:42 smithi184 ceph-mon[41609]: osdmap e726: 8 total, 8 up, 8 in 2024-02-05T07:33:42.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-146"}]: dispatch 2024-02-05T07:33:42.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi184-81478-111", "overlaypool": "test-rados-api-smithi184-81478-146"}]': finished 2024-02-05T07:33:43.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:43 smithi188 ceph-mon[33283]: pgmap v1131: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 693 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:33:43.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:43 smithi188 ceph-mon[33283]: osdmap e727: 8 total, 8 up, 8 in 2024-02-05T07:33:43.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-146", "mode": "writeback"}]: dispatch 2024-02-05T07:33:43.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:43 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:33:43.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-146", "mode": "writeback"}]': finished 2024-02-05T07:33:43.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:43 smithi184 ceph-mon[29861]: pgmap v1131: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 693 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:33:43.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:43 smithi184 ceph-mon[29861]: osdmap e727: 8 total, 8 up, 8 in 2024-02-05T07:33:43.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-146", "mode": "writeback"}]: dispatch 2024-02-05T07:33:43.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:43 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:33:43.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-146", "mode": "writeback"}]': finished 2024-02-05T07:33:43.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:43 smithi184 ceph-mon[41609]: pgmap v1131: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 693 MiB used, 715 GiB / 715 GiB avail 2024-02-05T07:33:43.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:43 smithi184 ceph-mon[41609]: osdmap e727: 8 total, 8 up, 8 in 2024-02-05T07:33:43.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-146", "mode": "writeback"}]: dispatch 2024-02-05T07:33:43.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:43 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-05T07:33:43.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi184-81478-146", "mode": "writeback"}]': finished 2024-02-05T07:33:44.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:44 smithi188 ceph-mon[33283]: osdmap e728: 8 total, 8 up, 8 in 2024-02-05T07:33:44.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:44 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:33:44.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:33:44.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:44 smithi184 ceph-mon[29861]: osdmap e728: 8 total, 8 up, 8 in 2024-02-05T07:33:44.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:44 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:33:44.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:33:44.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:44 smithi184 ceph-mon[41609]: osdmap e728: 8 total, 8 up, 8 in 2024-02-05T07:33:44.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:44 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_count","val": "2"}]: dispatch 2024-02-05T07:33:44.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:33:45.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:45 smithi188 ceph-mon[33283]: pgmap v1134: 300 pgs: 300 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:33:45.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:33:45.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:45 smithi188 ceph-mon[33283]: osdmap e729: 8 total, 8 up, 8 in 2024-02-05T07:33:45.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:33:45.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:45 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:45.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:45 smithi184 ceph-mon[29861]: pgmap v1134: 300 pgs: 300 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:33:45.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:33:45.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:45 smithi184 ceph-mon[29861]: osdmap e729: 8 total, 8 up, 8 in 2024-02-05T07:33:45.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:33:45.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:45 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:45.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:45 smithi184 ceph-mon[41609]: pgmap v1134: 300 pgs: 300 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:33:45.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_count","val": "2"}]': finished 2024-02-05T07:33:45.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:45 smithi184 ceph-mon[41609]: osdmap e729: 8 total, 8 up, 8 in 2024-02-05T07:33:45.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_period","val": "600"}]: dispatch 2024-02-05T07:33:45.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:45 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:33:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:33:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:46 smithi188 ceph-mon[33283]: osdmap e730: 8 total, 8 up, 8 in 2024-02-05T07:33:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:33:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:46 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:33:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:46 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:46.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:46 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:46.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:46 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:46.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:46 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:46.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:46 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:33:46.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:33:46.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:46 smithi188 ceph-mon[33283]: osdmap e731: 8 total, 8 up, 8 in 2024-02-05T07:33:46.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:33:46.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:33:46.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[29861]: osdmap e730: 8 total, 8 up, 8 in 2024-02-05T07:33:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:33:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:33:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:33:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:33:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[29861]: osdmap e731: 8 total, 8 up, 8 in 2024-02-05T07:33:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:33:46.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_period","val": "600"}]': finished 2024-02-05T07:33:46.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[41609]: osdmap e730: 8 total, 8 up, 8 in 2024-02-05T07:33:46.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-05T07:33:46.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:33:46.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:46.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:46.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:46.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:46.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-05T07:33:46.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "hit_set_type","val": "bloom"}]': finished 2024-02-05T07:33:46.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[41609]: osdmap e731: 8 total, 8 up, 8 in 2024-02-05T07:33:46.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-05T07:33:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:47 smithi188 ceph-mon[33283]: pgmap v1137: 300 pgs: 300 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:33:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:47 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:33:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:47 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:33:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:47 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:47 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-05T07:33:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:47 smithi188 ceph-mon[33283]: osdmap e732: 8 total, 8 up, 8 in 2024-02-05T07:33:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:47 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "target_max_objects","val": "1"}]: dispatch 2024-02-05T07:33:47.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:47 smithi184 ceph-mon[29861]: pgmap v1137: 300 pgs: 300 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:33:47.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:47 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:33:47.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:47 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:33:47.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:47 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:47.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:47 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-05T07:33:47.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:47 smithi184 ceph-mon[29861]: osdmap e732: 8 total, 8 up, 8 in 2024-02-05T07:33:47.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:47 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "target_max_objects","val": "1"}]: dispatch 2024-02-05T07:33:47.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:47 smithi184 ceph-mon[41609]: pgmap v1137: 300 pgs: 300 active+clean; 4.4 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-05T07:33:47.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:47 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:33:47.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:47 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:33:47.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:47 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:47.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:47 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-05T07:33:47.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:47 smithi184 ceph-mon[41609]: osdmap e732: 8 total, 8 up, 8 in 2024-02-05T07:33:47.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:47 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "target_max_objects","val": "1"}]: dispatch 2024-02-05T07:33:48.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:33:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:33:49.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:49.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:49 smithi188 ceph-mon[33283]: pgmap v1140: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-05T07:33:49.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:49 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "target_max_objects","val": "1"}]': finished 2024-02-05T07:33:49.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:49 smithi188 ceph-mon[33283]: osdmap e733: 8 total, 8 up, 8 in 2024-02-05T07:33:49.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:49.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:49 smithi184 ceph-mon[29861]: pgmap v1140: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-05T07:33:49.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:49 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "target_max_objects","val": "1"}]': finished 2024-02-05T07:33:49.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:49 smithi184 ceph-mon[29861]: osdmap e733: 8 total, 8 up, 8 in 2024-02-05T07:33:49.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:49.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:49 smithi184 ceph-mon[41609]: pgmap v1140: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-05T07:33:49.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:49 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-146","var": "target_max_objects","val": "1"}]': finished 2024-02-05T07:33:49.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:49 smithi184 ceph-mon[41609]: osdmap e733: 8 total, 8 up, 8 in 2024-02-05T07:33:50.972 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:33:50 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=sqlstore.transactions t=2024-02-05T07:33:50.680079384Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-02-05T07:33:51.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:50 smithi188 ceph-mon[33283]: pgmap v1142: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-05T07:33:51.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:50 smithi184 ceph-mon[29861]: pgmap v1142: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-05T07:33:51.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:50 smithi184 ceph-mon[41609]: pgmap v1142: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-05T07:33:52.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:51 smithi188 ceph-mon[33283]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-05T07:33:52.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:51 smithi184 ceph-mon[29861]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-05T07:33:52.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:51 smithi184 ceph-mon[41609]: Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-05T07:33:52.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:33:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:33:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:33:53.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:52 smithi188 ceph-mon[33283]: pgmap v1143: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-05T07:33:53.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:52 smithi184 ceph-mon[29861]: pgmap v1143: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-05T07:33:53.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:52 smithi184 ceph-mon[41609]: pgmap v1143: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-05T07:33:55.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:55 smithi188 ceph-mon[33283]: pgmap v1144: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-05T07:33:55.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:55 smithi184 ceph-mon[29861]: pgmap v1144: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-05T07:33:55.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:55 smithi184 ceph-mon[41609]: pgmap v1144: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1.8 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-05T07:33:57.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:57 smithi188 ceph-mon[33283]: pgmap v1145: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-05T07:33:57.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:57 smithi184 ceph-mon[29861]: pgmap v1145: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-05T07:33:57.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:57 smithi184 ceph-mon[41609]: pgmap v1145: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-05T07:33:58.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:33:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:33:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:59 smithi188 ceph-mon[33283]: pgmap v1146: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:33:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:59 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:33:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:33:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:59 smithi184 ceph-mon[29861]: pgmap v1146: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:33:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:59 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:33:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:33:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:33:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:59 smithi184 ceph-mon[41609]: pgmap v1146: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:33:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:59 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:33:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:33:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:33:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:34:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:34:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:00 smithi188 ceph-mon[33283]: osdmap e734: 8 total, 8 up, 8 in 2024-02-05T07:34:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:00 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-146"}]: dispatch 2024-02-05T07:34:00.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:34:00.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:00 smithi184 ceph-mon[41609]: osdmap e734: 8 total, 8 up, 8 in 2024-02-05T07:34:00.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:00 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-146"}]: dispatch 2024-02-05T07:34:00.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:34:00.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:00 smithi184 ceph-mon[29861]: osdmap e734: 8 total, 8 up, 8 in 2024-02-05T07:34:00.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:00 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-146"}]: dispatch 2024-02-05T07:34:01.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:01 smithi188 ceph-mon[33283]: pgmap v1148: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:34:01.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-146"}]': finished 2024-02-05T07:34:01.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:01 smithi188 ceph-mon[33283]: osdmap e735: 8 total, 8 up, 8 in 2024-02-05T07:34:01.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:01.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-146"}]: dispatch 2024-02-05T07:34:02.020 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:34:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:34:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:34:02.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:01 smithi184 ceph-mon[29861]: pgmap v1148: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:34:02.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-146"}]': finished 2024-02-05T07:34:02.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:01 smithi184 ceph-mon[29861]: osdmap e735: 8 total, 8 up, 8 in 2024-02-05T07:34:02.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:02.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-146"}]: dispatch 2024-02-05T07:34:02.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:01 smithi184 ceph-mon[41609]: pgmap v1148: 300 pgs: 300 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 B/s wr, 1 op/s 2024-02-05T07:34:02.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-146"}]': finished 2024-02-05T07:34:02.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:01 smithi184 ceph-mon[41609]: osdmap e735: 8 total, 8 up, 8 in 2024-02-05T07:34:02.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:02.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-146"}]: dispatch 2024-02-05T07:34:02.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:02 smithi188 ceph-mon[33283]: osdmap e736: 8 total, 8 up, 8 in 2024-02-05T07:34:02.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:02 smithi188 ceph-mon[33283]: pgmap v1151: 268 pgs: 268 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-02-05T07:34:02.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:02 smithi188 ceph-mon[33283]: osdmap e737: 8 total, 8 up, 8 in 2024-02-05T07:34:02.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:34:03.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:02 smithi184 ceph-mon[29861]: osdmap e736: 8 total, 8 up, 8 in 2024-02-05T07:34:03.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:02 smithi184 ceph-mon[29861]: pgmap v1151: 268 pgs: 268 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-02-05T07:34:03.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:02 smithi184 ceph-mon[29861]: osdmap e737: 8 total, 8 up, 8 in 2024-02-05T07:34:03.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:34:03.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:02 smithi184 ceph-mon[41609]: osdmap e736: 8 total, 8 up, 8 in 2024-02-05T07:34:03.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:02 smithi184 ceph-mon[41609]: pgmap v1151: 268 pgs: 268 active+clean; 4.4 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-02-05T07:34:03.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:02 smithi184 ceph-mon[41609]: osdmap e737: 8 total, 8 up, 8 in 2024-02-05T07:34:03.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:34:03.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:03 smithi188 ceph-mon[33283]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-05T07:34:03.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:03 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:34:03.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:03 smithi188 ceph-mon[33283]: osdmap e738: 8 total, 8 up, 8 in 2024-02-05T07:34:03.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:03 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:34:04.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:03 smithi184 ceph-mon[29861]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-05T07:34:04.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:03 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:34:04.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:03 smithi184 ceph-mon[29861]: osdmap e738: 8 total, 8 up, 8 in 2024-02-05T07:34:04.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:03 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:34:04.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:03 smithi184 ceph-mon[41609]: Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-05T07:34:04.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:03 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:34:04.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:03 smithi184 ceph-mon[41609]: osdmap e738: 8 total, 8 up, 8 in 2024-02-05T07:34:04.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:03 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-05T07:34:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:05 smithi188 ceph-mon[33283]: pgmap v1154: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 756 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-05T07:34:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-148", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:34:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:05 smithi188 ceph-mon[33283]: osdmap e739: 8 total, 8 up, 8 in 2024-02-05T07:34:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:05 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-148"}]: dispatch 2024-02-05T07:34:05.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:05 smithi184 ceph-mon[29861]: pgmap v1154: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 756 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-05T07:34:05.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-148", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:34:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:05 smithi184 ceph-mon[29861]: osdmap e739: 8 total, 8 up, 8 in 2024-02-05T07:34:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:05 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-148"}]: dispatch 2024-02-05T07:34:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:05 smithi184 ceph-mon[41609]: pgmap v1154: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 756 MiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-05T07:34:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-148", "force_nonempty": "--force-nonempty" }]': finished 2024-02-05T07:34:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:05 smithi184 ceph-mon[41609]: osdmap e739: 8 total, 8 up, 8 in 2024-02-05T07:34:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:05 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-148"}]: dispatch 2024-02-05T07:34:06.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-148"}]': finished 2024-02-05T07:34:06.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:06 smithi188 ceph-mon[33283]: osdmap e740: 8 total, 8 up, 8 in 2024-02-05T07:34:06.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:06.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:06 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-148"}]: dispatch 2024-02-05T07:34:06.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-148"}]': finished 2024-02-05T07:34:06.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:06 smithi184 ceph-mon[29861]: osdmap e740: 8 total, 8 up, 8 in 2024-02-05T07:34:06.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:06.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:06 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-148"}]: dispatch 2024-02-05T07:34:06.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-148"}]': finished 2024-02-05T07:34:06.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:06 smithi184 ceph-mon[41609]: osdmap e740: 8 total, 8 up, 8 in 2024-02-05T07:34:06.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:06.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:06 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-148"}]: dispatch 2024-02-05T07:34:07.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:07 smithi188 ceph-mon[33283]: pgmap v1157: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:07.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:07 smithi188 ceph-mon[33283]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:34:07.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:07 smithi188 ceph-mon[33283]: osdmap e741: 8 total, 8 up, 8 in 2024-02-05T07:34:07.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:07 smithi184 ceph-mon[29861]: pgmap v1157: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:07.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:07 smithi184 ceph-mon[29861]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:34:07.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:07 smithi184 ceph-mon[29861]: osdmap e741: 8 total, 8 up, 8 in 2024-02-05T07:34:07.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:07 smithi184 ceph-mon[41609]: pgmap v1157: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 756 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:07.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:07 smithi184 ceph-mon[41609]: Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:34:07.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:07 smithi184 ceph-mon[41609]: osdmap e741: 8 total, 8 up, 8 in 2024-02-05T07:34:08.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:08 smithi188 ceph-mon[33283]: osdmap e742: 8 total, 8 up, 8 in 2024-02-05T07:34:08.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:08 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:34:08.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:34:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:34:08.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:08 smithi184 ceph-mon[29861]: osdmap e742: 8 total, 8 up, 8 in 2024-02-05T07:34:08.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:08 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:34:08.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:08 smithi184 ceph-mon[41609]: osdmap e742: 8 total, 8 up, 8 in 2024-02-05T07:34:08.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:08 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:34:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:09 smithi188 ceph-mon[33283]: pgmap v1160: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-05T07:34:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:34:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:09 smithi188 ceph-mon[33283]: osdmap e743: 8 total, 8 up, 8 in 2024-02-05T07:34:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:09 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-150"}]: dispatch 2024-02-05T07:34:09.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:09.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:09 smithi184 ceph-mon[29861]: pgmap v1160: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-05T07:34:09.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:34:09.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:09 smithi184 ceph-mon[29861]: osdmap e743: 8 total, 8 up, 8 in 2024-02-05T07:34:09.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:09.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:09 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-150"}]: dispatch 2024-02-05T07:34:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:09 smithi184 ceph-mon[41609]: pgmap v1160: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-05T07:34:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:34:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:09 smithi184 ceph-mon[41609]: osdmap e743: 8 total, 8 up, 8 in 2024-02-05T07:34:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:09 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-150"}]: dispatch 2024-02-05T07:34:10.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:10 smithi184 ceph-mon[29861]: osdmap e744: 8 total, 8 up, 8 in 2024-02-05T07:34:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:10 smithi184 ceph-mon[41609]: osdmap e744: 8 total, 8 up, 8 in 2024-02-05T07:34:10.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:10 smithi188 ceph-mon[33283]: osdmap e744: 8 total, 8 up, 8 in 2024-02-05T07:34:11.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:11 smithi184 ceph-mon[29861]: pgmap v1163: 268 pgs: 268 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-05T07:34:11.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:11 smithi184 ceph-mon[29861]: osdmap e745: 8 total, 8 up, 8 in 2024-02-05T07:34:11.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:11 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:34:11.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:11 smithi184 ceph-mon[41609]: pgmap v1163: 268 pgs: 268 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-05T07:34:11.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:11 smithi184 ceph-mon[41609]: osdmap e745: 8 total, 8 up, 8 in 2024-02-05T07:34:11.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:11 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:34:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:11 smithi188 ceph-mon[33283]: pgmap v1163: 268 pgs: 268 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-05T07:34:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:11 smithi188 ceph-mon[33283]: osdmap e745: 8 total, 8 up, 8 in 2024-02-05T07:34:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:11 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:34:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:34:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:34:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:34:12.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:34:12.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:12 smithi188 ceph-mon[33283]: osdmap e746: 8 total, 8 up, 8 in 2024-02-05T07:34:12.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:12.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:12 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-152"}]: dispatch 2024-02-05T07:34:13.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:34:13.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:12 smithi184 ceph-mon[29861]: osdmap e746: 8 total, 8 up, 8 in 2024-02-05T07:34:13.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:13.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:12 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-152"}]: dispatch 2024-02-05T07:34:13.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:34:13.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:12 smithi184 ceph-mon[41609]: osdmap e746: 8 total, 8 up, 8 in 2024-02-05T07:34:13.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:13.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:12 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-152"}]: dispatch 2024-02-05T07:34:13.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:13 smithi188 ceph-mon[33283]: pgmap v1166: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:34:13.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:13 smithi188 ceph-mon[33283]: osdmap e747: 8 total, 8 up, 8 in 2024-02-05T07:34:14.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:13 smithi184 ceph-mon[29861]: pgmap v1166: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:34:14.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:13 smithi184 ceph-mon[29861]: osdmap e747: 8 total, 8 up, 8 in 2024-02-05T07:34:14.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:13 smithi184 ceph-mon[41609]: pgmap v1166: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 757 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:34:14.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:13 smithi184 ceph-mon[41609]: osdmap e747: 8 total, 8 up, 8 in 2024-02-05T07:34:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:14 smithi188 ceph-mon[33283]: osdmap e748: 8 total, 8 up, 8 in 2024-02-05T07:34:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:34:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:14 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:34:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:14 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:34:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:14 smithi188 ceph-mon[33283]: pgmap v1169: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 769 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-05T07:34:15.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:14 smithi184 ceph-mon[29861]: osdmap e748: 8 total, 8 up, 8 in 2024-02-05T07:34:15.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:34:15.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:14 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:34:15.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:14 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:34:15.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:14 smithi184 ceph-mon[29861]: pgmap v1169: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 769 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-05T07:34:15.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:14 smithi184 ceph-mon[41609]: osdmap e748: 8 total, 8 up, 8 in 2024-02-05T07:34:15.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:34:15.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:14 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:34:15.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:14 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:34:15.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:14 smithi184 ceph-mon[41609]: pgmap v1169: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 769 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-05T07:34:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:34:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:15 smithi188 ceph-mon[33283]: osdmap e749: 8 total, 8 up, 8 in 2024-02-05T07:34:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-111","var": "dedup_tier","val": "test-rados-api-smithi184-81478-154"}]: dispatch 2024-02-05T07:34:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-154"}]: dispatch 2024-02-05T07:34:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:15 smithi188 ceph-mon[33283]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:34:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:34:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:15 smithi184 ceph-mon[29861]: osdmap e749: 8 total, 8 up, 8 in 2024-02-05T07:34:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-111","var": "dedup_tier","val": "test-rados-api-smithi184-81478-154"}]: dispatch 2024-02-05T07:34:16.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:16.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-154"}]: dispatch 2024-02-05T07:34:16.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:15 smithi184 ceph-mon[29861]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:34:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi184-81478-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:34:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:15 smithi184 ceph-mon[41609]: osdmap e749: 8 total, 8 up, 8 in 2024-02-05T07:34:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi184-81478-111","var": "dedup_tier","val": "test-rados-api-smithi184-81478-154"}]: dispatch 2024-02-05T07:34:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi184-81478-111", "tierpool": "test-rados-api-smithi184-81478-154"}]: dispatch 2024-02-05T07:34:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:15 smithi184 ceph-mon[41609]: Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:34:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:16 smithi188 ceph-mon[33283]: osdmap e750: 8 total, 8 up, 8 in 2024-02-05T07:34:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:16 smithi188 ceph-mon[33283]: pgmap v1172: 268 pgs: 268 active+clean; 4.4 MiB data, 769 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-05T07:34:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:16 smithi188 ceph-mon[33283]: osdmap e751: 8 total, 8 up, 8 in 2024-02-05T07:34:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:17.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:16 smithi184 ceph-mon[29861]: osdmap e750: 8 total, 8 up, 8 in 2024-02-05T07:34:17.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:16 smithi184 ceph-mon[29861]: pgmap v1172: 268 pgs: 268 active+clean; 4.4 MiB data, 769 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-05T07:34:17.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:16 smithi184 ceph-mon[29861]: osdmap e751: 8 total, 8 up, 8 in 2024-02-05T07:34:17.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:17.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:16 smithi184 ceph-mon[41609]: osdmap e750: 8 total, 8 up, 8 in 2024-02-05T07:34:17.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:16 smithi184 ceph-mon[41609]: pgmap v1172: 268 pgs: 268 active+clean; 4.4 MiB data, 769 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 767 B/s wr, 4 op/s 2024-02-05T07:34:17.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:16 smithi184 ceph-mon[41609]: osdmap e751: 8 total, 8 up, 8 in 2024-02-05T07:34:17.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:18.161 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.161 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.161 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.162 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.162 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.162 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.162 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.162 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.162 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.162 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.162 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.162 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.162 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.162 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.162 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.162 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.162 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.162 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.163 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.163 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.163 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.163 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.163 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.163 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.163 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.163 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.163 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.163 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.163 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.163 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.163 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.164 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.164 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.164 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.164 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.164 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.164 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.164 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.164 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.164 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.164 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.164 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.164 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.164 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.165 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.165 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.165 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.165 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.165 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.165 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.165 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.165 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.165 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.165 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.165 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.165 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.165 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.166 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.166 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.166 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.166 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.166 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.166 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.166 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.166 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.166 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.166 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.166 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.166 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.166 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.167 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.167 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.167 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.167 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.167 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.167 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.167 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.167 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.167 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.167 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.167 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.167 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.167 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.168 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.168 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.168 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.168 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.168 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.168 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.168 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.168 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.168 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.168 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.168 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.168 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.168 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.168 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.169 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.169 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.169 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:34:18.560 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:34:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:34:18.572 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waitLibRadosTwoPoolsECPP.TryFlush (7915 ms) 2024-02-05T07:34:18.572 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-02-05T07:34:18.572 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (13424 ms) 2024-02-05T07:34:18.573 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-02-05T07:34:18.573 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8043 ms) 2024-02-05T07:34:18.573 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-02-05T07:34:18.573 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (13064 ms) 2024-02-05T07:34:18.573 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-02-05T07:34:18.573 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (7460 ms) 2024-02-05T07:34:18.573 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-02-05T07:34:18.573 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8052 ms) 2024-02-05T07:34:18.573 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-02-05T07:34:18.573 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: hmm, no HitSet yet 2024-02-05T07:34:18.573 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: ok, hit_set contains 326:602f83fe:::foo:head 2024-02-05T07:34:18.573 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (9028 ms) 2024-02-05T07:34:18.573 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-02-05T07:34:18.573 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707118374,0 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: first is 1707118374 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707118374,0 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707118374,0 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707118374,1707118376,1707118377,0 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707118374,1707118376,1707118377,0 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707118374,1707118376,1707118377,0 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707118374,1707118376,1707118377,1707118379,1707118380,0 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707118374,1707118376,1707118377,1707118379,1707118380,0 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707118374,1707118376,1707118377,1707118379,1707118380,0 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707118374,1707118376,1707118377,1707118379,1707118380,1707118382,1707118383,0 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707118374,1707118376,1707118377,1707118379,1707118380,1707118382,1707118383,0 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707118374,1707118376,1707118377,1707118379,1707118380,1707118382,1707118383,0 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: got ls 1707118377,1707118379,1707118380,1707118382,1707118383,1707118385,1707118386,0 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: first now 1707118377, trimmed 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (20917 ms) 2024-02-05T07:34:18.574 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-02-05T07:34:18.575 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: foo0 2024-02-05T07:34:18.575 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-02-05T07:34:18.575 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (14065 ms) 2024-02-05T07:34:18.575 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-02-05T07:34:18.575 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (17416 ms) 2024-02-05T07:34:18.575 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-02-05T07:34:18.575 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (23004 ms) 2024-02-05T07:34:18.575 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-02-05T07:34:18.575 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5027 ms) 2024-02-05T07:34:18.575 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-02-05T07:34:18.575 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (3019 ms) 2024-02-05T07:34:18.575 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-02-05T07:34:18.575 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (3034 ms) 2024-02-05T07:34:18.575 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-02-05T07:34:18.576 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3016 ms) 2024-02-05T07:34:18.576 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (231794 ms total) 2024-02-05T07:34:18.576 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: 2024-02-05T07:34:18.576 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-02-05T07:34:18.576 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (859811 ms total) 2024-02-05T07:34:18.576 INFO:tasks.workunit.client.0.smithi184.stdout: api_tier_pp: [ PASSED ] 77 tests. 2024-02-05T07:34:18.577 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:34:18.577 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81188 2024-02-05T07:34:18.577 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81188 2024-02-05T07:34:18.577 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:34:18.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81444 2024-02-05T07:34:18.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81444 2024-02-05T07:34:18.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:34:18.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81910 2024-02-05T07:34:18.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81910 2024-02-05T07:34:18.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:34:18.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81656 2024-02-05T07:34:18.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81656 2024-02-05T07:34:18.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:34:18.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81519 2024-02-05T07:34:18.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81519 2024-02-05T07:34:18.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:34:18.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81275 2024-02-05T07:34:18.578 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81275 2024-02-05T07:34:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:34:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:18 smithi188 ceph-mon[33283]: osdmap e752: 8 total, 8 up, 8 in 2024-02-05T07:34:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:18 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:18 smithi188 ceph-mon[33283]: pgmap v1175: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:34:19.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:34:19.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:18 smithi184 ceph-mon[29861]: osdmap e752: 8 total, 8 up, 8 in 2024-02-05T07:34:19.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:19.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:18 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:19.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:18 smithi184 ceph-mon[29861]: pgmap v1175: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:34:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:34:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:18 smithi184 ceph-mon[41609]: osdmap e752: 8 total, 8 up, 8 in 2024-02-05T07:34:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-111"}]: dispatch 2024-02-05T07:34:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:18 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:18 smithi184 ceph-mon[41609]: pgmap v1175: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:34:19.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:19 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:34:19.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:19 smithi188 ceph-mon[33283]: osdmap e753: 8 total, 8 up, 8 in 2024-02-05T07:34:20.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:19 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:34:20.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:19 smithi184 ceph-mon[29861]: osdmap e753: 8 total, 8 up, 8 in 2024-02-05T07:34:20.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:19 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1141983323' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi184-81478-111"}]': finished 2024-02-05T07:34:20.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:19 smithi184 ceph-mon[41609]: osdmap e753: 8 total, 8 up, 8 in 2024-02-05T07:34:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:20 smithi188 ceph-mon[33283]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:34:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:20 smithi188 ceph-mon[33283]: pgmap v1177: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:34:21.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:20 smithi184 ceph-mon[29861]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:34:21.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:20 smithi184 ceph-mon[29861]: pgmap v1177: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:34:21.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:20 smithi184 ceph-mon[41609]: Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:34:21.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:20 smithi184 ceph-mon[41609]: pgmap v1177: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:34:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:34:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:34:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:34:23.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:23 smithi188 ceph-mon[33283]: pgmap v1178: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:34:23.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:23 smithi184 ceph-mon[29861]: pgmap v1178: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:34:23.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:23 smithi184 ceph-mon[41609]: pgmap v1178: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:34:25.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:25 smithi188 ceph-mon[33283]: pgmap v1179: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-05T07:34:25.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:25 smithi184 ceph-mon[29861]: pgmap v1179: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-05T07:34:25.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:25 smithi184 ceph-mon[41609]: pgmap v1179: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-05T07:34:27.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:27 smithi188 ceph-mon[33283]: pgmap v1180: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 580 B/s rd, 0 op/s 2024-02-05T07:34:27.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:27 smithi184 ceph-mon[29861]: pgmap v1180: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 580 B/s rd, 0 op/s 2024-02-05T07:34:27.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:27 smithi184 ceph-mon[41609]: pgmap v1180: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 580 B/s rd, 0 op/s 2024-02-05T07:34:28.649 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:34:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:34:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:29 smithi188 ceph-mon[33283]: pgmap v1181: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:34:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:34:29.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:29.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:29 smithi184 ceph-mon[29861]: pgmap v1181: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:34:29.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:34:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:29 smithi184 ceph-mon[41609]: pgmap v1181: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:34:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:34:31.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:30 smithi188 ceph-mon[33283]: pgmap v1182: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 866 B/s rd, 0 op/s 2024-02-05T07:34:31.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:30 smithi184 ceph-mon[29861]: pgmap v1182: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 866 B/s rd, 0 op/s 2024-02-05T07:34:31.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:30 smithi184 ceph-mon[41609]: pgmap v1182: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 866 B/s rd, 0 op/s 2024-02-05T07:34:32.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:34:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:34:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:34:33.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:33 smithi188 ceph-mon[33283]: pgmap v1183: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:34:33.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:33 smithi184 ceph-mon[29861]: pgmap v1183: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:34:33.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:33 smithi184 ceph-mon[41609]: pgmap v1183: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:34:35.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:35 smithi188 ceph-mon[33283]: pgmap v1184: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:35.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:35 smithi184 ceph-mon[29861]: pgmap v1184: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:35.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:35 smithi184 ceph-mon[41609]: pgmap v1184: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:37 smithi188 ceph-mon[33283]: pgmap v1185: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:34:37.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:37 smithi184 ceph-mon[29861]: pgmap v1185: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:34:37.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:37 smithi184 ceph-mon[41609]: pgmap v1185: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:34:38.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:34:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:34:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:39 smithi188 ceph-mon[33283]: pgmap v1186: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:39.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:39.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:39 smithi184 ceph-mon[29861]: pgmap v1186: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:39.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:39.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:39 smithi184 ceph-mon[41609]: pgmap v1186: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:41.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:40 smithi188 ceph-mon[33283]: pgmap v1187: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:34:41.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:40 smithi184 ceph-mon[29861]: pgmap v1187: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:34:41.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:40 smithi184 ceph-mon[41609]: pgmap v1187: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:34:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:34:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:34:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:34:43.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:43 smithi188 ceph-mon[33283]: pgmap v1188: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:34:43.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:43 smithi184 ceph-mon[29861]: pgmap v1188: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:34:43.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:43 smithi184 ceph-mon[41609]: pgmap v1188: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:34:44.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:34:44.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:34:44.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:34:45.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:45 smithi188 ceph-mon[33283]: pgmap v1189: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:45.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:45 smithi184 ceph-mon[29861]: pgmap v1189: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:45.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:45 smithi184 ceph-mon[41609]: pgmap v1189: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:47 smithi188 ceph-mon[33283]: pgmap v1190: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:34:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:47 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:34:47.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:47 smithi184 ceph-mon[29861]: pgmap v1190: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:34:47.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:47 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:34:47.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:47 smithi184 ceph-mon[41609]: pgmap v1190: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:34:47.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:47 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:34:48.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:34:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:34:48.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:48 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:34:48.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:48 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:34:48.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:48 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:34:48.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:48 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:34:48.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:48 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:34:48.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:48 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:34:48.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:48 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:34:48.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:48 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:34:48.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:48 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:34:49.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:49.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:49 smithi188 ceph-mon[33283]: pgmap v1191: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:49.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:49.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:49 smithi184 ceph-mon[29861]: pgmap v1191: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:49.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:49.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:49 smithi184 ceph-mon[41609]: pgmap v1191: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:51.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:50 smithi188 ceph-mon[33283]: pgmap v1192: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:34:51.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:50 smithi184 ceph-mon[29861]: pgmap v1192: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:34:51.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:50 smithi184 ceph-mon[41609]: pgmap v1192: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:34:52.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:34:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:34:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:34:53.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:53 smithi188 ceph-mon[33283]: pgmap v1193: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:34:53.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:53 smithi184 ceph-mon[29861]: pgmap v1193: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:34:53.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:53 smithi184 ceph-mon[41609]: pgmap v1193: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:34:55.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:55 smithi188 ceph-mon[33283]: pgmap v1194: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:55.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:55 smithi184 ceph-mon[29861]: pgmap v1194: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:55.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:55 smithi184 ceph-mon[41609]: pgmap v1194: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:57.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:57 smithi188 ceph-mon[33283]: pgmap v1195: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:34:57.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:57 smithi184 ceph-mon[29861]: pgmap v1195: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:34:57.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:57 smithi184 ceph-mon[41609]: pgmap v1195: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:34:58.649 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:34:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:34:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:59 smithi188 ceph-mon[33283]: pgmap v1196: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:34:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:34:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:59 smithi184 ceph-mon[29861]: pgmap v1196: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:34:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:34:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:34:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:59 smithi184 ceph-mon[41609]: pgmap v1196: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:34:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:34:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:35:01.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:00 smithi188 ceph-mon[33283]: pgmap v1197: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:01.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:00 smithi184 ceph-mon[29861]: pgmap v1197: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:01.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:00 smithi184 ceph-mon[41609]: pgmap v1197: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:35:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:35:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:35:03.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:03 smithi188 ceph-mon[33283]: pgmap v1198: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:03.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:03 smithi184 ceph-mon[29861]: pgmap v1198: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:03.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:03 smithi184 ceph-mon[41609]: pgmap v1198: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:05 smithi188 ceph-mon[33283]: pgmap v1199: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:05 smithi184 ceph-mon[29861]: pgmap v1199: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:05 smithi184 ceph-mon[41609]: pgmap v1199: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:07.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:07 smithi188 ceph-mon[33283]: pgmap v1200: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:07.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:07 smithi184 ceph-mon[29861]: pgmap v1200: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:07.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:07 smithi184 ceph-mon[41609]: pgmap v1200: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:08.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:35:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:35:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:09 smithi188 ceph-mon[33283]: pgmap v1201: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:09.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:09.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:09 smithi184 ceph-mon[29861]: pgmap v1201: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:09 smithi184 ceph-mon[41609]: pgmap v1201: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:11.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:10 smithi188 ceph-mon[33283]: pgmap v1202: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:11.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:10 smithi184 ceph-mon[29861]: pgmap v1202: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:11.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:10 smithi184 ceph-mon[41609]: pgmap v1202: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:35:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:35:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:35:13.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:13 smithi188 ceph-mon[33283]: pgmap v1203: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:13.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:13 smithi184 ceph-mon[29861]: pgmap v1203: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:13.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:13 smithi184 ceph-mon[41609]: pgmap v1203: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:14.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:14 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:35:14.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:14 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:35:14.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:14 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:35:15.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:15 smithi188 ceph-mon[33283]: pgmap v1204: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:15.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:15 smithi184 ceph-mon[29861]: pgmap v1204: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:15.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:15 smithi184 ceph-mon[41609]: pgmap v1204: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:17.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:17 smithi188 ceph-mon[33283]: pgmap v1205: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:17.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:17 smithi184 ceph-mon[29861]: pgmap v1205: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:17.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:17 smithi184 ceph-mon[41609]: pgmap v1205: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:18.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:35:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:35:19.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:19.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:19 smithi188 ceph-mon[33283]: pgmap v1206: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:19.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:19.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:19 smithi184 ceph-mon[29861]: pgmap v1206: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:19.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:19.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:19 smithi184 ceph-mon[41609]: pgmap v1206: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:21.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:20 smithi184 ceph-mon[29861]: pgmap v1207: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:21.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:20 smithi184 ceph-mon[41609]: pgmap v1207: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:21.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:20 smithi188 ceph-mon[33283]: pgmap v1207: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:35:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:35:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:35:23.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:23 smithi188 ceph-mon[33283]: pgmap v1208: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:23.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:23 smithi184 ceph-mon[29861]: pgmap v1208: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:23.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:23 smithi184 ceph-mon[41609]: pgmap v1208: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:25.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:25 smithi188 ceph-mon[33283]: pgmap v1209: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:25.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:25 smithi184 ceph-mon[29861]: pgmap v1209: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:25.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:25 smithi184 ceph-mon[41609]: pgmap v1209: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:27.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:27 smithi188 ceph-mon[33283]: pgmap v1210: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:27.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:27 smithi184 ceph-mon[29861]: pgmap v1210: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:27.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:27 smithi184 ceph-mon[41609]: pgmap v1210: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:28.648 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:35:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:35:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:29 smithi188 ceph-mon[33283]: pgmap v1211: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:35:29.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:29.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:29 smithi184 ceph-mon[29861]: pgmap v1211: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:29.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:35:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:29 smithi184 ceph-mon[41609]: pgmap v1211: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:35:31.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:30 smithi184 ceph-mon[29861]: pgmap v1212: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:31.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:31 smithi184 ceph-mon[41609]: pgmap v1212: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:31.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:30 smithi188 ceph-mon[33283]: pgmap v1212: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:35:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:35:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:35:33.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:33 smithi188 ceph-mon[33283]: pgmap v1213: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:35:33.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:33 smithi184 ceph-mon[29861]: pgmap v1213: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:35:33.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:33 smithi184 ceph-mon[41609]: pgmap v1213: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:35:35.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:35 smithi188 ceph-mon[33283]: pgmap v1214: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:35.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:35 smithi184 ceph-mon[29861]: pgmap v1214: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:35.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:35 smithi184 ceph-mon[41609]: pgmap v1214: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:37.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:37 smithi188 ceph-mon[33283]: pgmap v1215: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:37.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:37 smithi184 ceph-mon[29861]: pgmap v1215: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:37.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:37 smithi184 ceph-mon[41609]: pgmap v1215: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:38.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:35:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:35:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:39 smithi188 ceph-mon[33283]: pgmap v1216: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:39.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:39.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:39 smithi184 ceph-mon[41609]: pgmap v1216: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:39.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:39.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:39 smithi184 ceph-mon[29861]: pgmap v1216: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:41.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:41 smithi184 ceph-mon[41609]: pgmap v1217: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:41.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:41 smithi184 ceph-mon[29861]: pgmap v1217: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:41.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:41 smithi188 ceph-mon[33283]: pgmap v1217: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:35:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:35:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:35:43.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:43 smithi188 ceph-mon[33283]: pgmap v1218: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:35:43.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:43 smithi184 ceph-mon[29861]: pgmap v1218: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:35:43.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:43 smithi184 ceph-mon[41609]: pgmap v1218: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:35:44.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:35:44.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:35:44.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:35:45.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:45 smithi188 ceph-mon[33283]: pgmap v1219: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:45.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:45 smithi184 ceph-mon[29861]: pgmap v1219: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:45.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:45 smithi184 ceph-mon[41609]: pgmap v1219: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:47 smithi188 ceph-mon[33283]: pgmap v1220: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:47.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:47 smithi184 ceph-mon[29861]: pgmap v1220: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:47.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:47 smithi184 ceph-mon[41609]: pgmap v1220: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:48.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:35:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:35:48.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:48 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:35:48.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:48 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:35:48.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:48 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:35:48.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:48 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:35:48.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:48 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:35:48.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:48 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:35:48.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:48 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:35:48.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:48 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:35:48.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:48 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:35:48.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:48 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:35:48.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:48 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:35:48.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:48 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:35:49.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:49.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:49 smithi188 ceph-mon[33283]: pgmap v1221: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:49.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:49.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:49 smithi184 ceph-mon[41609]: pgmap v1221: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:49.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:49.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:49 smithi184 ceph-mon[29861]: pgmap v1221: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:51.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:51 smithi184 ceph-mon[41609]: pgmap v1222: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:35:51.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:51 smithi184 ceph-mon[29861]: pgmap v1222: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:35:51.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:51 smithi188 ceph-mon[33283]: pgmap v1222: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:35:52.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:35:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:35:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:35:53.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:53 smithi188 ceph-mon[33283]: pgmap v1223: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:35:53.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:53 smithi184 ceph-mon[29861]: pgmap v1223: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:35:53.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:53 smithi184 ceph-mon[41609]: pgmap v1223: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:35:55.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:55 smithi188 ceph-mon[33283]: pgmap v1224: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:55.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:55 smithi184 ceph-mon[29861]: pgmap v1224: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:55.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:55 smithi184 ceph-mon[41609]: pgmap v1224: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:57.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:57 smithi188 ceph-mon[33283]: pgmap v1225: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:57.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:57 smithi184 ceph-mon[29861]: pgmap v1225: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:57.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:57 smithi184 ceph-mon[41609]: pgmap v1225: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:35:58.174 INFO:tasks.workunit.client.0.smithi184.stdout:ing 1 sec 2024-02-05T07:35:58.174 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.174 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.174 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.174 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.175 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.176 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.177 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.177 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.177 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.177 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.177 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.177 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.177 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.177 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.178 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.178 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.178 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.178 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.178 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.178 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.178 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.178 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.179 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.179 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.179 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.179 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.179 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.179 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.179 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.179 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.180 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.180 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.180 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.180 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.180 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.180 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.180 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.181 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.181 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.181 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.181 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.181 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.181 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.181 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.181 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.182 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.182 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.182 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.182 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.182 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.182 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.182 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.182 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.183 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.183 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.183 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.183 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.183 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.183 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.183 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.184 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.184 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.184 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.184 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.184 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.184 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.184 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.184 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.185 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.185 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.185 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.185 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.185 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.185 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.185 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:35:58.649 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:35:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:35:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:59 smithi188 ceph-mon[33283]: pgmap v1226: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:35:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:35:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:59 smithi184 ceph-mon[29861]: pgmap v1226: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:35:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:35:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:35:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:59 smithi184 ceph-mon[41609]: pgmap v1226: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:35:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:35:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:36:01.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:01 smithi184 ceph-mon[29861]: pgmap v1227: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:01.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:01 smithi184 ceph-mon[41609]: pgmap v1227: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:01.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:01 smithi188 ceph-mon[33283]: pgmap v1227: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:36:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:36:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:36:03.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:03 smithi188 ceph-mon[33283]: pgmap v1228: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:03.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:03 smithi184 ceph-mon[29861]: pgmap v1228: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:03.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:03 smithi184 ceph-mon[41609]: pgmap v1228: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:05 smithi188 ceph-mon[33283]: pgmap v1229: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:05.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:05 smithi184 ceph-mon[29861]: pgmap v1229: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:05.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:05 smithi184 ceph-mon[41609]: pgmap v1229: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:07.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:07 smithi188 ceph-mon[33283]: pgmap v1230: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:07.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:07 smithi184 ceph-mon[29861]: pgmap v1230: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:07.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:07 smithi184 ceph-mon[41609]: pgmap v1230: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:08.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:36:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:36:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:09.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:09 smithi188 ceph-mon[33283]: pgmap v1231: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:09.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:09.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:09 smithi184 ceph-mon[29861]: pgmap v1231: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:09.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:09 smithi184 ceph-mon[41609]: pgmap v1231: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:11.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:11 smithi184 ceph-mon[29861]: pgmap v1232: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:11.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:11 smithi184 ceph-mon[41609]: pgmap v1232: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:11.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:11 smithi188 ceph-mon[33283]: pgmap v1232: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:36:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:36:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:36:13.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:13 smithi188 ceph-mon[33283]: pgmap v1233: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:13.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:13 smithi184 ceph-mon[29861]: pgmap v1233: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:13.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:13 smithi184 ceph-mon[41609]: pgmap v1233: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:14.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:14 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:36:14.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:14 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:36:14.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:14 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:36:15.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:15 smithi188 ceph-mon[33283]: pgmap v1234: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:15.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:15 smithi184 ceph-mon[29861]: pgmap v1234: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:15.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:15 smithi184 ceph-mon[41609]: pgmap v1234: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:17.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:17 smithi188 ceph-mon[33283]: pgmap v1235: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:17.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:17 smithi184 ceph-mon[29861]: pgmap v1235: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:17.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:17 smithi184 ceph-mon[41609]: pgmap v1235: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:18.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:36:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:36:19.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:19.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:19 smithi188 ceph-mon[33283]: pgmap v1236: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:19.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:19.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:19 smithi184 ceph-mon[29861]: pgmap v1236: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:19.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:19.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:19 smithi184 ceph-mon[41609]: pgmap v1236: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:21.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:21 smithi184 ceph-mon[29861]: pgmap v1237: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:21.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:21 smithi184 ceph-mon[41609]: pgmap v1237: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:21.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:21 smithi188 ceph-mon[33283]: pgmap v1237: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:36:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:36:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:36:23.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:23 smithi188 ceph-mon[33283]: pgmap v1238: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:36:23.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:23 smithi184 ceph-mon[29861]: pgmap v1238: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:36:23.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:23 smithi184 ceph-mon[41609]: pgmap v1238: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:36:25.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:25 smithi188 ceph-mon[33283]: pgmap v1239: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:25.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:25 smithi184 ceph-mon[29861]: pgmap v1239: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:25.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:25 smithi184 ceph-mon[41609]: pgmap v1239: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:27.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:27 smithi188 ceph-mon[33283]: pgmap v1240: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:27.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:27 smithi184 ceph-mon[29861]: pgmap v1240: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:27.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:27 smithi184 ceph-mon[41609]: pgmap v1240: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:28.648 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:36:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:36:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:29 smithi188 ceph-mon[33283]: pgmap v1241: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:29.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:36:29.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:29 smithi184 ceph-mon[41609]: pgmap v1241: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:36:29.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:29.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:29 smithi184 ceph-mon[29861]: pgmap v1241: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:29.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:36:31.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:31 smithi184 ceph-mon[29861]: pgmap v1242: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:31.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:31 smithi184 ceph-mon[41609]: pgmap v1242: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:31.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:31 smithi188 ceph-mon[33283]: pgmap v1242: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:36:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:36:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:36:33.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:33 smithi188 ceph-mon[33283]: pgmap v1243: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:33.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:33 smithi184 ceph-mon[29861]: pgmap v1243: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:33.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:33 smithi184 ceph-mon[41609]: pgmap v1243: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:35.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:35 smithi188 ceph-mon[33283]: pgmap v1244: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:35.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:35 smithi184 ceph-mon[29861]: pgmap v1244: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:35.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:35 smithi184 ceph-mon[41609]: pgmap v1244: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:37 smithi188 ceph-mon[33283]: pgmap v1245: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:37.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:37 smithi184 ceph-mon[29861]: pgmap v1245: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:37 smithi184 ceph-mon[41609]: pgmap v1245: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:38.747 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:36:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:36:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:39 smithi188 ceph-mon[33283]: pgmap v1246: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:39.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:39.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:39 smithi184 ceph-mon[29861]: pgmap v1246: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:39.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:39.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:39 smithi184 ceph-mon[41609]: pgmap v1246: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:41.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:41 smithi184 ceph-mon[29861]: pgmap v1247: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:41.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:41 smithi184 ceph-mon[41609]: pgmap v1247: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:41.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:41 smithi188 ceph-mon[33283]: pgmap v1247: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:36:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:36:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:36:43.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:43 smithi188 ceph-mon[33283]: pgmap v1248: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:36:43.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:43 smithi184 ceph-mon[29861]: pgmap v1248: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:36:43.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:43 smithi184 ceph-mon[41609]: pgmap v1248: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:36:44.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:36:44.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:36:44.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:36:45.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:45 smithi188 ceph-mon[33283]: pgmap v1249: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:45.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:45 smithi184 ceph-mon[29861]: pgmap v1249: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:45.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:45 smithi184 ceph-mon[41609]: pgmap v1249: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:47.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:47 smithi188 ceph-mon[33283]: pgmap v1250: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:47.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:47 smithi184 ceph-mon[41609]: pgmap v1250: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:47.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:47 smithi184 ceph-mon[29861]: pgmap v1250: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:48.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:48 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:36:48.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:36:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:36:48.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:48 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:36:48.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:48 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:36:49.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:49.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:49 smithi184 ceph-mon[29861]: pgmap v1251: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:49.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:49 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:36:49.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:49 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:36:49.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:49 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:36:49.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:49.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:49 smithi184 ceph-mon[41609]: pgmap v1251: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:49.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:49 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:36:49.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:49 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:36:49.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:49 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:36:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:49 smithi188 ceph-mon[33283]: pgmap v1251: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:49 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:36:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:49 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:36:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:49 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:36:51.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:51 smithi184 ceph-mon[29861]: pgmap v1252: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:51.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:51 smithi184 ceph-mon[41609]: pgmap v1252: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:51.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:51 smithi188 ceph-mon[33283]: pgmap v1252: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:52.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:36:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:36:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:36:53.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:53 smithi188 ceph-mon[33283]: pgmap v1253: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:36:53.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:53 smithi184 ceph-mon[29861]: pgmap v1253: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:36:53.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:53 smithi184 ceph-mon[41609]: pgmap v1253: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:36:55.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:55 smithi188 ceph-mon[33283]: pgmap v1254: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:55.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:55 smithi184 ceph-mon[29861]: pgmap v1254: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:55.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:55 smithi184 ceph-mon[41609]: pgmap v1254: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:57.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:57 smithi188 ceph-mon[33283]: pgmap v1255: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:57.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:57 smithi184 ceph-mon[29861]: pgmap v1255: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:57.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:57 smithi184 ceph-mon[41609]: pgmap v1255: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:36:58.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:36:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:36:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:59 smithi188 ceph-mon[33283]: pgmap v1256: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:36:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:36:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:59 smithi184 ceph-mon[29861]: pgmap v1256: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:36:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:36:59.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:36:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:59 smithi184 ceph-mon[41609]: pgmap v1256: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:36:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:36:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:37:01.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:01 smithi188 ceph-mon[33283]: pgmap v1257: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:01.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:01 smithi184 ceph-mon[29861]: pgmap v1257: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:01.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:01 smithi184 ceph-mon[41609]: pgmap v1257: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:37:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:37:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:37:03.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:03 smithi188 ceph-mon[33283]: pgmap v1258: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:03.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:03 smithi184 ceph-mon[29861]: pgmap v1258: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:03.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:03 smithi184 ceph-mon[41609]: pgmap v1258: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:05 smithi188 ceph-mon[33283]: pgmap v1259: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:05.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:05 smithi184 ceph-mon[29861]: pgmap v1259: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:05.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:05 smithi184 ceph-mon[41609]: pgmap v1259: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:07.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:07 smithi188 ceph-mon[33283]: pgmap v1260: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:07.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:07 smithi184 ceph-mon[29861]: pgmap v1260: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:07.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:07 smithi184 ceph-mon[41609]: pgmap v1260: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:08.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:37:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:37:09.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:09.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:09 smithi184 ceph-mon[29861]: pgmap v1261: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:09.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:09 smithi184 ceph-mon[41609]: pgmap v1261: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:09.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:09.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:09 smithi188 ceph-mon[33283]: pgmap v1261: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:11.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:11 smithi188 ceph-mon[33283]: pgmap v1262: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:11.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:11 smithi184 ceph-mon[29861]: pgmap v1262: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:11.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:11 smithi184 ceph-mon[41609]: pgmap v1262: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:37:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:37:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:37:13.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:13 smithi188 ceph-mon[33283]: pgmap v1263: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:13.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:13 smithi184 ceph-mon[29861]: pgmap v1263: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:13.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:13 smithi184 ceph-mon[41609]: pgmap v1263: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:14.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:14 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:37:14.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:14 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:37:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:14 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:37:15.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:15 smithi184 ceph-mon[29861]: pgmap v1264: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:15.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:15 smithi184 ceph-mon[41609]: pgmap v1264: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:15 smithi188 ceph-mon[33283]: pgmap v1264: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:17.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:17 smithi184 ceph-mon[29861]: pgmap v1265: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:17.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:17 smithi184 ceph-mon[41609]: pgmap v1265: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:17 smithi188 ceph-mon[33283]: pgmap v1265: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:18.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:37:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:37:19.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:19.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:19 smithi184 ceph-mon[29861]: pgmap v1266: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:19.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:19.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:19 smithi184 ceph-mon[41609]: pgmap v1266: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:19.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:19.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:19 smithi188 ceph-mon[33283]: pgmap v1266: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:21.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:21 smithi188 ceph-mon[33283]: pgmap v1267: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:21.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:21 smithi184 ceph-mon[29861]: pgmap v1267: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:21.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:21 smithi184 ceph-mon[41609]: pgmap v1267: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:37:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:37:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:37:23.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:23 smithi184 ceph-mon[29861]: pgmap v1268: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:37:23.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:23 smithi184 ceph-mon[41609]: pgmap v1268: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:37:23.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:23 smithi188 ceph-mon[33283]: pgmap v1268: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:37:25.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:25 smithi184 ceph-mon[29861]: pgmap v1269: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:25.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:25 smithi184 ceph-mon[41609]: pgmap v1269: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:25.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:25 smithi188 ceph-mon[33283]: pgmap v1269: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:27.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:27 smithi184 ceph-mon[29861]: pgmap v1270: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:37:27.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:27 smithi184 ceph-mon[41609]: pgmap v1270: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:37:27.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:27 smithi188 ceph-mon[33283]: pgmap v1270: 260 pgs: 260 active+clean; 582 KiB data, 764 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:37:28.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:37:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:37:29.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:29.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:29 smithi184 ceph-mon[29861]: pgmap v1271: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:29.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:29 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:37:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:29 smithi184 ceph-mon[41609]: pgmap v1271: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:29.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:29 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:37:29.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:29.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:29 smithi188 ceph-mon[33283]: pgmap v1271: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:29.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:29 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:37:31.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:31 smithi188 ceph-mon[33283]: pgmap v1272: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:31.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:31 smithi184 ceph-mon[29861]: pgmap v1272: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:31.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:31 smithi184 ceph-mon[41609]: pgmap v1272: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:37:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:37:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:37:33.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:33 smithi184 ceph-mon[29861]: pgmap v1273: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:33.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:33 smithi184 ceph-mon[41609]: pgmap v1273: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:33.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:33 smithi188 ceph-mon[33283]: pgmap v1273: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 36 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:35.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:35 smithi184 ceph-mon[29861]: pgmap v1274: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:35.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:35 smithi184 ceph-mon[41609]: pgmap v1274: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:35.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:35 smithi188 ceph-mon[33283]: pgmap v1274: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:37.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:37 smithi184 ceph-mon[29861]: pgmap v1275: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:37 smithi184 ceph-mon[41609]: pgmap v1275: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:37.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:37 smithi188 ceph-mon[33283]: pgmap v1275: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:38.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.186 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.187 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.188 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.189 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.190 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.191 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.192 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.193 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:37:38.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:37:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:37:39.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:39.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:39 smithi184 ceph-mon[29861]: pgmap v1276: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:39.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:39.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:39 smithi184 ceph-mon[41609]: pgmap v1276: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:39.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:39.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:39 smithi188 ceph-mon[33283]: pgmap v1276: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:37:41.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:41 smithi188 ceph-mon[33283]: pgmap v1277: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:41.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:41 smithi184 ceph-mon[29861]: pgmap v1277: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:41.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:41 smithi184 ceph-mon[41609]: pgmap v1277: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:37:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:37:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:37:43.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:43 smithi184 ceph-mon[29861]: pgmap v1278: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:37:43.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:43 smithi184 ceph-mon[41609]: pgmap v1278: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:37:43.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:43 smithi188 ceph-mon[33283]: pgmap v1278: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:37:44.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:44 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:37:44.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:44 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:37:44.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:44 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:37:45.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:45 smithi184 ceph-mon[29861]: pgmap v1279: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:45.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:45 smithi184 ceph-mon[41609]: pgmap v1279: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:45 smithi188 ceph-mon[33283]: pgmap v1279: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:47.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:47 smithi184 ceph-mon[29861]: pgmap v1280: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:47.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:47 smithi184 ceph-mon[41609]: pgmap v1280: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:47.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:47 smithi188 ceph-mon[33283]: pgmap v1280: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:48.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:37:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:37:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:49 smithi188 ceph-mon[33283]: pgmap v1281: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:49 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:37:50.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:50.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:49 smithi184 ceph-mon[29861]: pgmap v1281: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:50.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:49 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:37:50.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:50.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:49 smithi184 ceph-mon[41609]: pgmap v1281: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:50.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:49 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:37:50.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:50 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:37:50.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:50 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:37:50.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:50 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:37:51.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:50 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:37:51.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:50 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:37:51.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:50 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:37:51.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:50 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:37:51.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:50 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:37:51.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:50 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:37:51.880 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:51 smithi184 ceph-mon[29861]: pgmap v1282: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:51.880 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:51 smithi184 ceph-mon[41609]: pgmap v1282: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:51.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:51 smithi188 ceph-mon[33283]: pgmap v1282: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:52.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:37:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:37:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:37:53.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:53 smithi188 ceph-mon[33283]: pgmap v1283: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:37:54.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:53 smithi184 ceph-mon[29861]: pgmap v1283: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:37:54.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:53 smithi184 ceph-mon[41609]: pgmap v1283: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:37:55.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:55 smithi188 ceph-mon[33283]: pgmap v1284: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:56.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:55 smithi184 ceph-mon[29861]: pgmap v1284: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:56.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:55 smithi184 ceph-mon[41609]: pgmap v1284: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:57.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:57 smithi188 ceph-mon[33283]: pgmap v1285: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:58.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:57 smithi184 ceph-mon[29861]: pgmap v1285: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:58.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:57 smithi184 ceph-mon[41609]: pgmap v1285: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:37:58.747 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:37:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:37:59.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:59 smithi188 ceph-mon[33283]: pgmap v1286: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:37:59.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:37:59.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:37:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:38:00.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:59 smithi184 ceph-mon[29861]: pgmap v1286: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:00.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:00.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:37:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:38:00.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:59 smithi184 ceph-mon[41609]: pgmap v1286: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:00.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:00.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:37:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:38:01.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:01 smithi188 ceph-mon[33283]: pgmap v1287: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:01.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:01 smithi184 ceph-mon[29861]: pgmap v1287: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:01.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:01 smithi184 ceph-mon[41609]: pgmap v1287: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:38:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:38:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:38:03.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:03 smithi184 ceph-mon[29861]: pgmap v1288: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:03.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:03 smithi184 ceph-mon[41609]: pgmap v1288: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:03.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:03 smithi188 ceph-mon[33283]: pgmap v1288: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:05.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:05 smithi184 ceph-mon[29861]: pgmap v1289: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:05 smithi184 ceph-mon[41609]: pgmap v1289: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:05.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:05 smithi188 ceph-mon[33283]: pgmap v1289: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:07.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:07 smithi188 ceph-mon[33283]: pgmap v1290: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:08.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:07 smithi184 ceph-mon[29861]: pgmap v1290: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:08.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:07 smithi184 ceph-mon[41609]: pgmap v1290: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:08.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:38:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:38:09.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:09 smithi188 ceph-mon[33283]: pgmap v1291: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:09.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:10.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:09 smithi184 ceph-mon[29861]: pgmap v1291: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:10.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:10.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:09 smithi184 ceph-mon[41609]: pgmap v1291: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:10.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:11.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:11 smithi188 ceph-mon[33283]: pgmap v1292: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:11.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:11 smithi184 ceph-mon[29861]: pgmap v1292: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:11.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:11 smithi184 ceph-mon[41609]: pgmap v1292: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:38:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:38:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:38:13.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:13 smithi184 ceph-mon[29861]: pgmap v1293: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:13.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:13 smithi184 ceph-mon[41609]: pgmap v1293: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:13.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:13 smithi188 ceph-mon[33283]: pgmap v1293: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:15 smithi188 ceph-mon[33283]: pgmap v1294: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:38:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:15 smithi184 ceph-mon[29861]: pgmap v1294: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:38:16.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:15 smithi184 ceph-mon[41609]: pgmap v1294: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:38:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:17 smithi188 ceph-mon[33283]: pgmap v1295: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:18.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:17 smithi184 ceph-mon[29861]: pgmap v1295: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:18.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:17 smithi184 ceph-mon[41609]: pgmap v1295: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:18.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:38:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:38:19.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:19 smithi188 ceph-mon[33283]: pgmap v1296: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:19.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:20.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:19 smithi184 ceph-mon[29861]: pgmap v1296: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:20.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:20.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:19 smithi184 ceph-mon[41609]: pgmap v1296: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:20.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:21.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:21 smithi188 ceph-mon[33283]: pgmap v1297: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:21.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:21 smithi184 ceph-mon[29861]: pgmap v1297: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:21.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:21 smithi184 ceph-mon[41609]: pgmap v1297: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:38:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:38:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:38:23.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:23 smithi188 ceph-mon[33283]: pgmap v1298: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:24.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:23 smithi184 ceph-mon[29861]: pgmap v1298: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:24.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:23 smithi184 ceph-mon[41609]: pgmap v1298: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:25.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:25 smithi188 ceph-mon[33283]: pgmap v1299: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:26.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:25 smithi184 ceph-mon[29861]: pgmap v1299: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:26.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:25 smithi184 ceph-mon[41609]: pgmap v1299: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:27.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:27 smithi188 ceph-mon[33283]: pgmap v1300: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:28.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:27 smithi184 ceph-mon[29861]: pgmap v1300: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:28.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:27 smithi184 ceph-mon[41609]: pgmap v1300: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:28.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:38:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:38:29.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:29 smithi188 ceph-mon[33283]: pgmap v1301: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:29.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:30.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:29 smithi184 ceph-mon[29861]: pgmap v1301: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:30.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:30.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:29 smithi184 ceph-mon[41609]: pgmap v1301: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:30.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:30.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:38:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:38:31.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:38:31.880 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:31 smithi184 ceph-mon[29861]: pgmap v1302: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:31.880 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:31 smithi184 ceph-mon[41609]: pgmap v1302: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:31.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:31 smithi188 ceph-mon[33283]: pgmap v1302: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:38:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:38:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:38:33.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:33 smithi188 ceph-mon[33283]: pgmap v1303: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:34.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:33 smithi184 ceph-mon[29861]: pgmap v1303: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:34.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:33 smithi184 ceph-mon[41609]: pgmap v1303: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:35.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:35 smithi188 ceph-mon[33283]: pgmap v1304: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:36.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:35 smithi184 ceph-mon[29861]: pgmap v1304: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:36.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:35 smithi184 ceph-mon[41609]: pgmap v1304: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:37.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:37 smithi188 ceph-mon[33283]: pgmap v1305: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:38.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:37 smithi184 ceph-mon[29861]: pgmap v1305: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:38.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:37 smithi184 ceph-mon[41609]: pgmap v1305: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:38.997 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:38:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:38:39.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:39 smithi188 ceph-mon[33283]: pgmap v1306: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:39.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:40.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:39 smithi184 ceph-mon[29861]: pgmap v1306: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:40.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:40.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:39 smithi184 ceph-mon[41609]: pgmap v1306: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:40.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:41.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:41 smithi188 ceph-mon[33283]: pgmap v1307: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:41.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:41 smithi184 ceph-mon[29861]: pgmap v1307: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:41.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:41 smithi184 ceph-mon[41609]: pgmap v1307: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:38:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:38:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:38:43.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:43 smithi188 ceph-mon[33283]: pgmap v1308: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:44.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:43 smithi184 ceph-mon[29861]: pgmap v1308: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:44.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:43 smithi184 ceph-mon[41609]: pgmap v1308: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:45 smithi188 ceph-mon[33283]: pgmap v1309: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:38:46.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:45 smithi184 ceph-mon[29861]: pgmap v1309: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:46.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:38:46.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:45 smithi184 ceph-mon[41609]: pgmap v1309: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:46.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:38:47.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:47 smithi188 ceph-mon[33283]: pgmap v1310: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:48.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:47 smithi184 ceph-mon[29861]: pgmap v1310: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:48.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:47 smithi184 ceph-mon[41609]: pgmap v1310: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:48.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:38:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:38:49.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:49 smithi188 ceph-mon[33283]: pgmap v1311: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:50.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:49 smithi184 ceph-mon[29861]: pgmap v1311: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:50.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:50.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:49 smithi184 ceph-mon[41609]: pgmap v1311: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:50.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:38:50.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:50 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:38:50.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:50 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:38:50.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:50 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:38:50.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:50 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:38:51.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:50 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:38:51.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:50 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:38:51.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:50 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:38:51.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:50 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:38:51.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:50 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:38:51.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:50 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:38:51.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:50 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:38:51.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:50 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:38:51.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:51 smithi188 ceph-mon[33283]: pgmap v1312: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:51.749 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:38:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=cleanup t=2024-02-05T07:38:51.297515095Z level=info msg="Completed cleanup jobs" duration=2.962006ms 2024-02-05T07:38:51.880 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:51 smithi184 ceph-mon[29861]: pgmap v1312: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:51.880 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:51 smithi184 ceph-mon[41609]: pgmap v1312: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:52.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:38:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:38:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:38:53.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:53 smithi188 ceph-mon[33283]: pgmap v1313: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:54.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:53 smithi184 ceph-mon[29861]: pgmap v1313: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:54.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:53 smithi184 ceph-mon[41609]: pgmap v1313: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:38:55.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:55 smithi188 ceph-mon[33283]: pgmap v1314: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:56.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:55 smithi184 ceph-mon[29861]: pgmap v1314: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:56.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:55 smithi184 ceph-mon[41609]: pgmap v1314: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:57.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:57 smithi188 ceph-mon[33283]: pgmap v1315: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:58.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:57 smithi184 ceph-mon[29861]: pgmap v1315: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:58.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:57 smithi184 ceph-mon[41609]: pgmap v1315: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:38:58.899 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:38:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:38:59.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:59 smithi188 ceph-mon[33283]: pgmap v1316: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:38:59.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:38:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:00.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:59 smithi184 ceph-mon[29861]: pgmap v1316: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:00.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:38:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:00.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:59 smithi184 ceph-mon[41609]: pgmap v1316: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:00.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:38:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:39:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:39:01.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:39:01.881 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:01 smithi184 ceph-mon[29861]: pgmap v1317: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:01.881 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:01 smithi184 ceph-mon[41609]: pgmap v1317: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:01.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:01 smithi188 ceph-mon[33283]: pgmap v1317: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:39:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:39:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:39:03.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:03 smithi188 ceph-mon[33283]: pgmap v1318: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:39:04.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:03 smithi184 ceph-mon[29861]: pgmap v1318: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:39:04.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:03 smithi184 ceph-mon[41609]: pgmap v1318: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:39:05.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:05 smithi188 ceph-mon[33283]: pgmap v1319: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:06.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:05 smithi184 ceph-mon[29861]: pgmap v1319: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:06.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:05 smithi184 ceph-mon[41609]: pgmap v1319: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:07.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:07 smithi188 ceph-mon[33283]: pgmap v1320: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:08.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:07 smithi184 ceph-mon[29861]: pgmap v1320: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:08.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:07 smithi184 ceph-mon[41609]: pgmap v1320: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:08.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:39:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:39:09.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:09 smithi188 ceph-mon[33283]: pgmap v1321: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:09.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:10.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:09 smithi184 ceph-mon[29861]: pgmap v1321: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:10.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:10.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:09 smithi184 ceph-mon[41609]: pgmap v1321: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:10.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:11.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:11 smithi188 ceph-mon[33283]: pgmap v1322: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:11.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:11 smithi184 ceph-mon[29861]: pgmap v1322: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:11.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:11 smithi184 ceph-mon[41609]: pgmap v1322: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:39:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:39:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:39:13.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:13 smithi188 ceph-mon[33283]: pgmap v1323: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:14.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:13 smithi184 ceph-mon[29861]: pgmap v1323: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:14.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:13 smithi184 ceph-mon[41609]: pgmap v1323: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:15 smithi188 ceph-mon[33283]: pgmap v1324: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:39:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:15 smithi184 ceph-mon[29861]: pgmap v1324: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:39:16.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:15 smithi184 ceph-mon[41609]: pgmap v1324: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:16.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:39:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:17 smithi188 ceph-mon[33283]: pgmap v1325: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:18.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:17 smithi184 ceph-mon[29861]: pgmap v1325: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:18.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:17 smithi184 ceph-mon[41609]: pgmap v1325: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:18.197 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.198 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.199 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.200 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.201 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.201 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.201 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.201 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.201 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.201 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.201 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.201 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.201 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.201 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.201 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.201 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.201 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.202 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.202 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.202 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.202 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.202 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.202 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.202 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.202 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.202 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.202 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.202 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.202 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.202 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.202 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.203 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.203 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.203 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.203 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.203 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.203 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.203 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.203 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.203 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.203 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.203 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.203 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.203 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.203 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.204 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.204 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.204 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.204 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.204 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.204 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.204 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.204 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.204 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.204 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.204 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.204 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.204 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.204 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.205 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.205 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.205 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.205 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.205 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:39:18.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:39:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:39:19.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:19 smithi188 ceph-mon[33283]: pgmap v1326: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:19.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:20.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:19 smithi184 ceph-mon[29861]: pgmap v1326: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:20.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:20.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:19 smithi184 ceph-mon[41609]: pgmap v1326: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:20.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:21.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:21 smithi188 ceph-mon[33283]: pgmap v1327: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:21.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:21 smithi184 ceph-mon[29861]: pgmap v1327: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:21.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:21 smithi184 ceph-mon[41609]: pgmap v1327: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:39:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:39:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:39:23.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:23 smithi188 ceph-mon[33283]: pgmap v1328: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:24.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:23 smithi184 ceph-mon[29861]: pgmap v1328: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:24.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:23 smithi184 ceph-mon[41609]: pgmap v1328: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:25.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:25 smithi188 ceph-mon[33283]: pgmap v1329: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:26.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:25 smithi184 ceph-mon[29861]: pgmap v1329: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:26.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:25 smithi184 ceph-mon[41609]: pgmap v1329: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:27.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:27 smithi188 ceph-mon[33283]: pgmap v1330: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:28.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:27 smithi184 ceph-mon[29861]: pgmap v1330: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:28.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:27 smithi184 ceph-mon[41609]: pgmap v1330: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:28.899 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:39:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:39:29.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:29 smithi188 ceph-mon[33283]: pgmap v1331: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:29.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:30.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:29 smithi184 ceph-mon[29861]: pgmap v1331: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:30.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:30.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:29 smithi184 ceph-mon[41609]: pgmap v1331: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:30.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:39:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:39:31.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:39:31.880 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:31 smithi184 ceph-mon[29861]: pgmap v1332: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:31.881 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:31 smithi184 ceph-mon[41609]: pgmap v1332: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:31.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:31 smithi188 ceph-mon[33283]: pgmap v1332: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:39:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:39:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:39:33.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:33 smithi188 ceph-mon[33283]: pgmap v1333: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:34.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:33 smithi184 ceph-mon[29861]: pgmap v1333: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:34.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:33 smithi184 ceph-mon[41609]: pgmap v1333: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:35.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:35 smithi188 ceph-mon[33283]: pgmap v1334: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:36.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:35 smithi184 ceph-mon[29861]: pgmap v1334: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:36.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:35 smithi184 ceph-mon[41609]: pgmap v1334: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:37.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:37 smithi188 ceph-mon[33283]: pgmap v1335: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:38.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:37 smithi184 ceph-mon[29861]: pgmap v1335: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:38.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:37 smithi184 ceph-mon[41609]: pgmap v1335: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:38.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:39:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:39:39.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:39 smithi188 ceph-mon[33283]: pgmap v1336: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:39.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:40.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:39 smithi184 ceph-mon[29861]: pgmap v1336: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:40.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:40.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:39 smithi184 ceph-mon[41609]: pgmap v1336: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:40.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:41.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:41 smithi188 ceph-mon[33283]: pgmap v1337: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:41.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:41 smithi184 ceph-mon[29861]: pgmap v1337: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:41.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:41 smithi184 ceph-mon[41609]: pgmap v1337: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:39:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:39:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:39:43.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:43 smithi188 ceph-mon[33283]: pgmap v1338: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:44.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:43 smithi184 ceph-mon[29861]: pgmap v1338: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:44.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:43 smithi184 ceph-mon[41609]: pgmap v1338: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:45 smithi188 ceph-mon[33283]: pgmap v1339: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:39:46.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:45 smithi184 ceph-mon[41609]: pgmap v1339: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:46.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:39:46.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:45 smithi184 ceph-mon[29861]: pgmap v1339: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:46.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:39:47.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:47 smithi188 ceph-mon[33283]: pgmap v1340: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:48.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:47 smithi184 ceph-mon[41609]: pgmap v1340: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:48.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:47 smithi184 ceph-mon[29861]: pgmap v1340: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:48.997 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:39:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:39:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:49 smithi188 ceph-mon[33283]: pgmap v1341: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:50.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:49 smithi184 ceph-mon[29861]: pgmap v1341: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:50.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:50.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:49 smithi184 ceph-mon[41609]: pgmap v1341: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:50.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:39:51.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:51 smithi188 ceph-mon[33283]: pgmap v1342: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:51.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:51 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:39:51.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:51 smithi184 ceph-mon[29861]: pgmap v1342: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:51.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:51 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:39:51.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:51 smithi184 ceph-mon[41609]: pgmap v1342: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:51.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:51 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:39:52.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:52 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:39:52.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:52 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:39:52.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:52 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:39:52.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:52 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:39:52.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:52 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:39:52.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:52 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:39:52.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:39:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:39:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:39:52.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:52 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:39:52.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:52 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:39:52.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:52 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:39:53.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:53 smithi188 ceph-mon[33283]: pgmap v1343: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:39:53.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:53 smithi184 ceph-mon[29861]: pgmap v1343: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:39:53.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:53 smithi184 ceph-mon[41609]: pgmap v1343: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:39:55.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:55 smithi188 ceph-mon[33283]: pgmap v1344: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:56.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:55 smithi184 ceph-mon[29861]: pgmap v1344: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:56.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:55 smithi184 ceph-mon[41609]: pgmap v1344: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:57.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:57 smithi188 ceph-mon[33283]: pgmap v1345: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:58.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:57 smithi184 ceph-mon[29861]: pgmap v1345: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:58.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:57 smithi184 ceph-mon[41609]: pgmap v1345: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:39:58.899 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:39:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:39:59.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:59 smithi188 ceph-mon[33283]: pgmap v1346: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:39:59.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:39:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:00.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:59 smithi184 ceph-mon[29861]: pgmap v1346: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:00.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:39:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:00.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:59 smithi184 ceph-mon[41609]: pgmap v1346: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:00.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:39:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:40:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:00 smithi188 ceph-mon[33283]: Health detail: HEALTH_WARN 4 pool(s) do not have an application enabled 2024-02-05T07:40:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:00 smithi188 ceph-mon[33283]: [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled 2024-02-05T07:40:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:00 smithi188 ceph-mon[33283]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-05T07:40:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:00 smithi188 ceph-mon[33283]: application not enabled on pool 'poolrace.1804289383' 2024-02-05T07:40:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:00 smithi188 ceph-mon[33283]: application not enabled on pool 'SnapListsmithi184-82555-1' 2024-02-05T07:40:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:00 smithi188 ceph-mon[33283]: application not enabled on pool 'poolrace2.846930886' 2024-02-05T07:40:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:00 smithi188 ceph-mon[33283]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-05T07:40:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:40:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[29861]: Health detail: HEALTH_WARN 4 pool(s) do not have an application enabled 2024-02-05T07:40:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[29861]: [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled 2024-02-05T07:40:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[29861]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-05T07:40:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[29861]: application not enabled on pool 'poolrace.1804289383' 2024-02-05T07:40:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[29861]: application not enabled on pool 'SnapListsmithi184-82555-1' 2024-02-05T07:40:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[29861]: application not enabled on pool 'poolrace2.846930886' 2024-02-05T07:40:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[29861]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-05T07:40:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:40:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[41609]: Health detail: HEALTH_WARN 4 pool(s) do not have an application enabled 2024-02-05T07:40:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[41609]: [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled 2024-02-05T07:40:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[41609]: application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-05T07:40:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[41609]: application not enabled on pool 'poolrace.1804289383' 2024-02-05T07:40:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[41609]: application not enabled on pool 'SnapListsmithi184-82555-1' 2024-02-05T07:40:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[41609]: application not enabled on pool 'poolrace2.846930886' 2024-02-05T07:40:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:00 smithi184 ceph-mon[41609]: use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-05T07:40:01.880 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:01 smithi184 ceph-mon[29861]: pgmap v1347: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:01.880 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:01 smithi184 ceph-mon[41609]: pgmap v1347: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:01.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:01 smithi188 ceph-mon[33283]: pgmap v1347: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:40:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:40:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:40:03.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:03 smithi188 ceph-mon[33283]: pgmap v1348: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:40:04.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:03 smithi184 ceph-mon[29861]: pgmap v1348: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:40:04.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:03 smithi184 ceph-mon[41609]: pgmap v1348: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:40:05.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:05 smithi188 ceph-mon[33283]: pgmap v1349: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:06.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:05 smithi184 ceph-mon[29861]: pgmap v1349: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:06.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:05 smithi184 ceph-mon[41609]: pgmap v1349: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:07.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:07 smithi188 ceph-mon[33283]: pgmap v1350: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:08.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:07 smithi184 ceph-mon[29861]: pgmap v1350: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:08.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:07 smithi184 ceph-mon[41609]: pgmap v1350: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:08.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:40:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:40:09.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:09 smithi188 ceph-mon[33283]: pgmap v1351: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:10.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:09 smithi184 ceph-mon[29861]: pgmap v1351: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:10.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:09 smithi184 ceph-mon[41609]: pgmap v1351: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:10.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:10 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:10.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:10 smithi188 ceph-mon[33283]: pgmap v1352: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:11.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:10 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:11.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:10 smithi184 ceph-mon[29861]: pgmap v1352: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:11.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:10 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:11.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:10 smithi184 ceph-mon[41609]: pgmap v1352: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:40:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:40:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:40:13.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:13 smithi188 ceph-mon[33283]: pgmap v1353: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:14.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:13 smithi184 ceph-mon[29861]: pgmap v1353: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:14.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:13 smithi184 ceph-mon[41609]: pgmap v1353: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:15 smithi188 ceph-mon[33283]: pgmap v1354: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:40:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:15 smithi184 ceph-mon[29861]: pgmap v1354: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:40:16.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:15 smithi184 ceph-mon[41609]: pgmap v1354: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:40:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:17 smithi188 ceph-mon[33283]: pgmap v1355: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:18.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:17 smithi184 ceph-mon[29861]: pgmap v1355: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:18.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:17 smithi184 ceph-mon[41609]: pgmap v1355: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:18.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:40:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:40:19.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:19 smithi188 ceph-mon[33283]: pgmap v1356: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:20.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:19 smithi184 ceph-mon[29861]: pgmap v1356: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:20.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:19 smithi184 ceph-mon[41609]: pgmap v1356: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:20 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:21.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:20 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:21.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:20 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:21.880 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:21 smithi184 ceph-mon[29861]: pgmap v1357: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:21.880 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:21 smithi184 ceph-mon[41609]: pgmap v1357: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:21.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:21 smithi188 ceph-mon[33283]: pgmap v1357: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:40:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:40:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:40:23.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:23 smithi188 ceph-mon[33283]: pgmap v1358: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:24.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:23 smithi184 ceph-mon[29861]: pgmap v1358: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:24.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:23 smithi184 ceph-mon[41609]: pgmap v1358: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:25.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:25 smithi188 ceph-mon[33283]: pgmap v1359: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:26.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:25 smithi184 ceph-mon[29861]: pgmap v1359: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:26.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:25 smithi184 ceph-mon[41609]: pgmap v1359: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:27.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:27 smithi188 ceph-mon[33283]: pgmap v1360: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:28.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:27 smithi184 ceph-mon[29861]: pgmap v1360: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:28.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:27 smithi184 ceph-mon[41609]: pgmap v1360: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:28.899 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:28 smithi188 ceph-mon[33283]: pgmap v1361: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:28.899 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:40:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:40:29.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:28 smithi184 ceph-mon[29861]: pgmap v1361: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:29.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:28 smithi184 ceph-mon[41609]: pgmap v1361: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:29.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:30.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:30.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:40:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:30 smithi188 ceph-mon[33283]: pgmap v1362: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:40:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:30 smithi184 ceph-mon[29861]: pgmap v1362: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:31.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:40:31.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:30 smithi184 ceph-mon[41609]: pgmap v1362: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:40:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:40:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:40:33.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:33 smithi188 ceph-mon[33283]: pgmap v1363: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:34.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:33 smithi184 ceph-mon[29861]: pgmap v1363: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:34.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:33 smithi184 ceph-mon[41609]: pgmap v1363: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:35.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:35 smithi188 ceph-mon[33283]: pgmap v1364: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:36.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:35 smithi184 ceph-mon[29861]: pgmap v1364: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:36.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:35 smithi184 ceph-mon[41609]: pgmap v1364: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:37.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:37 smithi188 ceph-mon[33283]: pgmap v1365: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:38.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:37 smithi184 ceph-mon[29861]: pgmap v1365: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:38.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:37 smithi184 ceph-mon[41609]: pgmap v1365: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:38.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:40:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:40:39.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:39 smithi188 ceph-mon[33283]: pgmap v1366: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:40.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:39 smithi184 ceph-mon[29861]: pgmap v1366: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:40.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:39 smithi184 ceph-mon[41609]: pgmap v1366: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:40.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:40 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:41.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:40 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:41.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:40 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:41.879 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:41 smithi184 ceph-mon[29861]: pgmap v1367: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:41.880 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:41 smithi184 ceph-mon[41609]: pgmap v1367: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:41.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:41 smithi188 ceph-mon[33283]: pgmap v1367: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:40:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:40:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:40:42.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:42 smithi188 ceph-mon[33283]: pgmap v1368: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:40:43.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:42 smithi184 ceph-mon[29861]: pgmap v1368: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:40:43.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:42 smithi184 ceph-mon[41609]: pgmap v1368: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:40:45.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:45 smithi188 ceph-mon[33283]: pgmap v1369: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:45.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:40:46.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:45 smithi184 ceph-mon[29861]: pgmap v1369: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:46.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:40:46.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:45 smithi184 ceph-mon[41609]: pgmap v1369: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:46.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:40:47.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:47 smithi188 ceph-mon[33283]: pgmap v1370: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:48.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:47 smithi184 ceph-mon[29861]: pgmap v1370: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:48.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:47 smithi184 ceph-mon[41609]: pgmap v1370: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:48.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:40:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:40:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:49 smithi188 ceph-mon[33283]: pgmap v1371: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:50.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:49 smithi184 ceph-mon[29861]: pgmap v1371: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:50.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:49 smithi184 ceph-mon[41609]: pgmap v1371: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:50.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:50 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:51.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:50 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:51.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:50 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:40:51.880 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:51 smithi184 ceph-mon[29861]: pgmap v1372: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:51.880 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:51 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:40:51.880 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:51 smithi184 ceph-mon[41609]: pgmap v1372: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:51.880 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:51 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:40:51.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:51 smithi188 ceph-mon[33283]: pgmap v1372: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:51.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:51 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:40:52.179 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:40:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:40:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:40:53.856 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:53 smithi184 ceph-mon[29861]: pgmap v1373: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:53.856 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:53 smithi184 ceph-mon[41609]: pgmap v1373: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:53.856 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:53 smithi188 ceph-mon[33283]: pgmap v1373: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:55.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:55 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:40:55.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:55 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:40:55.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:55 smithi188 ceph-mon[33283]: pgmap v1374: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:55.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:55 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:40:55.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:55 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:40:55.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:55 smithi184 ceph-mon[29861]: pgmap v1374: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:55.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:55 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:40:55.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:55 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:40:55.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:55 smithi184 ceph-mon[41609]: pgmap v1374: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:40:57.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:56 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:40:57.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:56 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:40:57.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:56 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:40:57.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:56 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:40:57.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:56 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:40:57.249 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:56 smithi188 ceph-mon[33283]: pgmap v1375: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:57.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:56 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:40:57.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:56 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:40:57.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:56 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:40:57.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:56 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:40:57.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:56 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:40:57.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:56 smithi184 ceph-mon[29861]: pgmap v1375: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:57.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:56 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:40:57.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:56 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:40:57.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:56 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:40:57.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:56 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:40:57.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:56 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:40:57.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:56 smithi184 ceph-mon[41609]: pgmap v1375: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:40:58.210 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.210 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.210 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.210 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.210 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.210 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.210 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.210 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.210 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.210 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.211 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.211 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.211 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.211 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.211 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.211 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.211 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.211 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.211 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.211 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.211 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.211 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.211 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.211 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.211 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.212 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.212 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.212 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.212 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.212 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.212 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.212 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.212 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.212 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.212 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.212 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.212 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.212 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.213 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.214 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.214 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.214 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.214 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.214 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.214 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.214 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.214 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.214 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.214 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.214 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.214 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.214 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.214 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.215 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.215 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.215 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.215 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.215 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.215 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.215 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.215 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.215 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.215 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.215 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.215 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.215 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.215 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.216 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.216 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.216 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.216 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.216 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.216 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.216 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.216 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.216 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.216 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.216 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.216 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.216 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.216 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.216 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.217 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.217 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.217 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:40:58.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:40:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:40:59.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:40:59 smithi188 ceph-mon[33283]: pgmap v1376: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:00.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:40:59 smithi184 ceph-mon[29861]: pgmap v1376: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:00.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:40:59 smithi184 ceph-mon[41609]: pgmap v1376: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:00.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:00 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:41:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:00 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:41:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:00 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:41:01.882 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:01 smithi184 ceph-mon[29861]: pgmap v1377: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:01.882 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:01 smithi184 ceph-mon[41609]: pgmap v1377: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:01.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:01 smithi188 ceph-mon[33283]: pgmap v1377: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:41:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:41:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:41:02.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:02 smithi188 ceph-mon[33283]: pgmap v1378: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:41:03.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:02 smithi184 ceph-mon[29861]: pgmap v1378: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:41:03.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:02 smithi184 ceph-mon[41609]: pgmap v1378: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:41:05.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:05 smithi188 ceph-mon[33283]: pgmap v1379: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:06.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:05 smithi184 ceph-mon[29861]: pgmap v1379: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:06.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:05 smithi184 ceph-mon[41609]: pgmap v1379: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:07.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:07 smithi188 ceph-mon[33283]: pgmap v1380: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:08.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:07 smithi184 ceph-mon[29861]: pgmap v1380: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:08.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:07 smithi184 ceph-mon[41609]: pgmap v1380: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:08.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:08 smithi188 ceph-mon[33283]: pgmap v1381: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:08.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:41:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:41:09.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:08 smithi184 ceph-mon[29861]: pgmap v1381: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:09.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:08 smithi184 ceph-mon[41609]: pgmap v1381: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:09.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:10.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:10.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:11.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:11 smithi188 ceph-mon[33283]: pgmap v1382: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:11.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:11 smithi184 ceph-mon[29861]: pgmap v1382: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:11.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:11 smithi184 ceph-mon[41609]: pgmap v1382: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:41:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:41:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:41:13.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:13 smithi188 ceph-mon[33283]: pgmap v1383: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:14.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:13 smithi184 ceph-mon[29861]: pgmap v1383: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:14.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:13 smithi184 ceph-mon[41609]: pgmap v1383: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:14.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:14 smithi188 ceph-mon[33283]: pgmap v1384: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:15.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:14 smithi184 ceph-mon[29861]: pgmap v1384: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:15.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:14 smithi184 ceph-mon[41609]: pgmap v1384: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:15.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:41:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:41:16.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:41:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:16 smithi188 ceph-mon[33283]: pgmap v1385: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:17.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:16 smithi184 ceph-mon[29861]: pgmap v1385: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:17.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:16 smithi184 ceph-mon[41609]: pgmap v1385: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:18 smithi188 ceph-mon[33283]: pgmap v1386: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:18.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:41:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:41:19.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:18 smithi184 ceph-mon[29861]: pgmap v1386: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:19.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:18 smithi184 ceph-mon[41609]: pgmap v1386: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:19.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:20.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:20.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:21.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:21 smithi188 ceph-mon[33283]: pgmap v1387: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:21.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:21 smithi184 ceph-mon[29861]: pgmap v1387: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:21.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:21 smithi184 ceph-mon[41609]: pgmap v1387: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:41:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:41:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:41:22.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:22 smithi188 ceph-mon[33283]: pgmap v1388: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:41:23.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:22 smithi184 ceph-mon[29861]: pgmap v1388: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:41:23.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:22 smithi184 ceph-mon[41609]: pgmap v1388: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:41:24.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:24 smithi188 ceph-mon[33283]: pgmap v1389: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:25.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:24 smithi184 ceph-mon[29861]: pgmap v1389: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:25.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:24 smithi184 ceph-mon[41609]: pgmap v1389: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:26.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:26 smithi188 ceph-mon[33283]: pgmap v1390: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:27.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:26 smithi184 ceph-mon[29861]: pgmap v1390: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:27.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:26 smithi184 ceph-mon[41609]: pgmap v1390: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:28.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:28 smithi188 ceph-mon[33283]: pgmap v1391: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:28.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:41:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:41:29.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:28 smithi184 ceph-mon[29861]: pgmap v1391: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:29.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:28 smithi184 ceph-mon[41609]: pgmap v1391: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:29.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:30.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:30.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:41:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:30 smithi188 ceph-mon[33283]: pgmap v1392: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:41:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:30 smithi184 ceph-mon[29861]: pgmap v1392: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:31.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:41:31.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:30 smithi184 ceph-mon[41609]: pgmap v1392: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:41:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:41:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:41:32.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:32 smithi188 ceph-mon[33283]: pgmap v1393: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:41:33.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:32 smithi184 ceph-mon[29861]: pgmap v1393: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:41:33.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:32 smithi184 ceph-mon[41609]: pgmap v1393: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:41:34.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:34 smithi188 ceph-mon[33283]: pgmap v1394: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:35.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:34 smithi184 ceph-mon[29861]: pgmap v1394: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:35.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:34 smithi184 ceph-mon[41609]: pgmap v1394: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:36.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:36 smithi188 ceph-mon[33283]: pgmap v1395: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:37.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:36 smithi184 ceph-mon[29861]: pgmap v1395: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:37.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:36 smithi184 ceph-mon[41609]: pgmap v1395: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:38.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:38 smithi188 ceph-mon[33283]: pgmap v1396: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:38.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:41:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:41:39.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:38 smithi184 ceph-mon[29861]: pgmap v1396: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:39.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:38 smithi184 ceph-mon[41609]: pgmap v1396: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:39.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:40.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:40.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:41.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:41 smithi188 ceph-mon[33283]: pgmap v1397: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:41.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:41 smithi184 ceph-mon[29861]: pgmap v1397: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:41.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:41 smithi184 ceph-mon[41609]: pgmap v1397: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:41:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:41:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:41:42.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:42 smithi188 ceph-mon[33283]: pgmap v1398: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:41:43.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:42 smithi184 ceph-mon[29861]: pgmap v1398: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:41:43.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:42 smithi184 ceph-mon[41609]: pgmap v1398: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:41:44.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:44 smithi188 ceph-mon[33283]: pgmap v1399: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:45.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:44 smithi184 ceph-mon[29861]: pgmap v1399: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:45.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:44 smithi184 ceph-mon[41609]: pgmap v1399: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:41:46.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:41:46.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:41:46.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:46 smithi188 ceph-mon[33283]: pgmap v1400: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:47.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:46 smithi184 ceph-mon[29861]: pgmap v1400: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:47.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:46 smithi184 ceph-mon[41609]: pgmap v1400: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:48.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:48 smithi188 ceph-mon[33283]: pgmap v1401: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:48.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:41:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:41:49.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:48 smithi184 ceph-mon[29861]: pgmap v1401: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:49.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:48 smithi184 ceph-mon[41609]: pgmap v1401: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:49.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:50.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:50.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:41:51.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:51 smithi188 ceph-mon[33283]: pgmap v1402: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:51.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:51 smithi184 ceph-mon[29861]: pgmap v1402: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:51.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:51 smithi184 ceph-mon[41609]: pgmap v1402: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:52.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:41:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:41:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:41:52.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:52 smithi188 ceph-mon[33283]: pgmap v1403: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:53.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:52 smithi184 ceph-mon[29861]: pgmap v1403: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:53.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:52 smithi184 ceph-mon[41609]: pgmap v1403: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:54.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:54 smithi188 ceph-mon[33283]: pgmap v1404: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:55.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:54 smithi184 ceph-mon[29861]: pgmap v1404: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:55.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:54 smithi184 ceph-mon[41609]: pgmap v1404: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:41:56.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:56 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:41:57.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:56 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:41:57.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:56 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:41:57.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:57 smithi188 ceph-mon[33283]: pgmap v1405: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:57.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:41:57.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:41:57.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:41:58.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:57 smithi184 ceph-mon[29861]: pgmap v1405: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:58.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:41:58.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:41:58.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:41:58.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:57 smithi184 ceph-mon[41609]: pgmap v1405: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:41:58.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:41:58.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:41:58.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:41:58.997 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:41:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:41:59.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:41:59 smithi188 ceph-mon[33283]: pgmap v1406: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:00.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:41:59 smithi184 ceph-mon[29861]: pgmap v1406: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:00.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:41:59 smithi184 ceph-mon[41609]: pgmap v1406: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:00 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:42:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:00 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:42:01.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:00 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:01.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:42:01.881 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:01 smithi184 ceph-mon[29861]: pgmap v1407: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:01.881 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:01 smithi184 ceph-mon[41609]: pgmap v1407: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:01.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:01 smithi188 ceph-mon[33283]: pgmap v1407: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:42:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:42:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:42:03.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:03 smithi188 ceph-mon[33283]: pgmap v1408: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:42:04.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:03 smithi184 ceph-mon[29861]: pgmap v1408: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:42:04.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:03 smithi184 ceph-mon[41609]: pgmap v1408: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:42:05.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:05 smithi188 ceph-mon[33283]: pgmap v1409: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:06.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:05 smithi184 ceph-mon[41609]: pgmap v1409: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:06.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:05 smithi184 ceph-mon[29861]: pgmap v1409: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:07.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:07 smithi188 ceph-mon[33283]: pgmap v1410: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:08.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:07 smithi184 ceph-mon[29861]: pgmap v1410: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:08.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:07 smithi184 ceph-mon[41609]: pgmap v1410: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:08.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:42:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:42:09.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:09 smithi188 ceph-mon[33283]: pgmap v1411: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:10.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:09 smithi184 ceph-mon[29861]: pgmap v1411: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:10.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:09 smithi184 ceph-mon[41609]: pgmap v1411: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:10.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:10 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:11.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:10 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:11.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:10 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:11.881 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:11 smithi184 ceph-mon[29861]: pgmap v1412: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:11.881 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:11 smithi184 ceph-mon[41609]: pgmap v1412: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:11 smithi188 ceph-mon[33283]: pgmap v1412: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:42:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:42:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:42:13.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:13 smithi188 ceph-mon[33283]: pgmap v1413: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:42:14.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:13 smithi184 ceph-mon[29861]: pgmap v1413: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:42:14.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:13 smithi184 ceph-mon[41609]: pgmap v1413: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:42:15.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:15 smithi188 ceph-mon[33283]: pgmap v1414: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:42:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:15 smithi184 ceph-mon[29861]: pgmap v1414: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:42:16.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:15 smithi184 ceph-mon[41609]: pgmap v1414: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:16.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:42:17.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:17 smithi188 ceph-mon[33283]: pgmap v1415: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:18.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:17 smithi184 ceph-mon[29861]: pgmap v1415: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:18.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:17 smithi184 ceph-mon[41609]: pgmap v1415: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:18.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:42:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:42:19.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:19 smithi188 ceph-mon[33283]: pgmap v1416: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:20.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:19 smithi184 ceph-mon[29861]: pgmap v1416: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:20.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:19 smithi184 ceph-mon[41609]: pgmap v1416: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:20 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:21.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:20 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:21.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:20 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:21.880 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:21 smithi184 ceph-mon[29861]: pgmap v1417: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:21.880 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:21 smithi184 ceph-mon[41609]: pgmap v1417: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:21.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:21 smithi188 ceph-mon[33283]: pgmap v1417: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:42:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:42:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:42:22.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:22 smithi188 ceph-mon[33283]: pgmap v1418: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:23.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:22 smithi184 ceph-mon[29861]: pgmap v1418: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:23.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:22 smithi184 ceph-mon[41609]: pgmap v1418: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:24.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:24 smithi188 ceph-mon[33283]: pgmap v1419: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:25.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:24 smithi184 ceph-mon[41609]: pgmap v1419: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:25.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:24 smithi184 ceph-mon[29861]: pgmap v1419: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:26.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:26 smithi188 ceph-mon[33283]: pgmap v1420: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:27.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:26 smithi184 ceph-mon[29861]: pgmap v1420: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:27.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:26 smithi184 ceph-mon[41609]: pgmap v1420: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:28.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:28 smithi188 ceph-mon[33283]: pgmap v1421: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:28.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:42:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:42:29.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:28 smithi184 ceph-mon[29861]: pgmap v1421: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:29.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:28 smithi184 ceph-mon[41609]: pgmap v1421: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:29.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:30.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:30.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:42:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:30 smithi188 ceph-mon[33283]: pgmap v1422: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:42:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:30 smithi184 ceph-mon[29861]: pgmap v1422: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:31.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:42:31.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:30 smithi184 ceph-mon[41609]: pgmap v1422: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:42:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:42:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:42:32.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:32 smithi188 ceph-mon[33283]: pgmap v1423: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:33.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:32 smithi184 ceph-mon[29861]: pgmap v1423: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:33.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:32 smithi184 ceph-mon[41609]: pgmap v1423: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:34.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:34 smithi188 ceph-mon[33283]: pgmap v1424: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:35.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:34 smithi184 ceph-mon[29861]: pgmap v1424: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:35.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:34 smithi184 ceph-mon[41609]: pgmap v1424: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:36.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:36 smithi188 ceph-mon[33283]: pgmap v1425: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:37.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:36 smithi184 ceph-mon[29861]: pgmap v1425: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:37.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:36 smithi184 ceph-mon[41609]: pgmap v1425: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:38.222 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.222 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.222 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.222 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.222 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.222 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.222 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.222 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.222 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.222 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.222 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.222 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.223 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.223 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.223 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.223 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.223 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.223 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.223 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.223 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.223 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.223 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.223 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.223 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.223 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.223 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.223 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.224 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.224 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.224 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.224 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.224 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.224 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.224 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.224 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.224 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.224 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.224 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.224 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.224 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.225 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.225 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.225 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.225 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.225 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.225 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.225 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.225 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.225 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.225 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.225 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.225 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.225 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.225 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.226 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.226 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.226 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.226 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.226 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.226 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.226 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.226 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.226 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.226 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.226 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.226 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.226 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.227 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.227 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.227 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.227 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.227 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.227 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.227 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.227 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.227 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.227 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.227 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.227 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.228 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.228 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.228 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.228 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.228 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.228 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.228 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.228 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.228 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.228 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.228 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.228 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.228 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.228 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.229 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.229 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.229 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.229 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.229 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.229 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.229 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:42:38.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:38 smithi188 ceph-mon[33283]: pgmap v1426: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:38.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:42:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:42:39.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:38 smithi184 ceph-mon[29861]: pgmap v1426: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:39.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:38 smithi184 ceph-mon[41609]: pgmap v1426: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:39.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:40.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:40.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:41.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:41 smithi188 ceph-mon[33283]: pgmap v1427: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:41.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:41 smithi184 ceph-mon[29861]: pgmap v1427: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:41.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:41 smithi184 ceph-mon[41609]: pgmap v1427: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:42:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:42:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:42:42.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:42 smithi188 ceph-mon[33283]: pgmap v1428: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:43.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:42 smithi184 ceph-mon[29861]: pgmap v1428: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:43.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:42 smithi184 ceph-mon[41609]: pgmap v1428: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:44.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:44 smithi188 ceph-mon[33283]: pgmap v1429: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:45.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:44 smithi184 ceph-mon[29861]: pgmap v1429: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:45.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:44 smithi184 ceph-mon[41609]: pgmap v1429: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:42:46.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:42:46.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:42:46.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:46 smithi188 ceph-mon[33283]: pgmap v1430: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:47.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:46 smithi184 ceph-mon[29861]: pgmap v1430: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:47.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:46 smithi184 ceph-mon[41609]: pgmap v1430: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:48.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:48 smithi188 ceph-mon[33283]: pgmap v1431: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:48.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:42:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:42:49.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:48 smithi184 ceph-mon[29861]: pgmap v1431: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:49.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:48 smithi184 ceph-mon[41609]: pgmap v1431: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:50.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:50.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:42:51.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:51 smithi188 ceph-mon[33283]: pgmap v1432: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:51.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:51 smithi184 ceph-mon[29861]: pgmap v1432: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:51.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:51 smithi184 ceph-mon[41609]: pgmap v1432: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:52.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:42:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:42:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:42:52.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:52 smithi188 ceph-mon[33283]: pgmap v1433: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:53.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:52 smithi184 ceph-mon[29861]: pgmap v1433: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:53.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:52 smithi184 ceph-mon[41609]: pgmap v1433: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:54.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:54 smithi188 ceph-mon[33283]: pgmap v1434: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:55.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:54 smithi184 ceph-mon[29861]: pgmap v1434: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:55.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:54 smithi184 ceph-mon[41609]: pgmap v1434: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:56.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:56 smithi188 ceph-mon[33283]: pgmap v1435: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:57.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:56 smithi184 ceph-mon[29861]: pgmap v1435: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:57.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:56 smithi184 ceph-mon[41609]: pgmap v1435: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:42:57.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:42:58.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:42:58.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:42:58.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:42:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:42:58.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:42:58.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:42:58.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:58 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:42:58.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:58 smithi188 ceph-mon[33283]: pgmap v1436: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:59.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:42:59.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:42:59.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:58 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:42:59.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:58 smithi184 ceph-mon[29861]: pgmap v1436: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:42:59.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:42:59.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:42:59.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:58 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:42:59.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:58 smithi184 ceph-mon[41609]: pgmap v1436: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:00.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:59 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:00.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:42:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:43:00.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:59 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:00.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:42:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:43:00.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:59 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:00.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:42:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:43:01.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:01 smithi188 ceph-mon[33283]: pgmap v1437: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:01.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:01 smithi184 ceph-mon[29861]: pgmap v1437: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:01.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:01 smithi184 ceph-mon[41609]: pgmap v1437: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:43:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:43:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:43:02.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:02 smithi188 ceph-mon[33283]: pgmap v1438: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:43:03.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:02 smithi184 ceph-mon[29861]: pgmap v1438: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:43:03.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:02 smithi184 ceph-mon[41609]: pgmap v1438: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:43:04.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:04 smithi188 ceph-mon[33283]: pgmap v1439: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:05.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:04 smithi184 ceph-mon[29861]: pgmap v1439: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:05.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:04 smithi184 ceph-mon[41609]: pgmap v1439: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:06.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:06 smithi188 ceph-mon[33283]: pgmap v1440: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:07.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:06 smithi184 ceph-mon[41609]: pgmap v1440: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:07.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:06 smithi184 ceph-mon[29861]: pgmap v1440: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:08.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:08 smithi188 ceph-mon[33283]: pgmap v1441: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:08.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:43:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:43:09.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:08 smithi184 ceph-mon[29861]: pgmap v1441: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:09.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:08 smithi184 ceph-mon[41609]: pgmap v1441: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:09.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:10.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:10.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:11.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:11 smithi188 ceph-mon[33283]: pgmap v1442: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:11.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:11 smithi184 ceph-mon[29861]: pgmap v1442: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:11.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:11 smithi184 ceph-mon[41609]: pgmap v1442: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:43:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:43:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:43:12.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:12 smithi188 ceph-mon[33283]: pgmap v1443: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:43:13.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:12 smithi184 ceph-mon[29861]: pgmap v1443: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:43:13.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:12 smithi184 ceph-mon[41609]: pgmap v1443: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:43:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:14 smithi188 ceph-mon[33283]: pgmap v1444: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:15.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:14 smithi184 ceph-mon[29861]: pgmap v1444: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:15.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:14 smithi184 ceph-mon[41609]: pgmap v1444: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:15.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:43:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:43:16.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:43:16.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:16 smithi188 ceph-mon[33283]: pgmap v1445: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:17.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:16 smithi184 ceph-mon[29861]: pgmap v1445: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:17.023 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:16 smithi184 ceph-mon[41609]: pgmap v1445: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:18 smithi188 ceph-mon[33283]: pgmap v1446: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:18.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:43:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:43:19.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:18 smithi184 ceph-mon[29861]: pgmap v1446: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:19.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:18 smithi184 ceph-mon[41609]: pgmap v1446: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:19.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:20.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:20.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:21.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:21 smithi188 ceph-mon[33283]: pgmap v1447: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:21.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:21 smithi184 ceph-mon[29861]: pgmap v1447: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:21.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:21 smithi184 ceph-mon[41609]: pgmap v1447: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:43:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:43:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:43:22.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:22 smithi188 ceph-mon[33283]: pgmap v1448: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:23.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:22 smithi184 ceph-mon[29861]: pgmap v1448: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:23.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:22 smithi184 ceph-mon[41609]: pgmap v1448: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:24.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:24 smithi188 ceph-mon[33283]: pgmap v1449: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:25.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:24 smithi184 ceph-mon[29861]: pgmap v1449: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:25.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:24 smithi184 ceph-mon[41609]: pgmap v1449: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:26.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:26 smithi188 ceph-mon[33283]: pgmap v1450: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:27.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:26 smithi184 ceph-mon[29861]: pgmap v1450: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:27.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:26 smithi184 ceph-mon[41609]: pgmap v1450: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:28.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:28 smithi188 ceph-mon[33283]: pgmap v1451: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:28.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:43:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:43:29.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:28 smithi184 ceph-mon[29861]: pgmap v1451: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:29.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:28 smithi184 ceph-mon[41609]: pgmap v1451: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:29.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:30.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:30.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:30.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:43:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:30 smithi188 ceph-mon[33283]: pgmap v1452: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:43:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:30 smithi184 ceph-mon[29861]: pgmap v1452: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:31.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:43:31.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:30 smithi184 ceph-mon[41609]: pgmap v1452: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:43:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:43:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:43:32.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:32 smithi188 ceph-mon[33283]: pgmap v1453: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:43:33.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:32 smithi184 ceph-mon[29861]: pgmap v1453: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:43:33.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:32 smithi184 ceph-mon[41609]: pgmap v1453: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:43:34.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:34 smithi188 ceph-mon[33283]: pgmap v1454: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:35.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:34 smithi184 ceph-mon[29861]: pgmap v1454: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:35.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:34 smithi184 ceph-mon[41609]: pgmap v1454: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:36.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:36 smithi188 ceph-mon[33283]: pgmap v1455: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:37.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:36 smithi184 ceph-mon[29861]: pgmap v1455: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:37.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:36 smithi184 ceph-mon[41609]: pgmap v1455: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:38.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:38 smithi188 ceph-mon[33283]: pgmap v1456: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:38.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:43:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:43:39.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:38 smithi184 ceph-mon[29861]: pgmap v1456: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:39.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:38 smithi184 ceph-mon[41609]: pgmap v1456: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:39.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:40.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:40.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:41.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:41 smithi188 ceph-mon[33283]: pgmap v1457: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:41.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:41 smithi184 ceph-mon[29861]: pgmap v1457: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:41.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:41 smithi184 ceph-mon[41609]: pgmap v1457: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:43:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:43:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:43:42.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:42 smithi188 ceph-mon[33283]: pgmap v1458: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:43:43.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:42 smithi184 ceph-mon[29861]: pgmap v1458: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:43:43.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:42 smithi184 ceph-mon[41609]: pgmap v1458: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:43:44.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:44 smithi188 ceph-mon[33283]: pgmap v1459: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:45.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:44 smithi184 ceph-mon[29861]: pgmap v1459: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:45.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:44 smithi184 ceph-mon[41609]: pgmap v1459: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:43:46.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:43:46.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:43:46.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:46 smithi188 ceph-mon[33283]: pgmap v1460: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:47.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:46 smithi184 ceph-mon[29861]: pgmap v1460: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:47.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:46 smithi184 ceph-mon[41609]: pgmap v1460: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:48.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:48 smithi188 ceph-mon[33283]: pgmap v1461: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:48.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:43:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:43:49.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:48 smithi184 ceph-mon[29861]: pgmap v1461: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:49.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:48 smithi184 ceph-mon[41609]: pgmap v1461: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:50.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:50.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:43:51.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:51 smithi188 ceph-mon[33283]: pgmap v1462: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:51.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:51 smithi184 ceph-mon[29861]: pgmap v1462: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:51.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:51 smithi184 ceph-mon[41609]: pgmap v1462: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:52.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:43:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:43:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:43:52.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:52 smithi188 ceph-mon[33283]: pgmap v1463: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:43:53.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:52 smithi184 ceph-mon[29861]: pgmap v1463: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:43:53.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:52 smithi184 ceph-mon[41609]: pgmap v1463: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:43:54.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:54 smithi188 ceph-mon[33283]: pgmap v1464: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:55.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:54 smithi184 ceph-mon[29861]: pgmap v1464: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:55.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:54 smithi184 ceph-mon[41609]: pgmap v1464: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:56.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:56 smithi188 ceph-mon[33283]: pgmap v1465: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:57.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:56 smithi184 ceph-mon[29861]: pgmap v1465: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:57.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:56 smithi184 ceph-mon[41609]: pgmap v1465: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:43:58.247 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:57 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:43:58.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:57 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:43:58.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:57 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:43:59.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:43:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:43:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:43:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:43:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:43:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:43:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:59 smithi188 ceph-mon[33283]: pgmap v1466: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:43:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:43:59.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:43:59 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:43:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:43:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:43:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:43:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:43:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[29861]: pgmap v1466: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:59.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:43:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:43:59.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:43:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:43:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:43:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:43:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:43:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[41609]: pgmap v1466: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:43:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:43:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:43:59.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:43:59 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:44:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:00 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:44:00.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:00 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:00.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:44:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:00 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:44:01.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:01 smithi188 ceph-mon[33283]: pgmap v1467: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:44:01.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:01 smithi184 ceph-mon[29861]: pgmap v1467: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:44:01.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:01 smithi184 ceph-mon[41609]: pgmap v1467: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:44:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:44:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:44:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:44:02.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:02 smithi188 ceph-mon[33283]: pgmap v1468: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:44:03.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:02 smithi184 ceph-mon[29861]: pgmap v1468: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:44:03.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:02 smithi184 ceph-mon[41609]: pgmap v1468: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:44:04.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:04 smithi188 ceph-mon[33283]: pgmap v1469: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:05.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:04 smithi184 ceph-mon[29861]: pgmap v1469: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:05.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:04 smithi184 ceph-mon[41609]: pgmap v1469: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:06.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:06 smithi188 ceph-mon[33283]: pgmap v1470: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:07.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:06 smithi184 ceph-mon[29861]: pgmap v1470: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:07.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:06 smithi184 ceph-mon[41609]: pgmap v1470: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:08.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:08 smithi188 ceph-mon[33283]: pgmap v1471: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:08.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:44:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:44:09.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:08 smithi184 ceph-mon[29861]: pgmap v1471: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:09.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:08 smithi184 ceph-mon[41609]: pgmap v1471: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:09.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:10.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:10.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:11.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:11 smithi188 ceph-mon[33283]: pgmap v1472: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:11.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:11 smithi184 ceph-mon[29861]: pgmap v1472: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:11.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:11 smithi184 ceph-mon[41609]: pgmap v1472: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:44:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:44:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:44:12.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:12 smithi188 ceph-mon[33283]: pgmap v1473: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:13.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:12 smithi184 ceph-mon[29861]: pgmap v1473: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:13.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:12 smithi184 ceph-mon[41609]: pgmap v1473: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:14 smithi188 ceph-mon[33283]: pgmap v1474: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:15.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:14 smithi184 ceph-mon[29861]: pgmap v1474: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:15.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:14 smithi184 ceph-mon[41609]: pgmap v1474: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:44:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:44:16.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:44:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:16 smithi188 ceph-mon[33283]: pgmap v1475: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:17.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:16 smithi184 ceph-mon[29861]: pgmap v1475: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:17.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:16 smithi184 ceph-mon[41609]: pgmap v1475: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:18.234 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.234 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.234 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.234 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.234 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.234 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.234 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.234 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.234 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.234 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.234 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.234 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.235 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.236 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.236 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.236 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.236 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.236 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.236 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.236 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.236 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.236 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.236 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.236 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.236 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.236 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.236 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.236 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.237 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.237 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.237 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.237 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.237 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.237 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.237 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.237 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.237 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.237 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.237 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.237 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.237 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.237 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.237 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.238 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.238 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.238 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.238 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.238 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.238 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.238 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.238 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.238 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.238 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.238 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.238 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.238 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.238 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.238 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.239 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.239 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.239 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.239 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.239 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.239 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.239 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.239 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.239 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.239 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.239 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.239 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.239 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.239 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.239 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.240 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.240 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.240 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.240 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.240 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.240 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.240 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.240 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.240 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.240 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.240 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.240 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:44:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:18 smithi188 ceph-mon[33283]: pgmap v1476: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:18.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:44:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:44:19.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:18 smithi184 ceph-mon[29861]: pgmap v1476: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:19.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:18 smithi184 ceph-mon[41609]: pgmap v1476: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:19.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:20.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:20.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:21.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:21 smithi188 ceph-mon[33283]: pgmap v1477: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:21.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:21 smithi184 ceph-mon[29861]: pgmap v1477: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:21.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:21 smithi184 ceph-mon[41609]: pgmap v1477: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:44:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:44:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:44:22.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:22 smithi188 ceph-mon[33283]: pgmap v1478: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:23.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:22 smithi184 ceph-mon[29861]: pgmap v1478: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:23.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:22 smithi184 ceph-mon[41609]: pgmap v1478: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:24.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:24 smithi188 ceph-mon[33283]: pgmap v1479: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:25.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:24 smithi184 ceph-mon[29861]: pgmap v1479: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:25.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:24 smithi184 ceph-mon[41609]: pgmap v1479: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:26.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:26 smithi188 ceph-mon[33283]: pgmap v1480: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:27.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:26 smithi184 ceph-mon[29861]: pgmap v1480: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:27.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:26 smithi184 ceph-mon[41609]: pgmap v1480: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:28.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:28 smithi188 ceph-mon[33283]: pgmap v1481: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:28.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:44:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:44:29.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:28 smithi184 ceph-mon[29861]: pgmap v1481: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:29.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:28 smithi184 ceph-mon[41609]: pgmap v1481: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:29.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:30.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:30.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:30.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:44:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:30 smithi188 ceph-mon[33283]: pgmap v1482: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:44:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:30 smithi184 ceph-mon[29861]: pgmap v1482: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:31.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:44:31.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:30 smithi184 ceph-mon[41609]: pgmap v1482: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:32.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:44:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:44:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:44:32.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:32 smithi188 ceph-mon[33283]: pgmap v1483: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:33.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:32 smithi184 ceph-mon[29861]: pgmap v1483: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:33.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:32 smithi184 ceph-mon[41609]: pgmap v1483: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:34.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:34 smithi188 ceph-mon[33283]: pgmap v1484: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:35.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:34 smithi184 ceph-mon[29861]: pgmap v1484: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:35.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:34 smithi184 ceph-mon[41609]: pgmap v1484: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:36.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:36 smithi188 ceph-mon[33283]: pgmap v1485: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:37.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:36 smithi184 ceph-mon[29861]: pgmap v1485: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:37.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:36 smithi184 ceph-mon[41609]: pgmap v1485: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:38.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:38 smithi188 ceph-mon[33283]: pgmap v1486: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:38.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:44:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:44:39.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:38 smithi184 ceph-mon[41609]: pgmap v1486: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:39.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:38 smithi184 ceph-mon[29861]: pgmap v1486: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:39.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:40.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:40.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:41.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:41 smithi188 ceph-mon[33283]: pgmap v1487: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:41.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:41 smithi184 ceph-mon[29861]: pgmap v1487: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:41.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:41 smithi184 ceph-mon[41609]: pgmap v1487: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:44:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:44:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:44:42.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:42 smithi188 ceph-mon[33283]: pgmap v1488: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:43.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:42 smithi184 ceph-mon[29861]: pgmap v1488: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:43.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:42 smithi184 ceph-mon[41609]: pgmap v1488: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:44.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:44 smithi188 ceph-mon[33283]: pgmap v1489: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:45.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:44 smithi184 ceph-mon[29861]: pgmap v1489: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:45.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:44 smithi184 ceph-mon[41609]: pgmap v1489: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:44:46.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:44:46.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:44:46.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:46 smithi188 ceph-mon[33283]: pgmap v1490: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:47.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:46 smithi184 ceph-mon[29861]: pgmap v1490: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:47.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:46 smithi184 ceph-mon[41609]: pgmap v1490: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:48.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:48 smithi188 ceph-mon[33283]: pgmap v1491: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:48.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:44:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:44:49.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:48 smithi184 ceph-mon[29861]: pgmap v1491: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:49.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:48 smithi184 ceph-mon[41609]: pgmap v1491: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:50.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:50.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:44:52.131 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:44:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:44:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:44:52.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:52 smithi188 ceph-mon[33283]: pgmap v1492: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:52.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:52 smithi184 ceph-mon[29861]: pgmap v1492: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:52.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:52 smithi184 ceph-mon[41609]: pgmap v1492: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:54.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:54 smithi188 ceph-mon[33283]: pgmap v1493: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:44:54.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:54 smithi184 ceph-mon[29861]: pgmap v1493: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:44:54.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:54 smithi184 ceph-mon[41609]: pgmap v1493: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:44:56.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:56 smithi188 ceph-mon[33283]: pgmap v1494: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:56.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:56 smithi184 ceph-mon[29861]: pgmap v1494: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:56.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:56 smithi184 ceph-mon[41609]: pgmap v1494: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:44:58.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:44:58 smithi188 ceph-mon[33283]: pgmap v1495: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:58.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:44:58 smithi184 ceph-mon[29861]: pgmap v1495: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:58.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:44:58 smithi184 ceph-mon[41609]: pgmap v1495: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:44:59.247 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:44:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:45:00.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:00 smithi188 ceph-mon[33283]: pgmap v1496: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:00.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:00 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:00.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:45:00.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:45:00.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:45:00.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:45:00.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:45:00.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:00 smithi184 ceph-mon[29861]: pgmap v1496: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:00.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:00 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:00.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:45:00.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:45:00.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:45:00.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:45:00.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:45:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:00 smithi184 ceph-mon[41609]: pgmap v1496: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:00 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:45:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:45:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:45:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:45:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:45:02.147 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:45:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:45:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:45:02.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:02 smithi188 ceph-mon[33283]: pgmap v1497: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:02.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:02 smithi184 ceph-mon[29861]: pgmap v1497: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:02.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:02 smithi184 ceph-mon[41609]: pgmap v1497: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:04.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:04 smithi188 ceph-mon[33283]: pgmap v1498: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:04.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:04 smithi184 ceph-mon[29861]: pgmap v1498: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:04.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:04 smithi184 ceph-mon[41609]: pgmap v1498: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:06.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:06 smithi188 ceph-mon[33283]: pgmap v1499: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:06.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:06 smithi184 ceph-mon[29861]: pgmap v1499: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:06.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:06 smithi184 ceph-mon[41609]: pgmap v1499: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:08.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:08 smithi188 ceph-mon[33283]: pgmap v1500: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:08.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:08 smithi184 ceph-mon[41609]: pgmap v1500: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:08.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:08 smithi184 ceph-mon[29861]: pgmap v1500: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:09.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:45:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:45:10.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:10 smithi188 ceph-mon[33283]: pgmap v1501: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:10.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:10 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:10.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:10 smithi184 ceph-mon[29861]: pgmap v1501: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:10.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:10 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:10.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:10 smithi184 ceph-mon[41609]: pgmap v1501: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:10.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:10 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:12.162 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:45:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:45:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:45:12.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:12 smithi188 ceph-mon[33283]: pgmap v1502: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:12.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:12 smithi184 ceph-mon[29861]: pgmap v1502: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:12.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:12 smithi184 ceph-mon[41609]: pgmap v1502: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:14.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:14 smithi188 ceph-mon[33283]: pgmap v1503: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:14.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:14 smithi184 ceph-mon[29861]: pgmap v1503: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:14.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:14 smithi184 ceph-mon[41609]: pgmap v1503: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:15.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:45:15.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:45:15.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:45:16.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:16 smithi188 ceph-mon[33283]: pgmap v1504: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:16.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:16 smithi184 ceph-mon[29861]: pgmap v1504: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:16.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:16 smithi184 ceph-mon[41609]: pgmap v1504: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:18.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:18 smithi188 ceph-mon[33283]: pgmap v1505: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:18.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:18 smithi184 ceph-mon[29861]: pgmap v1505: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:18.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:18 smithi184 ceph-mon[41609]: pgmap v1505: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:19.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:45:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:45:20.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:20 smithi188 ceph-mon[33283]: pgmap v1506: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:20.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:20 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:20.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:20 smithi184 ceph-mon[29861]: pgmap v1506: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:20.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:20 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:20.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:20 smithi184 ceph-mon[41609]: pgmap v1506: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:20.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:20 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:22.191 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:45:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:45:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:45:22.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:22 smithi188 ceph-mon[33283]: pgmap v1507: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:22.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:22 smithi184 ceph-mon[29861]: pgmap v1507: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:22.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:22 smithi184 ceph-mon[41609]: pgmap v1507: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:24.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:24 smithi188 ceph-mon[33283]: pgmap v1508: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:24.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:24 smithi184 ceph-mon[29861]: pgmap v1508: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:24.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:24 smithi184 ceph-mon[41609]: pgmap v1508: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:26.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:26 smithi188 ceph-mon[33283]: pgmap v1509: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:26.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:26 smithi184 ceph-mon[29861]: pgmap v1509: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:26.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:26 smithi184 ceph-mon[41609]: pgmap v1509: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:28.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:28 smithi188 ceph-mon[33283]: pgmap v1510: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:28.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:28 smithi184 ceph-mon[29861]: pgmap v1510: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:28.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:28 smithi184 ceph-mon[41609]: pgmap v1510: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:29.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:45:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:45:30.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:30 smithi188 ceph-mon[33283]: pgmap v1511: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:30.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:30 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:30.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:45:30.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:30 smithi184 ceph-mon[41609]: pgmap v1511: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:30.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:30 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:30.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:45:30.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:30 smithi184 ceph-mon[29861]: pgmap v1511: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:30.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:30 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:30.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:45:32.207 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:45:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:45:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:45:32.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:32 smithi188 ceph-mon[33283]: pgmap v1512: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:32.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:32 smithi184 ceph-mon[29861]: pgmap v1512: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:32.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:32 smithi184 ceph-mon[41609]: pgmap v1512: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:34.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:34 smithi188 ceph-mon[33283]: pgmap v1513: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:34.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:34 smithi184 ceph-mon[29861]: pgmap v1513: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:34.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:34 smithi184 ceph-mon[41609]: pgmap v1513: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:36.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:36 smithi188 ceph-mon[33283]: pgmap v1514: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:36.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:36 smithi184 ceph-mon[29861]: pgmap v1514: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:36.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:36 smithi184 ceph-mon[41609]: pgmap v1514: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:38.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:38 smithi188 ceph-mon[33283]: pgmap v1515: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:38.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:38 smithi184 ceph-mon[29861]: pgmap v1515: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:38.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:38 smithi184 ceph-mon[41609]: pgmap v1515: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:39.247 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:45:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:45:40.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:40 smithi188 ceph-mon[33283]: pgmap v1516: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:40.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:40 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:40.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:40 smithi184 ceph-mon[29861]: pgmap v1516: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:40.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:40 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:40.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:40 smithi184 ceph-mon[41609]: pgmap v1516: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:40.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:40 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:42.221 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:45:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:45:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:45:42.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:42 smithi188 ceph-mon[33283]: pgmap v1517: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:42.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:42 smithi184 ceph-mon[29861]: pgmap v1517: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:42.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:42 smithi184 ceph-mon[41609]: pgmap v1517: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:44.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:44 smithi188 ceph-mon[33283]: pgmap v1518: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:44.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:44 smithi184 ceph-mon[29861]: pgmap v1518: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:44.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:44 smithi184 ceph-mon[41609]: pgmap v1518: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:45.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:45:45.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:45:45.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:45:46.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:46 smithi188 ceph-mon[33283]: pgmap v1519: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:46.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:46 smithi184 ceph-mon[29861]: pgmap v1519: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:46.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:46 smithi184 ceph-mon[41609]: pgmap v1519: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:48.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:48 smithi188 ceph-mon[33283]: pgmap v1520: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:48.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:48 smithi184 ceph-mon[29861]: pgmap v1520: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:48.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:48 smithi184 ceph-mon[41609]: pgmap v1520: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:49.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:45:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:45:50.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:50 smithi188 ceph-mon[33283]: pgmap v1521: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:50.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:50 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:50.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:50 smithi184 ceph-mon[29861]: pgmap v1521: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:50.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:50 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:50.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:50 smithi184 ceph-mon[41609]: pgmap v1521: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:50.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:50 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:45:52.239 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:45:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:45:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:45:52.497 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:52 smithi188 ceph-mon[33283]: pgmap v1522: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:52.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:52 smithi184 ceph-mon[29861]: pgmap v1522: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:52.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:52 smithi184 ceph-mon[41609]: pgmap v1522: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:54.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:54 smithi188 ceph-mon[33283]: pgmap v1523: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:54.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:54 smithi184 ceph-mon[29861]: pgmap v1523: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:54.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:54 smithi184 ceph-mon[41609]: pgmap v1523: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:45:56.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:56 smithi188 ceph-mon[33283]: pgmap v1524: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:56.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:56 smithi184 ceph-mon[29861]: pgmap v1524: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:56.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:56 smithi184 ceph-mon[41609]: pgmap v1524: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:58.245 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.246 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.246 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.246 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.246 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.246 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.246 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.246 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.246 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.246 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.246 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.246 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.246 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.246 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.246 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.247 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.247 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.247 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.247 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.247 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.247 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.247 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.247 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.247 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.247 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.247 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.247 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.247 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.247 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.247 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.248 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.248 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.248 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.248 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.248 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.248 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.248 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.248 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.248 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.248 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.248 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.248 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.248 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.248 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.249 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.249 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.249 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.249 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.249 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.249 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.249 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.249 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.249 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.249 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.249 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.249 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.249 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.250 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.250 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.250 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.250 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.250 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.250 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.250 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.250 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.250 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.250 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.250 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.250 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.250 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.250 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.250 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.251 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.251 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.251 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.251 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.251 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.251 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.251 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.251 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.251 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.251 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.251 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.251 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.251 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.251 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.251 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.252 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.252 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.252 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.252 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.252 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.252 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.252 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.252 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.252 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.252 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.252 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.252 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.252 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:45:58.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:45:58 smithi184 ceph-mon[29861]: pgmap v1525: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:58.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:45:58 smithi184 ceph-mon[41609]: pgmap v1525: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:58.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:45:58 smithi188 ceph-mon[33283]: pgmap v1525: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:45:59.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:45:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:46:00.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:00 smithi184 ceph-mon[29861]: pgmap v1526: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:00.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:00 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:00.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:46:00.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:46:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:00 smithi184 ceph-mon[41609]: pgmap v1526: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:00 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:46:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:46:00.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:00 smithi188 ceph-mon[33283]: pgmap v1526: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:00 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:46:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:46:02.020 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:46:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:46:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:46:02.374 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:02 smithi184 ceph-mon[29861]: pgmap v1527: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:02.374 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:02 smithi184 ceph-mon[41609]: pgmap v1527: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:02.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:02 smithi188 ceph-mon[33283]: pgmap v1527: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:04.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:04 smithi184 ceph-mon[29861]: pgmap v1528: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:04.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:04 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:46:04.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:04 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:46:04.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:04 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:46:04.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:04 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:46:04.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:04 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:46:04.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:04 smithi184 ceph-mon[41609]: pgmap v1528: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:04.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:04 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:46:04.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:04 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:46:04.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:04 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:46:04.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:04 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:46:04.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:04 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:46:04.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:04 smithi188 ceph-mon[33283]: pgmap v1528: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:04.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:04 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:46:04.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:04 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:46:04.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:04 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:46:04.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:04 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:46:04.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:04 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:46:06.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:06 smithi184 ceph-mon[29861]: pgmap v1529: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:06.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:06 smithi184 ceph-mon[41609]: pgmap v1529: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:06.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:06 smithi188 ceph-mon[33283]: pgmap v1529: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:08.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:08 smithi184 ceph-mon[29861]: pgmap v1530: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:08.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:08 smithi184 ceph-mon[41609]: pgmap v1530: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:08.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:08 smithi188 ceph-mon[33283]: pgmap v1530: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:09.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:46:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:46:10.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:10 smithi184 ceph-mon[29861]: pgmap v1531: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:10.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:10 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:10.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:10 smithi184 ceph-mon[41609]: pgmap v1531: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:10.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:10 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:10 smithi188 ceph-mon[33283]: pgmap v1531: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:10 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:12.269 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:46:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:46:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:46:12.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:12 smithi184 ceph-mon[29861]: pgmap v1532: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:12.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:12 smithi184 ceph-mon[41609]: pgmap v1532: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:12.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:12 smithi188 ceph-mon[33283]: pgmap v1532: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:14.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:14 smithi188 ceph-mon[33283]: pgmap v1533: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:14.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:14 smithi184 ceph-mon[29861]: pgmap v1533: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:14.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:14 smithi184 ceph-mon[41609]: pgmap v1533: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:15.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:46:15.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:46:15.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:46:16.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:16 smithi188 ceph-mon[33283]: pgmap v1534: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:16.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:16 smithi184 ceph-mon[29861]: pgmap v1534: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:16 smithi184 ceph-mon[41609]: pgmap v1534: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:18.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:18 smithi188 ceph-mon[33283]: pgmap v1535: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:18.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:18 smithi184 ceph-mon[29861]: pgmap v1535: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:18.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:18 smithi184 ceph-mon[41609]: pgmap v1535: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:19.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:46:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:46:20.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:20 smithi188 ceph-mon[33283]: pgmap v1536: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:20.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:20 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:20.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:20 smithi184 ceph-mon[29861]: pgmap v1536: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:20.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:20 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:20.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:20 smithi184 ceph-mon[41609]: pgmap v1536: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:20.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:20 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:46:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:46:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:46:22.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:22 smithi188 ceph-mon[33283]: pgmap v1537: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:22.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:22 smithi184 ceph-mon[29861]: pgmap v1537: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:22.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:22 smithi184 ceph-mon[41609]: pgmap v1537: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:24.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:24 smithi188 ceph-mon[33283]: pgmap v1538: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:24.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:24 smithi184 ceph-mon[29861]: pgmap v1538: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:24.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:24 smithi184 ceph-mon[41609]: pgmap v1538: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:26.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:26 smithi188 ceph-mon[33283]: pgmap v1539: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:26.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:26 smithi184 ceph-mon[29861]: pgmap v1539: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:26.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:26 smithi184 ceph-mon[41609]: pgmap v1539: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:28.550 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:28 smithi188 ceph-mon[33283]: pgmap v1540: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:28.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:28 smithi184 ceph-mon[29861]: pgmap v1540: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:28.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:28 smithi184 ceph-mon[41609]: pgmap v1540: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:29.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:46:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:46:30.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:30 smithi188 ceph-mon[33283]: pgmap v1541: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:30.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:30 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:30.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:46:30.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:30 smithi184 ceph-mon[29861]: pgmap v1541: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:30.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:30 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:30.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:46:30.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:30 smithi184 ceph-mon[41609]: pgmap v1541: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:30.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:30 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:30.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:46:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:46:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:46:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:46:32.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:32 smithi188 ceph-mon[33283]: pgmap v1542: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:32.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:32 smithi184 ceph-mon[41609]: pgmap v1542: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:32.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:32 smithi184 ceph-mon[29861]: pgmap v1542: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:34.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:34 smithi188 ceph-mon[33283]: pgmap v1543: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:34.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:34 smithi184 ceph-mon[29861]: pgmap v1543: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:34.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:34 smithi184 ceph-mon[41609]: pgmap v1543: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:36.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:36 smithi188 ceph-mon[33283]: pgmap v1544: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:36.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:36 smithi184 ceph-mon[29861]: pgmap v1544: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:36 smithi184 ceph-mon[41609]: pgmap v1544: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:38.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:38 smithi188 ceph-mon[33283]: pgmap v1545: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:38.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:38 smithi184 ceph-mon[29861]: pgmap v1545: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:38.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:38 smithi184 ceph-mon[41609]: pgmap v1545: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:39.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:46:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:46:40.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:40 smithi188 ceph-mon[33283]: pgmap v1546: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:40.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:40 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:40.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:40 smithi184 ceph-mon[29861]: pgmap v1546: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:40.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:40 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:40.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:40 smithi184 ceph-mon[41609]: pgmap v1546: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:40.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:40 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:46:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:46:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:46:42.542 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:42 smithi184 ceph-mon[29861]: pgmap v1547: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:42.543 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:42 smithi184 ceph-mon[41609]: pgmap v1547: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:42.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:42 smithi188 ceph-mon[33283]: pgmap v1547: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:44.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:44 smithi188 ceph-mon[33283]: pgmap v1548: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:44.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:44 smithi184 ceph-mon[41609]: pgmap v1548: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:44.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:44 smithi184 ceph-mon[29861]: pgmap v1548: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:45.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:46:45.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:46:45.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:46:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:46 smithi188 ceph-mon[33283]: pgmap v1549: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:46.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:46 smithi184 ceph-mon[29861]: pgmap v1549: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:46.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:46 smithi184 ceph-mon[41609]: pgmap v1549: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:48.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:48 smithi188 ceph-mon[33283]: pgmap v1550: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:48.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:48 smithi184 ceph-mon[29861]: pgmap v1550: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:48.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:48 smithi184 ceph-mon[41609]: pgmap v1550: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:49.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:46:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:46:50.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:50 smithi188 ceph-mon[33283]: pgmap v1551: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:50.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:50 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:50.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:50 smithi184 ceph-mon[29861]: pgmap v1551: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:50.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:50 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:50.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:50 smithi184 ceph-mon[41609]: pgmap v1551: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:50.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:50 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:46:52.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:46:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:46:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:46:52.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:52 smithi188 ceph-mon[33283]: pgmap v1552: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:52.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:52 smithi184 ceph-mon[29861]: pgmap v1552: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:52.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:52 smithi184 ceph-mon[41609]: pgmap v1552: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:54.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:54 smithi188 ceph-mon[33283]: pgmap v1553: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:54.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:54 smithi184 ceph-mon[29861]: pgmap v1553: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:54.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:54 smithi184 ceph-mon[41609]: pgmap v1553: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:46:56.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:56 smithi188 ceph-mon[33283]: pgmap v1554: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:56.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:56 smithi184 ceph-mon[29861]: pgmap v1554: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:56.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:56 smithi184 ceph-mon[41609]: pgmap v1554: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:46:58.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:46:58 smithi188 ceph-mon[33283]: pgmap v1555: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:58.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:46:58 smithi184 ceph-mon[29861]: pgmap v1555: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:58.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:46:58 smithi184 ceph-mon[41609]: pgmap v1555: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:46:59.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:46:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:47:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:00 smithi188 ceph-mon[33283]: pgmap v1556: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:00 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:47:00.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:00 smithi184 ceph-mon[29861]: pgmap v1556: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:00.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:00 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:00.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:47:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:00 smithi184 ceph-mon[41609]: pgmap v1556: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:00 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:47:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:47:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:47:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:47:02.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:02 smithi188 ceph-mon[33283]: pgmap v1557: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:02.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:02 smithi184 ceph-mon[29861]: pgmap v1557: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:02.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:02 smithi184 ceph-mon[41609]: pgmap v1557: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:04.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:04 smithi188 ceph-mon[33283]: pgmap v1558: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:04.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:04 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:47:04.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:04 smithi184 ceph-mon[29861]: pgmap v1558: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:04.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:04 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:47:04.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:04 smithi184 ceph-mon[41609]: pgmap v1558: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:04.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:04 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:47:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:05 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:47:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:05 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:47:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:05 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:47:05.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:05 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:47:05.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:05 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:47:05.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:05 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:47:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:05 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:47:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:05 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:47:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:05 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:47:06.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:06 smithi188 ceph-mon[33283]: pgmap v1559: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:07.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:06 smithi184 ceph-mon[29861]: pgmap v1559: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:07.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:06 smithi184 ceph-mon[41609]: pgmap v1559: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:08.954 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:08 smithi188 ceph-mon[33283]: pgmap v1560: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:47:09.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:08 smithi184 ceph-mon[41609]: pgmap v1560: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:47:09.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:08 smithi184 ceph-mon[29861]: pgmap v1560: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:47:09.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:47:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:47:10.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:10 smithi188 ceph-mon[33283]: pgmap v1561: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:10.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:10 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:11.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:10 smithi184 ceph-mon[29861]: pgmap v1561: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:11.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:10 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:11.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:10 smithi184 ceph-mon[41609]: pgmap v1561: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:11.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:10 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:47:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:47:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:47:12.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:12 smithi188 ceph-mon[33283]: pgmap v1562: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:13.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:12 smithi184 ceph-mon[29861]: pgmap v1562: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:13.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:12 smithi184 ceph-mon[41609]: pgmap v1562: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:14 smithi188 ceph-mon[33283]: pgmap v1563: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:15.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:14 smithi184 ceph-mon[29861]: pgmap v1563: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:15.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:14 smithi184 ceph-mon[41609]: pgmap v1563: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:47:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:47:16.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:47:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:16 smithi188 ceph-mon[33283]: pgmap v1564: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:47:17.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:16 smithi184 ceph-mon[29861]: pgmap v1564: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:47:17.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:16 smithi184 ceph-mon[41609]: pgmap v1564: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:47:18.965 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:18 smithi188 ceph-mon[33283]: pgmap v1565: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:47:19.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:18 smithi184 ceph-mon[29861]: pgmap v1565: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:47:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:18 smithi184 ceph-mon[41609]: pgmap v1565: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:47:19.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:47:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:47:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:20 smithi188 ceph-mon[33283]: pgmap v1566: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:20 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:21.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:20 smithi184 ceph-mon[29861]: pgmap v1566: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:21.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:20 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:21.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:20 smithi184 ceph-mon[41609]: pgmap v1566: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:21.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:20 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:47:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:47:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:47:22.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:22 smithi188 ceph-mon[33283]: pgmap v1567: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:23.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:22 smithi184 ceph-mon[29861]: pgmap v1567: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:23.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:22 smithi184 ceph-mon[41609]: pgmap v1567: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:24.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:24 smithi188 ceph-mon[33283]: pgmap v1568: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:25.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:24 smithi184 ceph-mon[29861]: pgmap v1568: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:25.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:24 smithi184 ceph-mon[41609]: pgmap v1568: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:26.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:26 smithi188 ceph-mon[33283]: pgmap v1569: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:27.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:26 smithi184 ceph-mon[29861]: pgmap v1569: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:27.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:26 smithi184 ceph-mon[41609]: pgmap v1569: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:28.967 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:28 smithi188 ceph-mon[33283]: pgmap v1570: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:29.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:28 smithi184 ceph-mon[29861]: pgmap v1570: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:29.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:28 smithi184 ceph-mon[41609]: pgmap v1570: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:29.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:47:28 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:47:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:30 smithi188 ceph-mon[33283]: pgmap v1571: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:30 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:47:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:30 smithi184 ceph-mon[29861]: pgmap v1571: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:30 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:47:31.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:30 smithi184 ceph-mon[41609]: pgmap v1571: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:31.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:30 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:31.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:47:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:47:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:47:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:47:32.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:32 smithi188 ceph-mon[33283]: pgmap v1572: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:33.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:32 smithi184 ceph-mon[29861]: pgmap v1572: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:33.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:32 smithi184 ceph-mon[41609]: pgmap v1572: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:34.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:34 smithi188 ceph-mon[33283]: pgmap v1573: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:35.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:34 smithi184 ceph-mon[29861]: pgmap v1573: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:35.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:34 smithi184 ceph-mon[41609]: pgmap v1573: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:36.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:36 smithi188 ceph-mon[33283]: pgmap v1574: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:37.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:36 smithi184 ceph-mon[29861]: pgmap v1574: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:37.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:36 smithi184 ceph-mon[41609]: pgmap v1574: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:37.257 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.257 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.258 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.259 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.260 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.261 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.262 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.263 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.263 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.263 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.263 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.263 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.263 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.263 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.263 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.263 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.263 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.263 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.263 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.264 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.264 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.264 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.264 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.264 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.264 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.264 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.264 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.264 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.264 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:37.264 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:47:38.978 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:38 smithi188 ceph-mon[33283]: pgmap v1575: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:39.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:38 smithi184 ceph-mon[29861]: pgmap v1575: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:39.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:38 smithi184 ceph-mon[41609]: pgmap v1575: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:39.247 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:47:38 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:47:40.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:40 smithi188 ceph-mon[33283]: pgmap v1576: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:40.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:40 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:41.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:40 smithi184 ceph-mon[29861]: pgmap v1576: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:41.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:40 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:41.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:40 smithi184 ceph-mon[41609]: pgmap v1576: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-05T07:47:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:40 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:47:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:47:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:47:42.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:42 smithi188 ceph-mon[33283]: pgmap v1577: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:43.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:42 smithi184 ceph-mon[29861]: pgmap v1577: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:43.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:42 smithi184 ceph-mon[41609]: pgmap v1577: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:44.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:44 smithi188 ceph-mon[33283]: pgmap v1578: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:45.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:44 smithi184 ceph-mon[29861]: pgmap v1578: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:45.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:44 smithi184 ceph-mon[41609]: pgmap v1578: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:47:46.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:47:46.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:47:46.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:46 smithi188 ceph-mon[33283]: pgmap v1579: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:47.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:46 smithi184 ceph-mon[29861]: pgmap v1579: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:47.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:46 smithi184 ceph-mon[41609]: pgmap v1579: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:48.989 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:48 smithi188 ceph-mon[33283]: pgmap v1580: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:47:49.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:48 smithi184 ceph-mon[29861]: pgmap v1580: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:47:49.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:48 smithi184 ceph-mon[41609]: pgmap v1580: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:47:49.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:47:48 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:47:49.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:49 smithi188 ceph-mon[33283]: pgmap v1581: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:49.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:50.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:49 smithi184 ceph-mon[29861]: pgmap v1581: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:50.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:50.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:49 smithi184 ceph-mon[41609]: pgmap v1581: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:50.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:47:52.177 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:47:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:47:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:47:52.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:52 smithi188 ceph-mon[33283]: pgmap v1582: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:52.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:52 smithi184 ceph-mon[29861]: pgmap v1582: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:52.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:52 smithi184 ceph-mon[41609]: pgmap v1582: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:54.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:54 smithi188 ceph-mon[33283]: pgmap v1583: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:54.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:54 smithi184 ceph-mon[29861]: pgmap v1583: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:54.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:54 smithi184 ceph-mon[41609]: pgmap v1583: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:47:56.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:56 smithi188 ceph-mon[33283]: pgmap v1584: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:56.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:56 smithi184 ceph-mon[29861]: pgmap v1584: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:56.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:56 smithi184 ceph-mon[41609]: pgmap v1584: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:47:58.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:47:58 smithi188 ceph-mon[33283]: pgmap v1585: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:47:58.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:47:58 smithi184 ceph-mon[29861]: pgmap v1585: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:47:58.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:47:58 smithi184 ceph-mon[41609]: pgmap v1585: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:47:59.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:47:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:48:00.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:00 smithi188 ceph-mon[33283]: pgmap v1586: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:00.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:00 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:00.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:48:00.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:00 smithi184 ceph-mon[29861]: pgmap v1586: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:00.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:00 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:00.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:48:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:00 smithi184 ceph-mon[41609]: pgmap v1586: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:00 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:48:02.196 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:48:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:48:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:48:02.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:02 smithi188 ceph-mon[33283]: pgmap v1587: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:48:02.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:02 smithi184 ceph-mon[29861]: pgmap v1587: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:48:02.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:02 smithi184 ceph-mon[41609]: pgmap v1587: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:48:04.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:04 smithi188 ceph-mon[33283]: pgmap v1588: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:04.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:04 smithi184 ceph-mon[29861]: pgmap v1588: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:04.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:04 smithi184 ceph-mon[41609]: pgmap v1588: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:05.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:05 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:48:05.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:05 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:48:05.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:05 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:48:06.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:06 smithi188 ceph-mon[33283]: pgmap v1589: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:48:06.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:06 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:48:06.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:06 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:48:06.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:06 smithi184 ceph-mon[29861]: pgmap v1589: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:48:06.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:06 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:48:06.523 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:06 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:48:06.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:06 smithi184 ceph-mon[41609]: pgmap v1589: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:48:06.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:06 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:48:06.523 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:06 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:48:08.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:08 smithi188 ceph-mon[33283]: pgmap v1590: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:48:08.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:08 smithi184 ceph-mon[29861]: pgmap v1590: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:48:08.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:08 smithi184 ceph-mon[41609]: pgmap v1590: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:48:09.239 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:48:09 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:48:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:10 smithi188 ceph-mon[33283]: pgmap v1591: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:10 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:10 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:48:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:10 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:48:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:10 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:48:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:10 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:48:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:10 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:48:10.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:10 smithi184 ceph-mon[29861]: pgmap v1591: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:10.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:10 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:10.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:10 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:48:10.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:10 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:48:10.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:10 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:48:10.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:10 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:48:10.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:10 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:48:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:10 smithi184 ceph-mon[41609]: pgmap v1591: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:10 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:10 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:48:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:10 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:48:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:10 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:48:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:10 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:48:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:10 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:48:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:48:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:48:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:48:12.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:12 smithi188 ceph-mon[33283]: pgmap v1592: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:12.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:12 smithi184 ceph-mon[29861]: pgmap v1592: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:12.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:12 smithi184 ceph-mon[41609]: pgmap v1592: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:14.573 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:14 smithi184 ceph-mon[29861]: pgmap v1593: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:14.573 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:14 smithi184 ceph-mon[41609]: pgmap v1593: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:14.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:14 smithi188 ceph-mon[33283]: pgmap v1593: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:15.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:48:15.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:48:15.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:48:16.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:16 smithi188 ceph-mon[33283]: pgmap v1594: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:16.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:16 smithi184 ceph-mon[29861]: pgmap v1594: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:16 smithi184 ceph-mon[41609]: pgmap v1594: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:18.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:18 smithi188 ceph-mon[33283]: pgmap v1595: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:48:18.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:18 smithi184 ceph-mon[29861]: pgmap v1595: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:48:18.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:18 smithi184 ceph-mon[41609]: pgmap v1595: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:48:19.497 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:48:19 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:48:20.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:20 smithi188 ceph-mon[33283]: pgmap v1596: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:20.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:20 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:20.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:20 smithi184 ceph-mon[29861]: pgmap v1596: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:20.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:20 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:20.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:20 smithi184 ceph-mon[41609]: pgmap v1596: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:20.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:20 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:22.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:48:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:48:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:48:22.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:22 smithi188 ceph-mon[33283]: pgmap v1597: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:22.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:22 smithi184 ceph-mon[41609]: pgmap v1597: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:22.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:22 smithi184 ceph-mon[29861]: pgmap v1597: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:24.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:24 smithi188 ceph-mon[33283]: pgmap v1598: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:24.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:24 smithi184 ceph-mon[29861]: pgmap v1598: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:24.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:24 smithi184 ceph-mon[41609]: pgmap v1598: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:26.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:26 smithi188 ceph-mon[33283]: pgmap v1599: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:26.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:26 smithi184 ceph-mon[29861]: pgmap v1599: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:26.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:26 smithi184 ceph-mon[41609]: pgmap v1599: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:28.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:28 smithi188 ceph-mon[33283]: pgmap v1600: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:48:28.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:28 smithi184 ceph-mon[29861]: pgmap v1600: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:48:28.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:28 smithi184 ceph-mon[41609]: pgmap v1600: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:48:29.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:48:29 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:48:30.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:30 smithi188 ceph-mon[33283]: pgmap v1601: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:30.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:30 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:30.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:48:30.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:30 smithi184 ceph-mon[41609]: pgmap v1601: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:30.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:30 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:30.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:48:30.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:30 smithi184 ceph-mon[29861]: pgmap v1601: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:30.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:30 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:30.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:48:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:48:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:48:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:48:32.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:32 smithi188 ceph-mon[33283]: pgmap v1602: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:32.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:32 smithi184 ceph-mon[29861]: pgmap v1602: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:32.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:32 smithi184 ceph-mon[41609]: pgmap v1602: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:34.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:34 smithi188 ceph-mon[33283]: pgmap v1603: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:34.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:34 smithi184 ceph-mon[29861]: pgmap v1603: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:34.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:34 smithi184 ceph-mon[41609]: pgmap v1603: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:36.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:36 smithi188 ceph-mon[33283]: pgmap v1604: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:36.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:36 smithi184 ceph-mon[29861]: pgmap v1604: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:36.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:36 smithi184 ceph-mon[41609]: pgmap v1604: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:38.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:38 smithi188 ceph-mon[33283]: pgmap v1605: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:38.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:38 smithi184 ceph-mon[29861]: pgmap v1605: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:38.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:38 smithi184 ceph-mon[41609]: pgmap v1605: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:39.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:48:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:48:40.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:40 smithi188 ceph-mon[33283]: pgmap v1606: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:40.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:40 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:40.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:40 smithi184 ceph-mon[29861]: pgmap v1606: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:40.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:40 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:40.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:40 smithi184 ceph-mon[41609]: pgmap v1606: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:40.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:40 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:48:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:48:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:48:42.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:42 smithi188 ceph-mon[33283]: pgmap v1607: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:42.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:42 smithi184 ceph-mon[29861]: pgmap v1607: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:42.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:42 smithi184 ceph-mon[41609]: pgmap v1607: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:44.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:44 smithi188 ceph-mon[33283]: pgmap v1608: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:44.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:44 smithi184 ceph-mon[41609]: pgmap v1608: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:44.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:44 smithi184 ceph-mon[29861]: pgmap v1608: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:45.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:48:45.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:48:45.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:48:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:46 smithi188 ceph-mon[33283]: pgmap v1609: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:46.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:46 smithi184 ceph-mon[29861]: pgmap v1609: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:46.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:46 smithi184 ceph-mon[41609]: pgmap v1609: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:48.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:48 smithi188 ceph-mon[33283]: pgmap v1610: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:48:48.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:48 smithi184 ceph-mon[29861]: pgmap v1610: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:48:48.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:48 smithi184 ceph-mon[41609]: pgmap v1610: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:48:49.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:48:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:48:50.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:50 smithi188 ceph-mon[33283]: pgmap v1611: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:50.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:50 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:50.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:50 smithi184 ceph-mon[29861]: pgmap v1611: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:50.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:50 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:50.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:50 smithi184 ceph-mon[41609]: pgmap v1611: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:50.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:50 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:48:51.748 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:48:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a[66295]: logger=cleanup t=2024-02-05T07:48:51.30010364Z level=info msg="Completed cleanup jobs" duration=5.695689ms 2024-02-05T07:48:52.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:48:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:48:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:48:52.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:52 smithi188 ceph-mon[33283]: pgmap v1612: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:52.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:52 smithi184 ceph-mon[29861]: pgmap v1612: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:52.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:52 smithi184 ceph-mon[41609]: pgmap v1612: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:54.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:54 smithi188 ceph-mon[33283]: pgmap v1613: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:54.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:54 smithi184 ceph-mon[29861]: pgmap v1613: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:54.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:54 smithi184 ceph-mon[41609]: pgmap v1613: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:48:56.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:56 smithi188 ceph-mon[33283]: pgmap v1614: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:56.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:56 smithi184 ceph-mon[29861]: pgmap v1614: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:56.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:56 smithi184 ceph-mon[41609]: pgmap v1614: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:48:58.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:48:58 smithi188 ceph-mon[33283]: pgmap v1615: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:48:58.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:48:58 smithi184 ceph-mon[29861]: pgmap v1615: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:48:58.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:48:58 smithi184 ceph-mon[41609]: pgmap v1615: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:48:59.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:48:59 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:49:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:00 smithi188 ceph-mon[33283]: pgmap v1616: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:00 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:49:00.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:00 smithi184 ceph-mon[29861]: pgmap v1616: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:00.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:00 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:00.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:49:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:00 smithi184 ceph-mon[41609]: pgmap v1616: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:00 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:49:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:49:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:49:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:49:02.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:02 smithi188 ceph-mon[33283]: pgmap v1617: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:02.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:02 smithi184 ceph-mon[29861]: pgmap v1617: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:02.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:02 smithi184 ceph-mon[41609]: pgmap v1617: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:04.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:04 smithi188 ceph-mon[33283]: pgmap v1618: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:04.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:04 smithi184 ceph-mon[29861]: pgmap v1618: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:04.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:04 smithi184 ceph-mon[41609]: pgmap v1618: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:06.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:06 smithi188 ceph-mon[33283]: pgmap v1619: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:06.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:06 smithi184 ceph-mon[29861]: pgmap v1619: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:06.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:06 smithi184 ceph-mon[41609]: pgmap v1619: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:08.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:08 smithi188 ceph-mon[33283]: pgmap v1620: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:49:08.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:08 smithi184 ceph-mon[29861]: pgmap v1620: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:49:08.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:08 smithi184 ceph-mon[41609]: pgmap v1620: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:49:09.497 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:49:09 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:49:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:10 smithi188 ceph-mon[33283]: pgmap v1621: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:10 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:10 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:49:10.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:10 smithi184 ceph-mon[29861]: pgmap v1621: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:10.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:10 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:10.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:10 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:49:10.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:10 smithi184 ceph-mon[41609]: pgmap v1621: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:10 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:10 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:49:11.880 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:11 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:49:11.880 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:11 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:49:11.880 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:11 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:49:11.880 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:11 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:49:11.881 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:11 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:49:11.881 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:11 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:49:11.881 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:11 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:49:11.881 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:11 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:49:11.881 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:11 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:49:11.881 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:11 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:49:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:11 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:49:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:11 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:49:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:11 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:49:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:11 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:49:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:11 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:49:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:49:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:49:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:49:12.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:12 smithi188 ceph-mon[33283]: pgmap v1622: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:13.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:12 smithi184 ceph-mon[29861]: pgmap v1622: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:13.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:12 smithi184 ceph-mon[41609]: pgmap v1622: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:14 smithi188 ceph-mon[33283]: pgmap v1623: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:15.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:14 smithi184 ceph-mon[29861]: pgmap v1623: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:15.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:14 smithi184 ceph-mon[41609]: pgmap v1623: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:49:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:49:16.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:49:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:16 smithi188 ceph-mon[33283]: pgmap v1624: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:17.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:16 smithi184 ceph-mon[29861]: pgmap v1624: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:17.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:16 smithi184 ceph-mon[41609]: pgmap v1624: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:17.270 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.270 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.270 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.270 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.270 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.270 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.270 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.270 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.271 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.272 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.273 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.274 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.275 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.275 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.275 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.275 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.275 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.275 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.275 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.275 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.275 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.275 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.275 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.275 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.275 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.275 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.275 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.276 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.276 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.276 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.276 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.276 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.276 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.276 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.276 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.276 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.276 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:17.276 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:49:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:18 smithi188 ceph-mon[33283]: pgmap v1625: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:49:19.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:18 smithi184 ceph-mon[29861]: pgmap v1625: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:49:19.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:18 smithi184 ceph-mon[41609]: pgmap v1625: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:49:19.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:49:19 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:49:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:20 smithi188 ceph-mon[33283]: pgmap v1626: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:20 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:21.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:20 smithi184 ceph-mon[29861]: pgmap v1626: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:21.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:20 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:21.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:20 smithi184 ceph-mon[41609]: pgmap v1626: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:21.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:20 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:49:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:49:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:49:22.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:22 smithi188 ceph-mon[33283]: pgmap v1627: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:23.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:22 smithi184 ceph-mon[29861]: pgmap v1627: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:23.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:22 smithi184 ceph-mon[41609]: pgmap v1627: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:24.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:24 smithi188 ceph-mon[33283]: pgmap v1628: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:25.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:24 smithi184 ceph-mon[29861]: pgmap v1628: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:25.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:24 smithi184 ceph-mon[41609]: pgmap v1628: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:26.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:26 smithi188 ceph-mon[33283]: pgmap v1629: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:27.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:26 smithi184 ceph-mon[29861]: pgmap v1629: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:27.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:26 smithi184 ceph-mon[41609]: pgmap v1629: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:28.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:28 smithi188 ceph-mon[33283]: pgmap v1630: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:29.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:28 smithi184 ceph-mon[29861]: pgmap v1630: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:29.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:28 smithi184 ceph-mon[41609]: pgmap v1630: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:29.497 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:49:29 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:49:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:30 smithi188 ceph-mon[33283]: pgmap v1631: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:30 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:49:31.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:30 smithi184 ceph-mon[41609]: pgmap v1631: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:31.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:30 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:31.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:49:31.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:30 smithi184 ceph-mon[29861]: pgmap v1631: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:31.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:30 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:31.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:49:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:49:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:49:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:49:32.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:32 smithi188 ceph-mon[33283]: pgmap v1632: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:33.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:32 smithi184 ceph-mon[29861]: pgmap v1632: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:33.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:32 smithi184 ceph-mon[41609]: pgmap v1632: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:34.997 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:34 smithi188 ceph-mon[33283]: pgmap v1633: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:35.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:34 smithi184 ceph-mon[29861]: pgmap v1633: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:35.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:34 smithi184 ceph-mon[41609]: pgmap v1633: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:36.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:36 smithi188 ceph-mon[33283]: pgmap v1634: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:37.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:36 smithi184 ceph-mon[29861]: pgmap v1634: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:37.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:36 smithi184 ceph-mon[41609]: pgmap v1634: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:38.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:38 smithi188 ceph-mon[33283]: pgmap v1635: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:49:39.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:38 smithi184 ceph-mon[29861]: pgmap v1635: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:49:39.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:38 smithi184 ceph-mon[41609]: pgmap v1635: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:49:39.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:49:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:49:40.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:40 smithi188 ceph-mon[33283]: pgmap v1636: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:40.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:40 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:41.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:40 smithi184 ceph-mon[29861]: pgmap v1636: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:41.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:40 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:41.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:40 smithi184 ceph-mon[41609]: pgmap v1636: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:40 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:49:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:49:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:49:42.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:42 smithi188 ceph-mon[33283]: pgmap v1637: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:43.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:42 smithi184 ceph-mon[29861]: pgmap v1637: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:43.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:42 smithi184 ceph-mon[41609]: pgmap v1637: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:44.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:44 smithi188 ceph-mon[33283]: pgmap v1638: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:45.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:44 smithi184 ceph-mon[29861]: pgmap v1638: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:45.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:44 smithi184 ceph-mon[41609]: pgmap v1638: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:49:46.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:49:46.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:49:46.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:46 smithi188 ceph-mon[33283]: pgmap v1639: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:47.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:46 smithi184 ceph-mon[29861]: pgmap v1639: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:47.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:46 smithi184 ceph-mon[41609]: pgmap v1639: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:48.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:48 smithi188 ceph-mon[33283]: pgmap v1640: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:49:49.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:48 smithi184 ceph-mon[29861]: pgmap v1640: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:49:49.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:48 smithi184 ceph-mon[41609]: pgmap v1640: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:49:49.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:49:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:49:50.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:50 smithi188 ceph-mon[33283]: pgmap v1641: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:50.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:50 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:51.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:50 smithi184 ceph-mon[29861]: pgmap v1641: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:51.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:50 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:51.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:50 smithi184 ceph-mon[41609]: pgmap v1641: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:51.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:50 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:49:52.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:49:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:49:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:49:52.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:52 smithi188 ceph-mon[33283]: pgmap v1642: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:53.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:52 smithi184 ceph-mon[29861]: pgmap v1642: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:53.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:52 smithi184 ceph-mon[41609]: pgmap v1642: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:54.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:54 smithi188 ceph-mon[33283]: pgmap v1643: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:55.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:54 smithi184 ceph-mon[29861]: pgmap v1643: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:55.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:54 smithi184 ceph-mon[41609]: pgmap v1643: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:49:56.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:56 smithi188 ceph-mon[33283]: pgmap v1644: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:57.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:56 smithi184 ceph-mon[29861]: pgmap v1644: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:57.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:56 smithi184 ceph-mon[41609]: pgmap v1644: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:49:58.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:49:58 smithi188 ceph-mon[33283]: pgmap v1645: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:49:59.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:49:58 smithi184 ceph-mon[29861]: pgmap v1645: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:49:59.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:49:58 smithi184 ceph-mon[41609]: pgmap v1645: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:49:59.497 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:49:59 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:50:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:00 smithi188 ceph-mon[33283]: pgmap v1646: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:00 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:00 smithi188 ceph-mon[33283]: overall HEALTH_WARN 4 pool(s) do not have an application enabled 2024-02-05T07:50:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:50:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:00 smithi184 ceph-mon[29861]: pgmap v1646: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:00 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:00 smithi184 ceph-mon[29861]: overall HEALTH_WARN 4 pool(s) do not have an application enabled 2024-02-05T07:50:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:50:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:00 smithi184 ceph-mon[41609]: pgmap v1646: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:00 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:00 smithi184 ceph-mon[41609]: overall HEALTH_WARN 4 pool(s) do not have an application enabled 2024-02-05T07:50:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:50:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:50:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:50:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:50:02.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:02 smithi188 ceph-mon[33283]: pgmap v1647: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:50:03.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:02 smithi184 ceph-mon[29861]: pgmap v1647: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:50:03.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:02 smithi184 ceph-mon[41609]: pgmap v1647: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:50:04.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:04 smithi188 ceph-mon[33283]: pgmap v1648: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:05.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:04 smithi184 ceph-mon[29861]: pgmap v1648: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:05.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:04 smithi184 ceph-mon[41609]: pgmap v1648: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:06.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:06 smithi188 ceph-mon[33283]: pgmap v1649: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:50:07.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:06 smithi184 ceph-mon[29861]: pgmap v1649: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:50:07.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:06 smithi184 ceph-mon[41609]: pgmap v1649: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:50:07.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:07 smithi188 ceph-mon[33283]: pgmap v1650: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:50:07.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:07 smithi188 ceph-mon[33283]: osdmap e754: 8 total, 8 up, 8 in 2024-02-05T07:50:08.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:07 smithi184 ceph-mon[29861]: pgmap v1650: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:50:08.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:07 smithi184 ceph-mon[29861]: osdmap e754: 8 total, 8 up, 8 in 2024-02-05T07:50:08.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:07 smithi184 ceph-mon[41609]: pgmap v1650: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:50:08.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:07 smithi184 ceph-mon[41609]: osdmap e754: 8 total, 8 up, 8 in 2024-02-05T07:50:09.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:50:09 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:50:09.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:09 smithi188 ceph-mon[33283]: osdmap e755: 8 total, 8 up, 8 in 2024-02-05T07:50:09.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:09 smithi188 ceph-mon[33283]: pgmap v1653: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:09.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:09 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:10.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:09 smithi184 ceph-mon[29861]: osdmap e755: 8 total, 8 up, 8 in 2024-02-05T07:50:10.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:09 smithi184 ceph-mon[29861]: pgmap v1653: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:10.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:09 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:10.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:09 smithi184 ceph-mon[41609]: osdmap e755: 8 total, 8 up, 8 in 2024-02-05T07:50:10.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:09 smithi184 ceph-mon[41609]: pgmap v1653: 260 pgs: 260 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:10.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:09 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:10.277 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.277 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.277 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.277 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.277 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.277 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.277 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.278 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.278 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.278 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.278 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.278 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.278 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.278 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.278 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.278 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.278 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.278 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.278 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.278 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.279 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.279 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.279 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.279 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.279 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.279 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.279 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.279 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.279 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.279 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.279 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.279 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.279 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.279 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.279 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.280 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.280 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.280 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.280 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.280 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.280 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.280 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.280 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.280 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.280 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.280 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.280 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.280 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.280 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.280 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.281 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.281 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.281 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 1 sec 2024-02-05T07:50:10.281 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: started 512 aios 2024-02-05T07:50:10.281 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x5602548dc720 2024-02-05T07:50:10.281 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c1f190 2024-02-05T07:50:10.281 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c21db0 2024-02-05T07:50:10.281 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c22380 2024-02-05T07:50:10.281 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c22270 2024-02-05T07:50:10.281 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c228c0 2024-02-05T07:50:10.281 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c23310 2024-02-05T07:50:10.281 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c23120 2024-02-05T07:50:10.281 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c237e0 2024-02-05T07:50:10.281 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c238f0 2024-02-05T07:50:10.281 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c23dc0 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c23ed0 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c24480 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c23aa0 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c23bb0 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c23fe0 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c240f0 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c24220 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c245b0 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c246e0 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c24c90 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c24830 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c24940 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c24a50 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c24da0 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c24eb0 2024-02-05T07:50:10.282 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c254a0 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c25000 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c25130 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c25240 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c25350 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c25a50 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c255b0 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c256c0 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c257d0 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c258e0 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c26080 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c25be0 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c25cf0 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c25e00 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c25f30 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c26630 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c26190 2024-02-05T07:50:10.283 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c262a0 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c263d0 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c264e0 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c26c20 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c26780 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c26890 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c269a0 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c26ab0 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c271d0 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c26d30 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c26e60 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c26f70 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c27080 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c277a0 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c27300 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c27430 2024-02-05T07:50:10.284 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c27560 2024-02-05T07:50:10.285 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c27670 2024-02-05T07:50:10.285 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c27d70 2024-02-05T07:50:10.285 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c278d0 2024-02-05T07:50:10.285 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c279e0 2024-02-05T07:50:10.285 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c27af0 2024-02-05T07:50:10.285 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c27c00 2024-02-05T07:50:10.285 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c28320 2024-02-05T07:50:10.285 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c27e80 2024-02-05T07:50:10.285 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c27f90 2024-02-05T07:50:10.285 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c280c0 2024-02-05T07:50:10.285 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c28210 2024-02-05T07:50:10.285 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c28470 2024-02-05T07:50:10.285 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c28a20 2024-02-05T07:50:10.285 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c285d0 2024-02-05T07:50:10.285 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c28730 2024-02-05T07:50:10.286 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c288d0 2024-02-05T07:50:10.286 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c28b70 2024-02-05T07:50:10.286 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c29000 2024-02-05T07:50:10.286 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c29110 2024-02-05T07:50:10.286 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c23480 2024-02-05T07:50:10.286 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c23590 2024-02-05T07:50:10.286 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c236a0 2024-02-05T07:50:10.286 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c29240 2024-02-05T07:50:10.286 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c29350 2024-02-05T07:50:10.286 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c29460 2024-02-05T07:50:10.286 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c29570 2024-02-05T07:50:10.286 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c29be0 2024-02-05T07:50:10.286 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c29740 2024-02-05T07:50:10.286 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c29850 2024-02-05T07:50:10.286 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c29960 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c29ab0 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2a190 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c29cf0 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c29e00 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c29f30 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2a060 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2a760 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2a2c0 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2a3d0 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2a4e0 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2a5f0 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2ad50 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2a8b0 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2a9e0 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2ab10 2024-02-05T07:50:10.287 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2ac20 2024-02-05T07:50:10.288 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2b300 2024-02-05T07:50:10.288 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2ae60 2024-02-05T07:50:10.288 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2af70 2024-02-05T07:50:10.288 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2b0a0 2024-02-05T07:50:10.288 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2b1b0 2024-02-05T07:50:10.288 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2b8d0 2024-02-05T07:50:10.288 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2b430 2024-02-05T07:50:10.288 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2b560 2024-02-05T07:50:10.288 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2b670 2024-02-05T07:50:10.288 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2b7a0 2024-02-05T07:50:10.288 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2be80 2024-02-05T07:50:10.288 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2b9e0 2024-02-05T07:50:10.288 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2bb10 2024-02-05T07:50:10.288 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2bc20 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2bd30 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2c450 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2bfb0 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2c0e0 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2c210 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2c340 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2ca20 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2c580 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2c720 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2c850 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2cb70 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2d000 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2d130 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c28c80 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c28db0 2024-02-05T07:50:10.289 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2d700 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2d260 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2d390 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2d4c0 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2d5f0 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2dcd0 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2d830 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2d960 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2da90 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2dbc0 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2e2c0 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2de20 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2df30 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2e080 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2e190 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2e8b0 2024-02-05T07:50:10.290 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2e410 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2e520 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2e630 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2e7a0 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2eea0 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2ea00 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2eb30 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2ec60 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2ed70 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2f450 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2efb0 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2f100 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2f230 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2f340 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2fa40 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2f5a0 2024-02-05T07:50:10.291 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2f6d0 2024-02-05T07:50:10.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2f7e0 2024-02-05T07:50:10.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2f910 2024-02-05T07:50:10.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2fff0 2024-02-05T07:50:10.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2fb50 2024-02-05T07:50:10.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2fc60 2024-02-05T07:50:10.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2fd90 2024-02-05T07:50:10.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2fea0 2024-02-05T07:50:10.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c305c0 2024-02-05T07:50:10.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c30120 2024-02-05T07:50:10.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c30250 2024-02-05T07:50:10.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c30360 2024-02-05T07:50:10.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c30470 2024-02-05T07:50:10.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c30bb0 2024-02-05T07:50:10.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c30710 2024-02-05T07:50:10.292 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c30820 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c30950 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c30a60 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c311a0 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c30d00 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c30e10 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c30f60 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c31070 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c31750 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c312b0 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c313c0 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c31510 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c31620 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c31d40 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c318a0 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c319b0 2024-02-05T07:50:10.293 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c31ac0 2024-02-05T07:50:10.294 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c31bd0 2024-02-05T07:50:10.294 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c32310 2024-02-05T07:50:10.294 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c31e70 2024-02-05T07:50:10.294 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c31fa0 2024-02-05T07:50:10.294 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c320b0 2024-02-05T07:50:10.294 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c321c0 2024-02-05T07:50:10.294 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c328e0 2024-02-05T07:50:10.294 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c32440 2024-02-05T07:50:10.294 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c32550 2024-02-05T07:50:10.294 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c326a0 2024-02-05T07:50:10.294 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c327b0 2024-02-05T07:50:10.294 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c32eb0 2024-02-05T07:50:10.294 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c32a10 2024-02-05T07:50:10.294 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c32b60 2024-02-05T07:50:10.294 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c32c70 2024-02-05T07:50:10.295 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c32da0 2024-02-05T07:50:10.295 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c33460 2024-02-05T07:50:10.295 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c32fc0 2024-02-05T07:50:10.295 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c330d0 2024-02-05T07:50:10.295 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c33200 2024-02-05T07:50:10.295 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c33310 2024-02-05T07:50:10.295 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c33a50 2024-02-05T07:50:10.295 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c335b0 2024-02-05T07:50:10.295 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c336c0 2024-02-05T07:50:10.295 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c337f0 2024-02-05T07:50:10.295 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c33920 2024-02-05T07:50:10.295 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c34020 2024-02-05T07:50:10.295 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c33b80 2024-02-05T07:50:10.295 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c33c90 2024-02-05T07:50:10.295 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c33dc0 2024-02-05T07:50:10.296 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c33ed0 2024-02-05T07:50:10.296 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c34610 2024-02-05T07:50:10.296 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c34170 2024-02-05T07:50:10.296 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c342a0 2024-02-05T07:50:10.296 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c343b0 2024-02-05T07:50:10.296 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c344e0 2024-02-05T07:50:10.296 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c34bc0 2024-02-05T07:50:10.296 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c34720 2024-02-05T07:50:10.296 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c34850 2024-02-05T07:50:10.296 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c34980 2024-02-05T07:50:10.296 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c34cf0 2024-02-05T07:50:10.296 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c34e40 2024-02-05T07:50:10.296 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c35430 2024-02-05T07:50:10.296 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c34f90 2024-02-05T07:50:10.297 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c350e0 2024-02-05T07:50:10.297 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c351f0 2024-02-05T07:50:10.297 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c35320 2024-02-05T07:50:10.297 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c359e0 2024-02-05T07:50:10.297 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c35540 2024-02-05T07:50:10.297 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c35690 2024-02-05T07:50:10.297 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c357c0 2024-02-05T07:50:10.297 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c35af0 2024-02-05T07:50:10.297 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c35fa0 2024-02-05T07:50:10.297 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c360b0 2024-02-05T07:50:10.297 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2cca0 2024-02-05T07:50:10.297 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2cdd0 2024-02-05T07:50:10.297 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c36680 2024-02-05T07:50:10.297 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c361e0 2024-02-05T07:50:10.297 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c36310 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c36440 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c36570 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c36c50 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c367b0 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c368e0 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c36a30 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c36b40 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c37220 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c36d80 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c36ed0 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c37020 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c37330 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c377c0 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c37910 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c35c40 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c35d50 2024-02-05T07:50:10.298 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c35e80 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c37a60 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c37ef0 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c38020 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c37460 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c37590 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c385f0 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c38150 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c382a0 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c2cee0 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c383d0 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c38bc0 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c38720 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c38830 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c376a0 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c38980 2024-02-05T07:50:10.299 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c38ab0 2024-02-05T07:50:10.300 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c38d10 2024-02-05T07:50:10.300 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c391c0 2024-02-05T07:50:10.300 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c39310 2024-02-05T07:50:10.300 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c37b70 2024-02-05T07:50:10.300 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c37ca0 2024-02-05T07:50:10.300 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c39900 2024-02-05T07:50:10.300 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c39460 2024-02-05T07:50:10.300 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c39590 2024-02-05T07:50:10.300 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c396c0 2024-02-05T07:50:10.300 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c397f0 2024-02-05T07:50:10.300 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c39ed0 2024-02-05T07:50:10.300 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c39a30 2024-02-05T07:50:10.300 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c39b60 2024-02-05T07:50:10.300 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c39c90 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c39dc0 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3a4a0 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3a000 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3a130 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3a280 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3a5d0 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3aa60 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3ab90 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c38e60 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c38f90 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3b160 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3acc0 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3adf0 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3af20 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3b050 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3b750 2024-02-05T07:50:10.301 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3b2b0 2024-02-05T07:50:10.302 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3b3e0 2024-02-05T07:50:10.302 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3b530 2024-02-05T07:50:10.302 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3b880 2024-02-05T07:50:10.302 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3bd10 2024-02-05T07:50:10.302 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3be40 2024-02-05T07:50:10.302 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3b640 2024-02-05T07:50:10.302 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3bf70 2024-02-05T07:50:10.302 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3c0c0 2024-02-05T07:50:10.302 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3c6b0 2024-02-05T07:50:10.302 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3a700 2024-02-05T07:50:10.302 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3a830 2024-02-05T07:50:10.302 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3c210 2024-02-05T07:50:10.302 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3c340 2024-02-05T07:50:10.302 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3c470 2024-02-05T07:50:10.302 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3c5a0 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3cc80 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3c7e0 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3c930 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3ca60 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3cdb0 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3d240 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3d370 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3b9b0 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3bae0 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3d940 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3d4a0 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3d5d0 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3d700 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3d830 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3df10 2024-02-05T07:50:10.303 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3da70 2024-02-05T07:50:10.304 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3dba0 2024-02-05T07:50:10.304 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3dcd0 2024-02-05T07:50:10.304 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3de00 2024-02-05T07:50:10.304 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3e4e0 2024-02-05T07:50:10.304 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3e040 2024-02-05T07:50:10.304 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3e190 2024-02-05T07:50:10.304 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3e2c0 2024-02-05T07:50:10.304 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3e610 2024-02-05T07:50:10.304 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3eaa0 2024-02-05T07:50:10.304 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3ebd0 2024-02-05T07:50:10.304 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3e3d0 2024-02-05T07:50:10.304 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3ed00 2024-02-05T07:50:10.304 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3cee0 2024-02-05T07:50:10.304 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3cb70 2024-02-05T07:50:10.304 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3cff0 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3d120 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3ee30 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3ef60 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3f550 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3f0b0 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3f1e0 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3f310 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3f440 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3fb00 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3f660 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3f7b0 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3f8e0 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3fc30 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c400c0 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c401f0 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3e740 2024-02-05T07:50:10.305 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3e870 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c407c0 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c40320 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c40470 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c405a0 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c40910 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c40df0 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c40f70 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3fd60 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c3fe90 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c41540 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c410a0 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c411d0 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c41300 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c41430 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c41b10 2024-02-05T07:50:10.306 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c41670 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c417c0 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c418f0 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c41c40 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c420d0 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c42200 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c40a40 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c40b70 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c427d0 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c42330 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c42460 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c42590 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c42900 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c42e00 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c42f30 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c426c0 2024-02-05T07:50:10.307 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c42a50 2024-02-05T07:50:10.308 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c42b80 2024-02-05T07:50:10.308 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c43060 2024-02-05T07:50:10.308 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c434f0 2024-02-05T07:50:10.308 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c43620 2024-02-05T07:50:10.308 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c41d70 2024-02-05T07:50:10.308 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c41ea0 2024-02-05T07:50:10.308 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c43bf0 2024-02-05T07:50:10.308 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c43750 2024-02-05T07:50:10.308 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c43880 2024-02-05T07:50:10.308 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c41fb0 2024-02-05T07:50:10.308 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c439b0 2024-02-05T07:50:10.308 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c43ae0 2024-02-05T07:50:10.308 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c42cd0 2024-02-05T07:50:10.308 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c441c0 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c43d20 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c43e70 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c43fc0 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c442f0 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c44780 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c448b0 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c43190 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c432c0 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c44e80 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c449e0 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c44b10 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c44c40 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c44d70 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c45450 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c44fb0 2024-02-05T07:50:10.309 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c450e0 2024-02-05T07:50:10.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:10 smithi188 ceph-mon[33283]: osdmap e756: 8 total, 8 up, 8 in 2024-02-05T07:50:10.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:10 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:50:11.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:10 smithi184 ceph-mon[29861]: osdmap e756: 8 total, 8 up, 8 in 2024-02-05T07:50:11.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:10 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:50:11.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:10 smithi184 ceph-mon[41609]: osdmap e756: 8 total, 8 up, 8 in 2024-02-05T07:50:11.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:10 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:50:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:11 smithi188 ceph-mon[33283]: osdmap e757: 8 total, 8 up, 8 in 2024-02-05T07:50:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:11 smithi188 ceph-mon[33283]: pgmap v1656: 228 pgs: 32 unknown, 196 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:11 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:50:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:11 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:50:11.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:11 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:50:12.020 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:50:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:50:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:50:12.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:11 smithi184 ceph-mon[29861]: osdmap e757: 8 total, 8 up, 8 in 2024-02-05T07:50:12.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:11 smithi184 ceph-mon[29861]: pgmap v1656: 228 pgs: 32 unknown, 196 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:12.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:11 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:50:12.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:11 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:50:12.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:11 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:50:12.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:11 smithi184 ceph-mon[41609]: osdmap e757: 8 total, 8 up, 8 in 2024-02-05T07:50:12.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:11 smithi184 ceph-mon[41609]: pgmap v1656: 228 pgs: 32 unknown, 196 active+clean; 582 KiB data, 768 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:12.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:11 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:50:12.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:11 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:50:12.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:11 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:50:12.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:12 smithi188 ceph-mon[33283]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:12.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:12 smithi188 ceph-mon[33283]: osdmap e758: 8 total, 8 up, 8 in 2024-02-05T07:50:13.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:12 smithi184 ceph-mon[29861]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:13.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:12 smithi184 ceph-mon[29861]: osdmap e758: 8 total, 8 up, 8 in 2024-02-05T07:50:13.020 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:12 smithi184 ceph-mon[41609]: Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:13.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:12 smithi184 ceph-mon[41609]: osdmap e758: 8 total, 8 up, 8 in 2024-02-05T07:50:13.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:13 smithi188 ceph-mon[33283]: osdmap e759: 8 total, 8 up, 8 in 2024-02-05T07:50:13.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:13 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:13.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:13 smithi188 ceph-mon[33283]: from='client.36335 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:13.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:13 smithi188 ceph-mon[33283]: pgmap v1659: 228 pgs: 32 unknown, 196 active+clean; 582 KiB data, 767 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:14.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:13 smithi184 ceph-mon[29861]: osdmap e759: 8 total, 8 up, 8 in 2024-02-05T07:50:14.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:13 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:14.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:13 smithi184 ceph-mon[29861]: from='client.36335 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:14.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:13 smithi184 ceph-mon[29861]: pgmap v1659: 228 pgs: 32 unknown, 196 active+clean; 582 KiB data, 767 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:14.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:13 smithi184 ceph-mon[41609]: osdmap e759: 8 total, 8 up, 8 in 2024-02-05T07:50:14.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:13 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:14.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:13 smithi184 ceph-mon[41609]: from='client.36335 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:14.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:13 smithi184 ceph-mon[41609]: pgmap v1659: 228 pgs: 32 unknown, 196 active+clean; 582 KiB data, 767 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:14 smithi188 ceph-mon[33283]: from='client.36335 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:50:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:14 smithi188 ceph-mon[33283]: osdmap e760: 8 total, 8 up, 8 in 2024-02-05T07:50:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-02-05T07:50:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:14 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:14 smithi188 ceph-mon[33283]: from='client.36335 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:15.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:14 smithi184 ceph-mon[29861]: from='client.36335 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:50:15.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:14 smithi184 ceph-mon[29861]: osdmap e760: 8 total, 8 up, 8 in 2024-02-05T07:50:15.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-02-05T07:50:15.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:14 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:15.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:14 smithi184 ceph-mon[29861]: from='client.36335 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:15.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:14 smithi184 ceph-mon[41609]: from='client.36335 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-05T07:50:15.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:14 smithi184 ceph-mon[41609]: osdmap e760: 8 total, 8 up, 8 in 2024-02-05T07:50:15.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-02-05T07:50:15.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:14 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:15.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:14 smithi184 ceph-mon[41609]: from='client.36335 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:15 smithi188 ceph-mon[33283]: from='client.36335 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-05T07:50:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:15 smithi188 ceph-mon[33283]: osdmap e761: 8 total, 8 up, 8 in 2024-02-05T07:50:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app2"}]: dispatch 2024-02-05T07:50:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:15 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:15 smithi188 ceph-mon[33283]: from='client.36335 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:15.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:15 smithi188 ceph-mon[33283]: pgmap v1662: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 767 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:15.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:50:16.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:15 smithi184 ceph-mon[29861]: from='client.36335 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-05T07:50:16.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:15 smithi184 ceph-mon[29861]: osdmap e761: 8 total, 8 up, 8 in 2024-02-05T07:50:16.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app2"}]: dispatch 2024-02-05T07:50:16.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:15 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:16.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:15 smithi184 ceph-mon[29861]: from='client.36335 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:16.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:15 smithi184 ceph-mon[29861]: pgmap v1662: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 767 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:16.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:50:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:15 smithi184 ceph-mon[41609]: from='client.36335 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-05T07:50:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:15 smithi184 ceph-mon[41609]: osdmap e761: 8 total, 8 up, 8 in 2024-02-05T07:50:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app2"}]: dispatch 2024-02-05T07:50:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:15 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:15 smithi184 ceph-mon[41609]: from='client.36335 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-05T07:50:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:15 smithi184 ceph-mon[41609]: pgmap v1662: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 767 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:16.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:50:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:16 smithi188 ceph-mon[33283]: from='client.36335 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-05T07:50:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:16 smithi188 ceph-mon[33283]: osdmap e762: 8 total, 8 up, 8 in 2024-02-05T07:50:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-02-05T07:50:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-05T07:50:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:16 smithi188 ceph-mon[33283]: from='client.36335 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-05T07:50:17.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:16 smithi184 ceph-mon[29861]: from='client.36335 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-05T07:50:17.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:16 smithi184 ceph-mon[29861]: osdmap e762: 8 total, 8 up, 8 in 2024-02-05T07:50:17.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-02-05T07:50:17.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-05T07:50:17.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:16 smithi184 ceph-mon[29861]: from='client.36335 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-05T07:50:17.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:16 smithi184 ceph-mon[41609]: from='client.36335 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi184-81352-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-05T07:50:17.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:16 smithi184 ceph-mon[41609]: osdmap e762: 8 total, 8 up, 8 in 2024-02-05T07:50:17.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-02-05T07:50:17.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-05T07:50:17.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:16 smithi184 ceph-mon[41609]: from='client.36335 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-05T07:50:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:17 smithi188 ceph-mon[33283]: from='client.36335 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-05T07:50:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:17 smithi188 ceph-mon[33283]: osdmap e763: 8 total, 8 up, 8 in 2024-02-05T07:50:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-05T07:50:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:17 smithi188 ceph-mon[33283]: from='client.36335 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-05T07:50:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:17 smithi188 ceph-mon[33283]: pgmap v1665: 228 pgs: 64 unknown, 164 active+clean; 582 KiB data, 767 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:50:18.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:17 smithi184 ceph-mon[29861]: from='client.36335 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-05T07:50:18.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:17 smithi184 ceph-mon[29861]: osdmap e763: 8 total, 8 up, 8 in 2024-02-05T07:50:18.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-05T07:50:18.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:17 smithi184 ceph-mon[29861]: from='client.36335 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-05T07:50:18.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:17 smithi184 ceph-mon[29861]: pgmap v1665: 228 pgs: 64 unknown, 164 active+clean; 582 KiB data, 767 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:50:18.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:17 smithi184 ceph-mon[41609]: from='client.36335 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-05T07:50:18.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:17 smithi184 ceph-mon[41609]: osdmap e763: 8 total, 8 up, 8 in 2024-02-05T07:50:18.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-05T07:50:18.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:17 smithi184 ceph-mon[41609]: from='client.36335 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-05T07:50:18.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:17 smithi184 ceph-mon[41609]: pgmap v1665: 228 pgs: 64 unknown, 164 active+clean; 582 KiB data, 767 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:50:18.763 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c45210 2024-02-05T07:50:18.763 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c45340 2024-02-05T07:50:18.764 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c45a20 2024-02-05T07:50:18.764 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c45580 2024-02-05T07:50:18.764 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c456d0 2024-02-05T07:50:18.764 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c45800 2024-02-05T07:50:18.764 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c45b50 2024-02-05T07:50:18.764 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c46030 2024-02-05T07:50:18.764 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c46160 2024-02-05T07:50:18.764 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c44420 2024-02-05T07:50:18.764 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c44550 2024-02-05T07:50:18.764 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c46730 2024-02-05T07:50:18.764 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c46290 2024-02-05T07:50:18.764 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c463c0 2024-02-05T07:50:18.764 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c44660 2024-02-05T07:50:18.764 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c464f0 2024-02-05T07:50:18.764 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c46600 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c46860 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c46d10 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c471a0 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c472f0 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c469b0 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c46ae0 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c45c80 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c45dd0 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c45f20 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c47440 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c478d0 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c47a00 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c47ff0 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c47570 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c46bf0 2024-02-05T07:50:18.765 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c40ca0 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c476a0 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c47b50 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c47ca0 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c47df0 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c48100 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c48590 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c486c0 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c48c90 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c48230 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c48360 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c487f0 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c48920 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c48a50 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c48b60 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c49280 2024-02-05T07:50:18.766 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c48de0 2024-02-05T07:50:18.767 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c48f10 2024-02-05T07:50:18.767 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c49060 2024-02-05T07:50:18.767 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c493b0 2024-02-05T07:50:18.767 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c49840 2024-02-05T07:50:18.767 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c49970 2024-02-05T07:50:18.767 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c49170 2024-02-05T07:50:18.767 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c49aa0 2024-02-05T07:50:18.767 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c49bf0 2024-02-05T07:50:18.767 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c494e0 2024-02-05T07:50:18.767 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c49610 2024-02-05T07:50:18.767 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c4a1e0 2024-02-05T07:50:18.767 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c49d40 2024-02-05T07:50:18.767 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c49e70 2024-02-05T07:50:18.767 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c49fa0 2024-02-05T07:50:18.767 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c4a0d0 2024-02-05T07:50:18.768 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: waiting 0x560254c4a7b0 2024-02-05T07:50:18.768 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: done. 2024-02-05T07:50:18.768 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (1810918 ms) 2024-02-05T07:50:18.768 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (1810918 ms total) 2024-02-05T07:50:18.768 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: 2024-02-05T07:50:18.768 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-02-05T07:50:18.768 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-02-05T07:50:18.768 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-02-05T07:50:18.768 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-02-05T07:50:18.768 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ OK ] LibRadosMisc.Exec (24 ms) 2024-02-05T07:50:18.768 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-02-05T07:50:18.768 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (4 ms) 2024-02-05T07:50:18.768 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-02-05T07:50:18.768 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (3 ms) 2024-02-05T07:50:18.768 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-02-05T07:50:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:18 smithi188 ceph-mon[33283]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:18 smithi188 ceph-mon[33283]: from='client.36335 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-05T07:50:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:18 smithi188 ceph-mon[33283]: osdmap e764: 8 total, 8 up, 8 in 2024-02-05T07:50:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1"}]: dispatch 2024-02-05T07:50:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:18 smithi188 ceph-mon[33283]: from='client.36335 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1"}]: dispatch 2024-02-05T07:50:19.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:18 smithi184 ceph-mon[29861]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:19.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:18 smithi184 ceph-mon[29861]: from='client.36335 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-05T07:50:19.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:18 smithi184 ceph-mon[29861]: osdmap e764: 8 total, 8 up, 8 in 2024-02-05T07:50:19.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1"}]: dispatch 2024-02-05T07:50:19.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:18 smithi184 ceph-mon[29861]: from='client.36335 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1"}]: dispatch 2024-02-05T07:50:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:18 smithi184 ceph-mon[41609]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:18 smithi184 ceph-mon[41609]: from='client.36335 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-05T07:50:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:18 smithi184 ceph-mon[41609]: osdmap e764: 8 total, 8 up, 8 in 2024-02-05T07:50:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1817637727' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1"}]: dispatch 2024-02-05T07:50:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:18 smithi184 ceph-mon[41609]: from='client.36335 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1"}]: dispatch 2024-02-05T07:50:19.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:50:19 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:50:20.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:19 smithi184 ceph-mon[29861]: from='client.36335 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1"}]': finished 2024-02-05T07:50:20.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:19 smithi184 ceph-mon[29861]: pgmap v1667: 228 pgs: 228 active+clean; 583 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-05T07:50:20.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:19 smithi184 ceph-mon[29861]: osdmap e765: 8 total, 8 up, 8 in 2024-02-05T07:50:20.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:19 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:20.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:19 smithi184 ceph-mon[41609]: from='client.36335 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1"}]': finished 2024-02-05T07:50:20.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:19 smithi184 ceph-mon[41609]: pgmap v1667: 228 pgs: 228 active+clean; 583 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-05T07:50:20.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:19 smithi184 ceph-mon[41609]: osdmap e765: 8 total, 8 up, 8 in 2024-02-05T07:50:20.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:19 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:20.247 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:19 smithi188 ceph-mon[33283]: from='client.36335 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi184-81352-1","app":"app1","key":"key1"}]': finished 2024-02-05T07:50:20.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:19 smithi188 ceph-mon[33283]: pgmap v1667: 228 pgs: 228 active+clean; 583 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-05T07:50:20.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:19 smithi188 ceph-mon[33283]: osdmap e765: 8 total, 8 up, 8 in 2024-02-05T07:50:20.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:19 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:21.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:20 smithi184 ceph-mon[29861]: osdmap e766: 8 total, 8 up, 8 in 2024-02-05T07:50:21.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:20 smithi184 ceph-mon[41609]: osdmap e766: 8 total, 8 up, 8 in 2024-02-05T07:50:21.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:20 smithi188 ceph-mon[33283]: osdmap e766: 8 total, 8 up, 8 in 2024-02-05T07:50:22.247 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:21 smithi188 ceph-mon[33283]: pgmap v1670: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:50:22.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:21 smithi188 ceph-mon[33283]: osdmap e767: 8 total, 8 up, 8 in 2024-02-05T07:50:22.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:21 smithi184 ceph-mon[29861]: pgmap v1670: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:50:22.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:21 smithi184 ceph-mon[29861]: osdmap e767: 8 total, 8 up, 8 in 2024-02-05T07:50:22.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:21 smithi184 ceph-mon[41609]: pgmap v1670: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-05T07:50:22.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:21 smithi184 ceph-mon[41609]: osdmap e767: 8 total, 8 up, 8 in 2024-02-05T07:50:22.273 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:50:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:50:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:50:23.247 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:22 smithi188 ceph-mon[33283]: osdmap e768: 8 total, 8 up, 8 in 2024-02-05T07:50:23.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:22 smithi188 ceph-mon[33283]: osdmap e769: 8 total, 8 up, 8 in 2024-02-05T07:50:23.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:22 smithi184 ceph-mon[29861]: osdmap e768: 8 total, 8 up, 8 in 2024-02-05T07:50:23.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:22 smithi184 ceph-mon[29861]: osdmap e769: 8 total, 8 up, 8 in 2024-02-05T07:50:23.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:22 smithi184 ceph-mon[41609]: osdmap e768: 8 total, 8 up, 8 in 2024-02-05T07:50:23.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:22 smithi184 ceph-mon[41609]: osdmap e769: 8 total, 8 up, 8 in 2024-02-05T07:50:24.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:24 smithi188 ceph-mon[33283]: pgmap v1673: 228 pgs: 228 active+clean; 583 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:24.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:24 smithi188 ceph-mon[33283]: osdmap e770: 8 total, 8 up, 8 in 2024-02-05T07:50:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:24 smithi184 ceph-mon[29861]: pgmap v1673: 228 pgs: 228 active+clean; 583 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:24.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:24 smithi184 ceph-mon[29861]: osdmap e770: 8 total, 8 up, 8 in 2024-02-05T07:50:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:24 smithi184 ceph-mon[41609]: pgmap v1673: 228 pgs: 228 active+clean; 583 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:24.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:24 smithi184 ceph-mon[41609]: osdmap e770: 8 total, 8 up, 8 in 2024-02-05T07:50:26.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:25 smithi188 ceph-mon[33283]: pgmap v1676: 196 pgs: 196 active+clean; 583 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:26.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:25 smithi188 ceph-mon[33283]: osdmap e771: 8 total, 8 up, 8 in 2024-02-05T07:50:26.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:25 smithi188 ceph-mon[33283]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:26.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:25 smithi184 ceph-mon[29861]: pgmap v1676: 196 pgs: 196 active+clean; 583 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:26.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:25 smithi184 ceph-mon[29861]: osdmap e771: 8 total, 8 up, 8 in 2024-02-05T07:50:26.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:25 smithi184 ceph-mon[29861]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:26.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:25 smithi184 ceph-mon[41609]: pgmap v1676: 196 pgs: 196 active+clean; 583 KiB data, 807 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:26.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:25 smithi184 ceph-mon[41609]: osdmap e771: 8 total, 8 up, 8 in 2024-02-05T07:50:26.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:25 smithi184 ceph-mon[41609]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:27.247 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:26 smithi188 ceph-mon[33283]: osdmap e772: 8 total, 8 up, 8 in 2024-02-05T07:50:27.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:26 smithi184 ceph-mon[41609]: osdmap e772: 8 total, 8 up, 8 in 2024-02-05T07:50:27.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:26 smithi184 ceph-mon[29861]: osdmap e772: 8 total, 8 up, 8 in 2024-02-05T07:50:28.149 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:27 smithi188 ceph-mon[33283]: pgmap v1679: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 807 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:50:28.149 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:27 smithi188 ceph-mon[33283]: osdmap e773: 8 total, 8 up, 8 in 2024-02-05T07:50:28.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:27 smithi184 ceph-mon[41609]: pgmap v1679: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 807 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:50:28.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:27 smithi184 ceph-mon[41609]: osdmap e773: 8 total, 8 up, 8 in 2024-02-05T07:50:28.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:27 smithi184 ceph-mon[29861]: pgmap v1679: 228 pgs: 32 unknown, 196 active+clean; 583 KiB data, 807 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:50:28.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:27 smithi184 ceph-mon[29861]: osdmap e773: 8 total, 8 up, 8 in 2024-02-05T07:50:29.139 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:28 smithi188 ceph-mon[33283]: osdmap e774: 8 total, 8 up, 8 in 2024-02-05T07:50:29.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:28 smithi184 ceph-mon[29861]: osdmap e774: 8 total, 8 up, 8 in 2024-02-05T07:50:29.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:28 smithi184 ceph-mon[41609]: osdmap e774: 8 total, 8 up, 8 in 2024-02-05T07:50:29.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:50:29 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:50:30.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:29 smithi188 ceph-mon[33283]: pgmap v1682: 228 pgs: 228 active+clean; 583 KiB data, 803 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:50:30.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:29 smithi188 ceph-mon[33283]: osdmap e775: 8 total, 8 up, 8 in 2024-02-05T07:50:30.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:29 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:30.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:29 smithi184 ceph-mon[29861]: pgmap v1682: 228 pgs: 228 active+clean; 583 KiB data, 803 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:50:30.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:29 smithi184 ceph-mon[29861]: osdmap e775: 8 total, 8 up, 8 in 2024-02-05T07:50:30.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:29 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:30.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:29 smithi184 ceph-mon[41609]: pgmap v1682: 228 pgs: 228 active+clean; 583 KiB data, 803 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:50:30.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:29 smithi184 ceph-mon[41609]: osdmap e775: 8 total, 8 up, 8 in 2024-02-05T07:50:30.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:29 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:31.247 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:30 smithi188 ceph-mon[33283]: osdmap e776: 8 total, 8 up, 8 in 2024-02-05T07:50:31.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:50:31.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:30 smithi184 ceph-mon[29861]: osdmap e776: 8 total, 8 up, 8 in 2024-02-05T07:50:31.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:50:31.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:30 smithi184 ceph-mon[41609]: osdmap e776: 8 total, 8 up, 8 in 2024-02-05T07:50:31.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:50:32.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:31 smithi188 ceph-mon[33283]: pgmap v1685: 228 pgs: 228 active+clean; 583 KiB data, 803 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:50:32.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:31 smithi188 ceph-mon[33283]: osdmap e777: 8 total, 8 up, 8 in 2024-02-05T07:50:32.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:31 smithi184 ceph-mon[29861]: pgmap v1685: 228 pgs: 228 active+clean; 583 KiB data, 803 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:50:32.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:31 smithi184 ceph-mon[29861]: osdmap e777: 8 total, 8 up, 8 in 2024-02-05T07:50:32.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:31 smithi184 ceph-mon[41609]: pgmap v1685: 228 pgs: 228 active+clean; 583 KiB data, 803 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:50:32.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:31 smithi184 ceph-mon[41609]: osdmap e777: 8 total, 8 up, 8 in 2024-02-05T07:50:32.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:50:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:50:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:50:33.247 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:32 smithi188 ceph-mon[33283]: osdmap e778: 8 total, 8 up, 8 in 2024-02-05T07:50:33.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:32 smithi184 ceph-mon[29861]: osdmap e778: 8 total, 8 up, 8 in 2024-02-05T07:50:33.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:32 smithi184 ceph-mon[41609]: osdmap e778: 8 total, 8 up, 8 in 2024-02-05T07:50:34.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:33 smithi188 ceph-mon[33283]: pgmap v1688: 228 pgs: 32 creating+peering, 196 active+clean; 583 KiB data, 802 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:34.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:33 smithi188 ceph-mon[33283]: osdmap e779: 8 total, 8 up, 8 in 2024-02-05T07:50:34.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:33 smithi188 ceph-mon[33283]: osdmap e780: 8 total, 8 up, 8 in 2024-02-05T07:50:34.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:33 smithi184 ceph-mon[29861]: pgmap v1688: 228 pgs: 32 creating+peering, 196 active+clean; 583 KiB data, 802 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:34.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:33 smithi184 ceph-mon[29861]: osdmap e779: 8 total, 8 up, 8 in 2024-02-05T07:50:34.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:33 smithi184 ceph-mon[29861]: osdmap e780: 8 total, 8 up, 8 in 2024-02-05T07:50:34.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:33 smithi184 ceph-mon[41609]: pgmap v1688: 228 pgs: 32 creating+peering, 196 active+clean; 583 KiB data, 802 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:34.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:33 smithi184 ceph-mon[41609]: osdmap e779: 8 total, 8 up, 8 in 2024-02-05T07:50:34.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:33 smithi184 ceph-mon[41609]: osdmap e780: 8 total, 8 up, 8 in 2024-02-05T07:50:36.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:35 smithi188 ceph-mon[33283]: pgmap v1691: 228 pgs: 32 creating+peering, 196 active+clean; 583 KiB data, 802 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:36.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:35 smithi188 ceph-mon[33283]: osdmap e781: 8 total, 8 up, 8 in 2024-02-05T07:50:36.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:35 smithi188 ceph-mon[33283]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:36.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:35 smithi184 ceph-mon[29861]: pgmap v1691: 228 pgs: 32 creating+peering, 196 active+clean; 583 KiB data, 802 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:36.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:35 smithi184 ceph-mon[29861]: osdmap e781: 8 total, 8 up, 8 in 2024-02-05T07:50:36.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:35 smithi184 ceph-mon[29861]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:36.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:35 smithi184 ceph-mon[41609]: pgmap v1691: 228 pgs: 32 creating+peering, 196 active+clean; 583 KiB data, 802 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:36.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:35 smithi184 ceph-mon[41609]: osdmap e781: 8 total, 8 up, 8 in 2024-02-05T07:50:36.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:35 smithi184 ceph-mon[41609]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:37.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:36 smithi188 ceph-mon[33283]: osdmap e782: 8 total, 8 up, 8 in 2024-02-05T07:50:37.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:36 smithi184 ceph-mon[29861]: osdmap e782: 8 total, 8 up, 8 in 2024-02-05T07:50:37.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:36 smithi184 ceph-mon[41609]: osdmap e782: 8 total, 8 up, 8 in 2024-02-05T07:50:37.922 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ OK ] LibRadosMisc.Applications (5006 ms) 2024-02-05T07:50:37.922 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-02-05T07:50:37.922 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (0 ms) 2024-02-05T07:50:37.922 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-02-05T07:50:37.922 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-02-05T07:50:37.922 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-02-05T07:50:37.922 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (18319 ms) 2024-02-05T07:50:37.922 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [----------] 8 tests from LibRadosMisc (23356 ms total) 2024-02-05T07:50:37.922 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: 2024-02-05T07:50:37.922 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [----------] Global test environment tear-down 2024-02-05T07:50:37.922 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (1839180 ms total) 2024-02-05T07:50:37.923 INFO:tasks.workunit.client.0.smithi184.stdout: api_misc: [ PASSED ] 12 tests. 2024-02-05T07:50:37.923 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.923 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81591 2024-02-05T07:50:37.923 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81591 2024-02-05T07:50:37.923 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.923 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82075 2024-02-05T07:50:37.923 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 82075 2024-02-05T07:50:37.924 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.924 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82160 2024-02-05T07:50:37.924 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 82160 2024-02-05T07:50:37.924 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.924 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81293 2024-02-05T07:50:37.924 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81293 2024-02-05T07:50:37.924 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.924 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81938 2024-02-05T07:50:37.924 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81938 2024-02-05T07:50:37.924 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.924 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81860 2024-02-05T07:50:37.924 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81860 2024-02-05T07:50:37.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81160 2024-02-05T07:50:37.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81160 2024-02-05T07:50:37.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81225 2024-02-05T07:50:37.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81225 2024-02-05T07:50:37.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81877 2024-02-05T07:50:37.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81877 2024-02-05T07:50:37.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81151 2024-02-05T07:50:37.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81151 2024-02-05T07:50:37.925 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81173 2024-02-05T07:50:37.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81173 2024-02-05T07:50:37.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82237 2024-02-05T07:50:37.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 82237 2024-02-05T07:50:37.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81481 2024-02-05T07:50:37.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81481 2024-02-05T07:50:37.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82362 2024-02-05T07:50:37.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 82362 2024-02-05T07:50:37.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81548 2024-02-05T07:50:37.926 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81548 2024-02-05T07:50:37.927 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.927 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82023 2024-02-05T07:50:37.927 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 82023 2024-02-05T07:50:37.927 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.927 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82495 2024-02-05T07:50:37.927 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 82495 2024-02-05T07:50:37.927 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.927 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81500 2024-02-05T07:50:37.927 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81500 2024-02-05T07:50:37.927 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.927 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81897 2024-02-05T07:50:37.927 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81897 2024-02-05T07:50:37.927 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.927 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82203 2024-02-05T07:50:37.927 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 82203 2024-02-05T07:50:37.928 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.928 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81989 2024-02-05T07:50:37.928 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81989 2024-02-05T07:50:37.928 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.928 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82332 2024-02-05T07:50:37.928 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 82332 2024-02-05T07:50:37.928 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.928 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81813 2024-02-05T07:50:37.928 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81813 2024-02-05T07:50:37.928 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.929 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81420 2024-02-05T07:50:37.929 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81420 2024-02-05T07:50:37.929 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:50:37.929 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82422 2024-02-05T07:50:37.929 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 82422 2024-02-05T07:50:38.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:37 smithi188 ceph-mon[33283]: pgmap v1694: 196 pgs: 196 active+clean; 583 KiB data, 802 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:50:38.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:37 smithi188 ceph-mon[33283]: osdmap e783: 8 total, 8 up, 8 in 2024-02-05T07:50:38.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:37 smithi184 ceph-mon[29861]: pgmap v1694: 196 pgs: 196 active+clean; 583 KiB data, 802 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:50:38.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:37 smithi184 ceph-mon[29861]: osdmap e783: 8 total, 8 up, 8 in 2024-02-05T07:50:38.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:37 smithi184 ceph-mon[41609]: pgmap v1694: 196 pgs: 196 active+clean; 583 KiB data, 802 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:50:38.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:37 smithi184 ceph-mon[41609]: osdmap e783: 8 total, 8 up, 8 in 2024-02-05T07:50:39.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:38 smithi188 ceph-mon[33283]: osdmap e784: 8 total, 8 up, 8 in 2024-02-05T07:50:39.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:50:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:50:39.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:38 smithi184 ceph-mon[29861]: osdmap e784: 8 total, 8 up, 8 in 2024-02-05T07:50:39.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:38 smithi184 ceph-mon[41609]: osdmap e784: 8 total, 8 up, 8 in 2024-02-05T07:50:40.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:39 smithi188 ceph-mon[33283]: pgmap v1697: 196 pgs: 32 creating+peering, 164 active+clean; 582 KiB data, 838 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:50:40.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:39 smithi188 ceph-mon[33283]: osdmap e785: 8 total, 8 up, 8 in 2024-02-05T07:50:40.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:39 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:40.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:39 smithi184 ceph-mon[29861]: pgmap v1697: 196 pgs: 32 creating+peering, 164 active+clean; 582 KiB data, 838 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:50:40.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:39 smithi184 ceph-mon[29861]: osdmap e785: 8 total, 8 up, 8 in 2024-02-05T07:50:40.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:39 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:40.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:39 smithi184 ceph-mon[41609]: pgmap v1697: 196 pgs: 32 creating+peering, 164 active+clean; 582 KiB data, 838 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:50:40.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:39 smithi184 ceph-mon[41609]: osdmap e785: 8 total, 8 up, 8 in 2024-02-05T07:50:40.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:39 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:41.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:40 smithi188 ceph-mon[33283]: osdmap e786: 8 total, 8 up, 8 in 2024-02-05T07:50:41.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:40 smithi188 ceph-mon[33283]: osdmap e787: 8 total, 8 up, 8 in 2024-02-05T07:50:41.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:40 smithi184 ceph-mon[41609]: osdmap e786: 8 total, 8 up, 8 in 2024-02-05T07:50:41.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:40 smithi184 ceph-mon[41609]: osdmap e787: 8 total, 8 up, 8 in 2024-02-05T07:50:41.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:40 smithi184 ceph-mon[29861]: osdmap e786: 8 total, 8 up, 8 in 2024-02-05T07:50:41.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:40 smithi184 ceph-mon[29861]: osdmap e787: 8 total, 8 up, 8 in 2024-02-05T07:50:42.215 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:50:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:50:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:50:42.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:42 smithi188 ceph-mon[33283]: pgmap v1700: 196 pgs: 32 creating+peering, 164 active+clean; 582 KiB data, 838 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:50:42.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:42 smithi188 ceph-mon[33283]: osdmap e788: 8 total, 8 up, 8 in 2024-02-05T07:50:42.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:42 smithi184 ceph-mon[29861]: pgmap v1700: 196 pgs: 32 creating+peering, 164 active+clean; 582 KiB data, 838 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:50:42.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:42 smithi184 ceph-mon[29861]: osdmap e788: 8 total, 8 up, 8 in 2024-02-05T07:50:42.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:42 smithi184 ceph-mon[41609]: pgmap v1700: 196 pgs: 32 creating+peering, 164 active+clean; 582 KiB data, 838 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-05T07:50:42.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:42 smithi184 ceph-mon[41609]: osdmap e788: 8 total, 8 up, 8 in 2024-02-05T07:50:44.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:43 smithi188 ceph-mon[33283]: pgmap v1703: 164 pgs: 164 active+clean; 582 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:44.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:43 smithi188 ceph-mon[33283]: osdmap e789: 8 total, 8 up, 8 in 2024-02-05T07:50:44.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:43 smithi188 ceph-mon[33283]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:44.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:43 smithi184 ceph-mon[29861]: pgmap v1703: 164 pgs: 164 active+clean; 582 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:44.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:43 smithi184 ceph-mon[29861]: osdmap e789: 8 total, 8 up, 8 in 2024-02-05T07:50:44.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:43 smithi184 ceph-mon[29861]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:44.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:43 smithi184 ceph-mon[41609]: pgmap v1703: 164 pgs: 164 active+clean; 582 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:44.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:43 smithi184 ceph-mon[41609]: osdmap e789: 8 total, 8 up, 8 in 2024-02-05T07:50:44.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:43 smithi184 ceph-mon[41609]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:45.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:44 smithi188 ceph-mon[33283]: osdmap e790: 8 total, 8 up, 8 in 2024-02-05T07:50:45.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:44 smithi184 ceph-mon[29861]: osdmap e790: 8 total, 8 up, 8 in 2024-02-05T07:50:45.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:44 smithi184 ceph-mon[41609]: osdmap e790: 8 total, 8 up, 8 in 2024-02-05T07:50:46.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:45 smithi188 ceph-mon[33283]: pgmap v1706: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:46.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:45 smithi188 ceph-mon[33283]: osdmap e791: 8 total, 8 up, 8 in 2024-02-05T07:50:46.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:50:46.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:45 smithi184 ceph-mon[29861]: pgmap v1706: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:46.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:45 smithi184 ceph-mon[29861]: osdmap e791: 8 total, 8 up, 8 in 2024-02-05T07:50:46.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:50:46.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:45 smithi184 ceph-mon[41609]: pgmap v1706: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:46.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:45 smithi184 ceph-mon[41609]: osdmap e791: 8 total, 8 up, 8 in 2024-02-05T07:50:46.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:50:47.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:46 smithi188 ceph-mon[33283]: osdmap e792: 8 total, 8 up, 8 in 2024-02-05T07:50:47.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:46 smithi184 ceph-mon[29861]: osdmap e792: 8 total, 8 up, 8 in 2024-02-05T07:50:47.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:46 smithi184 ceph-mon[41609]: osdmap e792: 8 total, 8 up, 8 in 2024-02-05T07:50:48.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:47 smithi188 ceph-mon[33283]: pgmap v1709: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 860 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:50:48.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:47 smithi188 ceph-mon[33283]: osdmap e793: 8 total, 8 up, 8 in 2024-02-05T07:50:48.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:47 smithi184 ceph-mon[29861]: pgmap v1709: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 860 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:50:48.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:47 smithi184 ceph-mon[29861]: osdmap e793: 8 total, 8 up, 8 in 2024-02-05T07:50:48.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:47 smithi184 ceph-mon[41609]: pgmap v1709: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 860 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:50:48.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:47 smithi184 ceph-mon[41609]: osdmap e793: 8 total, 8 up, 8 in 2024-02-05T07:50:49.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:48 smithi188 ceph-mon[33283]: osdmap e794: 8 total, 8 up, 8 in 2024-02-05T07:50:49.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:50:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:50:49.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:48 smithi184 ceph-mon[29861]: osdmap e794: 8 total, 8 up, 8 in 2024-02-05T07:50:49.270 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:48 smithi184 ceph-mon[41609]: osdmap e794: 8 total, 8 up, 8 in 2024-02-05T07:50:50.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:49 smithi188 ceph-mon[33283]: pgmap v1712: 196 pgs: 196 active+clean; 584 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-02-05T07:50:50.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:49 smithi188 ceph-mon[33283]: osdmap e795: 8 total, 8 up, 8 in 2024-02-05T07:50:50.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:49 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:50.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:49 smithi184 ceph-mon[29861]: pgmap v1712: 196 pgs: 196 active+clean; 584 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-02-05T07:50:50.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:49 smithi184 ceph-mon[29861]: osdmap e795: 8 total, 8 up, 8 in 2024-02-05T07:50:50.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:49 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:50.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:49 smithi184 ceph-mon[41609]: pgmap v1712: 196 pgs: 196 active+clean; 584 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3.5 KiB/s wr, 5 op/s 2024-02-05T07:50:50.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:49 smithi184 ceph-mon[41609]: osdmap e795: 8 total, 8 up, 8 in 2024-02-05T07:50:50.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:49 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:50:51.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:50 smithi188 ceph-mon[33283]: osdmap e796: 8 total, 8 up, 8 in 2024-02-05T07:50:51.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:50 smithi188 ceph-mon[33283]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:51.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:50 smithi184 ceph-mon[29861]: osdmap e796: 8 total, 8 up, 8 in 2024-02-05T07:50:51.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:50 smithi184 ceph-mon[29861]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:51.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:50 smithi184 ceph-mon[41609]: osdmap e796: 8 total, 8 up, 8 in 2024-02-05T07:50:51.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:50 smithi184 ceph-mon[41609]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:52.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:51 smithi188 ceph-mon[33283]: pgmap v1715: 164 pgs: 164 active+clean; 582 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:52.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:51 smithi188 ceph-mon[33283]: osdmap e797: 8 total, 8 up, 8 in 2024-02-05T07:50:52.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:51 smithi184 ceph-mon[29861]: pgmap v1715: 164 pgs: 164 active+clean; 582 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:52.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:51 smithi184 ceph-mon[29861]: osdmap e797: 8 total, 8 up, 8 in 2024-02-05T07:50:52.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:50:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:50:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:50:52.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:51 smithi184 ceph-mon[41609]: pgmap v1715: 164 pgs: 164 active+clean; 582 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:50:52.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:51 smithi184 ceph-mon[41609]: osdmap e797: 8 total, 8 up, 8 in 2024-02-05T07:50:53.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:53 smithi184 ceph-mon[29861]: osdmap e798: 8 total, 8 up, 8 in 2024-02-05T07:50:53.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:53 smithi184 ceph-mon[41609]: osdmap e798: 8 total, 8 up, 8 in 2024-02-05T07:50:53.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:53 smithi188 ceph-mon[33283]: osdmap e798: 8 total, 8 up, 8 in 2024-02-05T07:50:54.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:54 smithi184 ceph-mon[29861]: pgmap v1718: 196 pgs: 196 active+clean; 1.6 MiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-05T07:50:54.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:54 smithi184 ceph-mon[29861]: osdmap e799: 8 total, 8 up, 8 in 2024-02-05T07:50:54.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:54 smithi184 ceph-mon[41609]: pgmap v1718: 196 pgs: 196 active+clean; 1.6 MiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-05T07:50:54.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:54 smithi184 ceph-mon[41609]: osdmap e799: 8 total, 8 up, 8 in 2024-02-05T07:50:54.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:54 smithi188 ceph-mon[33283]: pgmap v1718: 196 pgs: 196 active+clean; 1.6 MiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-05T07:50:54.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:54 smithi188 ceph-mon[33283]: osdmap e799: 8 total, 8 up, 8 in 2024-02-05T07:50:55.270 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:55 smithi184 ceph-mon[29861]: osdmap e800: 8 total, 8 up, 8 in 2024-02-05T07:50:55.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:55 smithi184 ceph-mon[41609]: osdmap e800: 8 total, 8 up, 8 in 2024-02-05T07:50:55.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:55 smithi188 ceph-mon[33283]: osdmap e800: 8 total, 8 up, 8 in 2024-02-05T07:50:56.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:56 smithi188 ceph-mon[33283]: pgmap v1721: 196 pgs: 196 active+clean; 1.6 MiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 256 KiB/s wr, 1 op/s 2024-02-05T07:50:56.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:56 smithi188 ceph-mon[33283]: osdmap e801: 8 total, 8 up, 8 in 2024-02-05T07:50:56.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:56 smithi184 ceph-mon[29861]: pgmap v1721: 196 pgs: 196 active+clean; 1.6 MiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 256 KiB/s wr, 1 op/s 2024-02-05T07:50:56.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:56 smithi184 ceph-mon[29861]: osdmap e801: 8 total, 8 up, 8 in 2024-02-05T07:50:56.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:56 smithi184 ceph-mon[41609]: pgmap v1721: 196 pgs: 196 active+clean; 1.6 MiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 256 KiB/s wr, 1 op/s 2024-02-05T07:50:56.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:56 smithi184 ceph-mon[41609]: osdmap e801: 8 total, 8 up, 8 in 2024-02-05T07:50:57.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:57 smithi188 ceph-mon[33283]: osdmap e802: 8 total, 8 up, 8 in 2024-02-05T07:50:57.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:57 smithi184 ceph-mon[29861]: osdmap e802: 8 total, 8 up, 8 in 2024-02-05T07:50:57.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:57 smithi184 ceph-mon[41609]: osdmap e802: 8 total, 8 up, 8 in 2024-02-05T07:50:58.399 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:58 smithi188 ceph-mon[33283]: pgmap v1724: 164 pgs: 164 active+clean; 582 KiB data, 866 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:50:58.399 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:58 smithi188 ceph-mon[33283]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:58.399 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:58 smithi188 ceph-mon[33283]: osdmap e803: 8 total, 8 up, 8 in 2024-02-05T07:50:58.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:58 smithi184 ceph-mon[29861]: pgmap v1724: 164 pgs: 164 active+clean; 582 KiB data, 866 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:50:58.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:58 smithi184 ceph-mon[29861]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:58.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:58 smithi184 ceph-mon[29861]: osdmap e803: 8 total, 8 up, 8 in 2024-02-05T07:50:58.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:58 smithi184 ceph-mon[41609]: pgmap v1724: 164 pgs: 164 active+clean; 582 KiB data, 866 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:50:58.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:58 smithi184 ceph-mon[41609]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:50:58.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:58 smithi184 ceph-mon[41609]: osdmap e803: 8 total, 8 up, 8 in 2024-02-05T07:50:59.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:50:59 smithi188 ceph-mon[33283]: osdmap e804: 8 total, 8 up, 8 in 2024-02-05T07:50:59.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:50:59 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:50:59.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:50:59 smithi184 ceph-mon[29861]: osdmap e804: 8 total, 8 up, 8 in 2024-02-05T07:50:59.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:50:59 smithi184 ceph-mon[41609]: osdmap e804: 8 total, 8 up, 8 in 2024-02-05T07:51:00.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:00 smithi188 ceph-mon[33283]: pgmap v1727: 196 pgs: 32 creating+peering, 164 active+clean; 582 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:00.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:00 smithi188 ceph-mon[33283]: osdmap e805: 8 total, 8 up, 8 in 2024-02-05T07:51:00.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:00 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:00.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:00 smithi184 ceph-mon[29861]: pgmap v1727: 196 pgs: 32 creating+peering, 164 active+clean; 582 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:00.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:00 smithi184 ceph-mon[29861]: osdmap e805: 8 total, 8 up, 8 in 2024-02-05T07:51:00.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:00 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:00 smithi184 ceph-mon[41609]: pgmap v1727: 196 pgs: 32 creating+peering, 164 active+clean; 582 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:00 smithi184 ceph-mon[41609]: osdmap e805: 8 total, 8 up, 8 in 2024-02-05T07:51:00.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:00 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:01.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:01 smithi188 ceph-mon[33283]: osdmap e806: 8 total, 8 up, 8 in 2024-02-05T07:51:01.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:01 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:51:01.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:01 smithi184 ceph-mon[29861]: osdmap e806: 8 total, 8 up, 8 in 2024-02-05T07:51:01.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:01 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:51:01.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:01 smithi184 ceph-mon[41609]: osdmap e806: 8 total, 8 up, 8 in 2024-02-05T07:51:01.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:01 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:51:02.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:02 smithi184 ceph-mon[29861]: pgmap v1730: 164 pgs: 164 active+clean; 582 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:02.271 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:02 smithi184 ceph-mon[29861]: osdmap e807: 8 total, 8 up, 8 in 2024-02-05T07:51:02.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:02 smithi184 ceph-mon[41609]: pgmap v1730: 164 pgs: 164 active+clean; 582 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:02.271 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:02 smithi184 ceph-mon[41609]: osdmap e807: 8 total, 8 up, 8 in 2024-02-05T07:51:02.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:51:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:51:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:51:02.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:02 smithi188 ceph-mon[33283]: pgmap v1730: 164 pgs: 164 active+clean; 582 KiB data, 866 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:02.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:02 smithi188 ceph-mon[33283]: osdmap e807: 8 total, 8 up, 8 in 2024-02-05T07:51:03.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:03 smithi188 ceph-mon[33283]: osdmap e808: 8 total, 8 up, 8 in 2024-02-05T07:51:03.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:03 smithi184 ceph-mon[29861]: osdmap e808: 8 total, 8 up, 8 in 2024-02-05T07:51:03.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:03 smithi184 ceph-mon[41609]: osdmap e808: 8 total, 8 up, 8 in 2024-02-05T07:51:04.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:04 smithi188 ceph-mon[33283]: pgmap v1733: 196 pgs: 196 active+clean; 582 KiB data, 870 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:51:04.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:04 smithi188 ceph-mon[33283]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:51:04.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:04 smithi188 ceph-mon[33283]: osdmap e809: 8 total, 8 up, 8 in 2024-02-05T07:51:04.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:04 smithi184 ceph-mon[29861]: pgmap v1733: 196 pgs: 196 active+clean; 582 KiB data, 870 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:51:04.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:04 smithi184 ceph-mon[29861]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:51:04.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:04 smithi184 ceph-mon[29861]: osdmap e809: 8 total, 8 up, 8 in 2024-02-05T07:51:04.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:04 smithi184 ceph-mon[41609]: pgmap v1733: 196 pgs: 196 active+clean; 582 KiB data, 870 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:51:04.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:04 smithi184 ceph-mon[41609]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:51:04.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:04 smithi184 ceph-mon[41609]: osdmap e809: 8 total, 8 up, 8 in 2024-02-05T07:51:05.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:05 smithi188 ceph-mon[33283]: osdmap e810: 8 total, 8 up, 8 in 2024-02-05T07:51:05.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:05 smithi184 ceph-mon[29861]: osdmap e810: 8 total, 8 up, 8 in 2024-02-05T07:51:05.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:05 smithi184 ceph-mon[41609]: osdmap e810: 8 total, 8 up, 8 in 2024-02-05T07:51:06.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:06 smithi188 ceph-mon[33283]: pgmap v1736: 196 pgs: 196 active+clean; 582 KiB data, 870 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:51:06.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:06 smithi184 ceph-mon[29861]: pgmap v1736: 196 pgs: 196 active+clean; 582 KiB data, 870 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:51:06.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:06 smithi184 ceph-mon[41609]: pgmap v1736: 196 pgs: 196 active+clean; 582 KiB data, 870 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-05T07:51:08.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:08 smithi188 ceph-mon[33283]: pgmap v1737: 196 pgs: 196 active+clean; 582 KiB data, 870 MiB used, 714 GiB / 715 GiB avail; 898 B/s rd, 179 B/s wr, 1 op/s 2024-02-05T07:51:08.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:08 smithi184 ceph-mon[29861]: pgmap v1737: 196 pgs: 196 active+clean; 582 KiB data, 870 MiB used, 714 GiB / 715 GiB avail; 898 B/s rd, 179 B/s wr, 1 op/s 2024-02-05T07:51:08.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:08 smithi184 ceph-mon[41609]: pgmap v1737: 196 pgs: 196 active+clean; 582 KiB data, 870 MiB used, 714 GiB / 715 GiB avail; 898 B/s rd, 179 B/s wr, 1 op/s 2024-02-05T07:51:09.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:51:09 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:51:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:10 smithi188 ceph-mon[33283]: pgmap v1738: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 152 B/s wr, 1 op/s 2024-02-05T07:51:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:10 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:10.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:10 smithi184 ceph-mon[29861]: pgmap v1738: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 152 B/s wr, 1 op/s 2024-02-05T07:51:10.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:10 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:10 smithi184 ceph-mon[41609]: pgmap v1738: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 152 B/s wr, 1 op/s 2024-02-05T07:51:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:10 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:11.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:11 smithi188 ceph-mon[33283]: osdmap e811: 8 total, 8 up, 8 in 2024-02-05T07:51:11.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:11 smithi184 ceph-mon[29861]: osdmap e811: 8 total, 8 up, 8 in 2024-02-05T07:51:11.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:11 smithi184 ceph-mon[41609]: osdmap e811: 8 total, 8 up, 8 in 2024-02-05T07:51:12.220 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:51:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:51:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:51:12.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:12 smithi184 ceph-mon[29861]: pgmap v1740: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 666 B/s rd, 0 op/s 2024-02-05T07:51:12.521 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:12 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:51:12.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:12 smithi184 ceph-mon[41609]: pgmap v1740: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 666 B/s rd, 0 op/s 2024-02-05T07:51:12.521 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:12 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:51:12.637 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:12 smithi188 ceph-mon[33283]: pgmap v1740: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 666 B/s rd, 0 op/s 2024-02-05T07:51:12.637 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:12 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:51:14.498 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:14 smithi188 ceph-mon[33283]: pgmap v1741: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:14.520 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:14 smithi184 ceph-mon[29861]: pgmap v1741: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:14.520 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:14 smithi184 ceph-mon[41609]: pgmap v1741: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:15.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:51:15.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:15.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:15.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:51:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:15.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:51:16.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:16 smithi184 ceph-mon[29861]: pgmap v1742: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:51:16.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:16 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:16.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:16 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:16 smithi184 ceph-mon[41609]: pgmap v1742: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:51:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:16 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:16 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:16 smithi188 ceph-mon[33283]: pgmap v1742: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:51:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:16 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:16.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:16 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:17.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:17 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:51:17.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:17 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:51:17.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:17 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:17.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:17 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:51:17.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:17 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:51:17.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:17 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:17 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:51:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:17 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:51:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:17 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:18 smithi188 ceph-mon[33283]: pgmap v1743: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:51:19.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:18 smithi184 ceph-mon[29861]: pgmap v1743: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:51:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:18 smithi184 ceph-mon[41609]: pgmap v1743: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:51:19.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:51:19 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:51:19.612 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: Running main() from gmock_main.cc 2024-02-05T07:51:19.612 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2024-02-05T07:51:19.612 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [----------] Global test environment set-up. 2024-02-05T07:51:19.612 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2024-02-05T07:51:19.612 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2024-02-05T07:51:19.612 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (1810622 ms) 2024-02-05T07:51:19.612 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2024-02-05T07:51:19.612 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (5032 ms) 2024-02-05T07:51:19.612 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2024-02-05T07:51:19.612 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (4043 ms) 2024-02-05T07:51:19.612 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2024-02-05T07:51:19.613 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (5007 ms) 2024-02-05T07:51:19.613 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-02-05T07:51:19.613 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (7072 ms) 2024-02-05T07:51:19.613 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (1831776 ms total) 2024-02-05T07:51:19.613 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: 2024-02-05T07:51:19.613 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2024-02-05T07:51:19.613 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-02-05T07:51:19.613 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (5025 ms) 2024-02-05T07:51:19.613 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-02-05T07:51:19.613 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (6047 ms) 2024-02-05T07:51:19.613 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-02-05T07:51:19.613 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (8060 ms) 2024-02-05T07:51:19.614 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-02-05T07:51:19.614 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6052 ms) 2024-02-05T07:51:19.614 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-02-05T07:51:19.614 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4033 ms) 2024-02-05T07:51:19.614 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-02-05T07:51:19.614 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnapsmithi184-82555-11. 2024-02-05T07:51:19.614 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: Waiting for snaps to purge. 2024-02-05T07:51:19.614 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (19535 ms) 2024-02-05T07:51:19.614 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (48752 ms total) 2024-02-05T07:51:19.614 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: 2024-02-05T07:51:19.614 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [----------] Global test environment tear-down 2024-02-05T07:51:19.614 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (1880529 ms total) 2024-02-05T07:51:19.614 INFO:tasks.workunit.client.0.smithi184.stdout: snapshots: [ PASSED ] 11 tests. 2024-02-05T07:51:19.617 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:51:19.617 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81673 2024-02-05T07:51:19.617 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81673 2024-02-05T07:51:19.617 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:51:19.617 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81144 2024-02-05T07:51:19.617 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81144 2024-02-05T07:51:19.617 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:51:19.617 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81205 2024-02-05T07:51:19.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81205 2024-02-05T07:51:19.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:51:19.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81613 2024-02-05T07:51:19.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81613 2024-02-05T07:51:19.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:51:19.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81244 2024-02-05T07:51:19.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81244 2024-02-05T07:51:19.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:51:19.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81724 2024-02-05T07:51:19.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81724 2024-02-05T07:51:19.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:51:19.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=81738 2024-02-05T07:51:19.618 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 81738 2024-02-05T07:51:19.619 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:51:19.619 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82186 2024-02-05T07:51:19.619 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 82186 2024-02-05T07:51:19.619 INFO:tasks.workunit.client.0.smithi184.stderr:+ for t in "${!pids[@]}" 2024-02-05T07:51:19.619 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=82552 2024-02-05T07:51:19.619 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 82552 2024-02-05T07:51:19.619 INFO:tasks.workunit.client.0.smithi184.stderr:+ exit 0 2024-02-05T07:51:19.619 INFO:tasks.workunit.client.0.smithi184.stderr:+ cleanup 2024-02-05T07:51:19.619 INFO:tasks.workunit.client.0.smithi184.stderr:+ pkill -P 81139 2024-02-05T07:51:19.631 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-02-05T07:51:19.632 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-05T07:51:19.632 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-05T07:51:19.667 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-02-05T07:51:19.668 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-02-05T07:51:19.669 DEBUG:teuthology.orchestra.run.smithi184:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=164d3be4a527be775f4d3c343ea591122f1b8921 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-02-05T07:51:19.725 INFO:tasks.workunit.client.0.smithi184.stderr:++ uuidgen 2024-02-05T07:51:19.743 INFO:tasks.workunit.client.0.smithi184.stderr:+ p=978227f4-3b71-45f5-b8b8-2286bb55bbcd 2024-02-05T07:51:19.743 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool create 978227f4-3b71-45f5-b8b8-2286bb55bbcd 12 2024-02-05T07:51:19.829 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.825+0000 7fd2cc547640 1 -- 172.21.15.184:0/2091574958 >> v1:172.21.15.184:6790/0 conn(0x7fd2c41001f0 legacy=0x7fd2c41005d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:19.829 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.825+0000 7fd2cc547640 1 -- 172.21.15.184:0/2091574958 shutdown_connections 2024-02-05T07:51:19.829 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.825+0000 7fd2cc547640 1 -- 172.21.15.184:0/2091574958 >> 172.21.15.184:0/2091574958 conn(0x7fd2c40fba30 msgr2=0x7fd2c40fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:51:19.829 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.825+0000 7fd2cc547640 1 -- 172.21.15.184:0/2091574958 shutdown_connections 2024-02-05T07:51:19.829 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.825+0000 7fd2cc547640 1 -- 172.21.15.184:0/2091574958 wait complete. 2024-02-05T07:51:19.829 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.826+0000 7fd2cc547640 1 Processor -- start 2024-02-05T07:51:19.830 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.826+0000 7fd2cc547640 1 -- start start 2024-02-05T07:51:19.830 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.826+0000 7fd2cc547640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd2c41a8030 con 0x7fd2c410c9e0 2024-02-05T07:51:19.830 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.826+0000 7fd2cc547640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd2c41a91d0 con 0x7fd2c41001f0 2024-02-05T07:51:19.830 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.826+0000 7fd2cc547640 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd2c41aa3d0 con 0x7fd2c4108e70 2024-02-05T07:51:19.830 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.826+0000 7fd2c9ae2640 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7fd2c4108e70 0x7fd2c41a3150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:33260/0 (socket says 172.21.15.184:33260) 2024-02-05T07:51:19.830 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.826+0000 7fd2caae4640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fd2c410c9e0 0x7fd2c41a6880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:38614/0 (socket says 172.21.15.184:38614) 2024-02-05T07:51:19.830 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.826+0000 7fd2c9ae2640 1 -- 172.21.15.184:0/1622193134 learned_addr learned my addr 172.21.15.184:0/1622193134 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:51:19.830 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.826+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424459360 0 0) 0x7fd2c41aa3d0 con 0x7fd2c4108e70 2024-02-05T07:51:19.830 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.826+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2b0003520 con 0x7fd2c4108e70 2024-02-05T07:51:19.830 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.826+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393972308 0 0) 0x7fd2c41a8030 con 0x7fd2c410c9e0 2024-02-05T07:51:19.830 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.826+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c41aa3d0 con 0x7fd2c410c9e0 2024-02-05T07:51:19.830 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348338124 0 0) 0x7fd2c41a91d0 con 0x7fd2c41001f0 2024-02-05T07:51:19.830 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c41a8030 con 0x7fd2c41001f0 2024-02-05T07:51:19.831 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3159779345 0 0) 0x7fd2b0003520 con 0x7fd2c4108e70 2024-02-05T07:51:19.831 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd2c41a91d0 con 0x7fd2c4108e70 2024-02-05T07:51:19.831 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fd2b4001910 con 0x7fd2c4108e70 2024-02-05T07:51:19.831 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1811117856 0 0) 0x7fd2c41aa3d0 con 0x7fd2c410c9e0 2024-02-05T07:51:19.831 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd2b0003520 con 0x7fd2c410c9e0 2024-02-05T07:51:19.831 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fd2bc0018e0 con 0x7fd2c410c9e0 2024-02-05T07:51:19.831 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4294283854 0 0) 0x7fd2c41a8030 con 0x7fd2c41001f0 2024-02-05T07:51:19.831 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd2c41aa3d0 con 0x7fd2c41001f0 2024-02-05T07:51:19.831 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fd2c0001880 con 0x7fd2c41001f0 2024-02-05T07:51:19.831 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2106638877 0 0) 0x7fd2c41a91d0 con 0x7fd2c4108e70 2024-02-05T07:51:19.831 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 >> v1:172.21.15.188:6789/0 conn(0x7fd2c41001f0 legacy=0x7fd2c4105370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:19.831 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 >> v1:172.21.15.184:6789/0 conn(0x7fd2c410c9e0 legacy=0x7fd2c41a6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:19.831 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c41ab5d0 con 0x7fd2c4108e70 2024-02-05T07:51:19.831 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2cc547640 1 -- 172.21.15.184:0/1622193134 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2c41a93c0 con 0x7fd2c4108e70 2024-02-05T07:51:19.832 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2cc547640 1 -- 172.21.15.184:0/1622193134 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2c41a9850 con 0x7fd2c4108e70 2024-02-05T07:51:19.832 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fd2b4003aa0 con 0x7fd2c4108e70 2024-02-05T07:51:19.832 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.827+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fd2b4005c30 con 0x7fd2c4108e70 2024-02-05T07:51:19.832 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.828+0000 7fd2cc547640 1 -- 172.21.15.184:0/1622193134 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a8005080 con 0x7fd2c4108e70 2024-02-05T07:51:19.832 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.828+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7fd2b4003610 con 0x7fd2c4108e70 2024-02-05T07:51:19.832 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.829+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(812..812 src has 253..812) v4 ==== 7430+0+0 (unknown 1210941438 0 0) 0x7fd2b4088db0 con 0x7fd2c4108e70 2024-02-05T07:51:19.834 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:19.833+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fd2b4055bc0 con 0x7fd2c4108e70 2024-02-05T07:51:20.010 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.009+0000 7fd2cc547640 1 -- 172.21.15.184:0/1622193134 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12} v 0) v1 -- 0x7fd2a80058b0 con 0x7fd2c4108e70 2024-02-05T07:51:20.611 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.610+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.2 v1:172.21.15.184:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]=0 pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' created v813) v1 ==== 176+0+0 (unknown 1426625097 0 0) 0x7fd2b4053f30 con 0x7fd2c4108e70 2024-02-05T07:51:20.725 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.724+0000 7fd2cc547640 1 -- 172.21.15.184:0/1622193134 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12} v 0) v1 -- 0x7fd2a80053e0 con 0x7fd2c4108e70 2024-02-05T07:51:20.726 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.725+0000 7fd2bb7fe640 1 -- 172.21.15.184:0/1622193134 <== mon.2 v1:172.21.15.184:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]=0 pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' already exists v813) v1 ==== 183+0+0 (unknown 1607435433 0 0) 0x7fd2a80053e0 con 0x7fd2c4108e70 2024-02-05T07:51:20.726 INFO:tasks.workunit.client.0.smithi184.stderr:pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' already exists 2024-02-05T07:51:20.728 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.727+0000 7fd2cc547640 1 -- 172.21.15.184:0/1622193134 >> v1:172.21.15.184:6800/103463156 conn(0x7fd2b006ecc0 legacy=0x7fd2b0071180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:20.728 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.727+0000 7fd2cc547640 1 -- 172.21.15.184:0/1622193134 >> v1:172.21.15.184:6790/0 conn(0x7fd2c4108e70 legacy=0x7fd2c41a3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:20.728 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.727+0000 7fd2cc547640 1 -- 172.21.15.184:0/1622193134 shutdown_connections 2024-02-05T07:51:20.728 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.727+0000 7fd2cc547640 1 -- 172.21.15.184:0/1622193134 >> 172.21.15.184:0/1622193134 conn(0x7fd2c40fba30 msgr2=0x7fd2c410ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:51:20.728 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.727+0000 7fd2cc547640 1 -- 172.21.15.184:0/1622193134 shutdown_connections 2024-02-05T07:51:20.728 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.727+0000 7fd2cc547640 1 -- 172.21.15.184:0/1622193134 wait complete. 2024-02-05T07:51:20.737 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool set-quota 978227f4-3b71-45f5-b8b8-2286bb55bbcd max_objects 10 2024-02-05T07:51:20.825 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.819+0000 7f5ad09f4640 1 -- 172.21.15.184:0/1342120845 >> v1:172.21.15.184:6790/0 conn(0x7f5acc10db60 legacy=0x7f5acc10fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:20.825 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.819+0000 7f5ad09f4640 1 -- 172.21.15.184:0/1342120845 shutdown_connections 2024-02-05T07:51:20.825 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.819+0000 7f5ad09f4640 1 -- 172.21.15.184:0/1342120845 >> 172.21.15.184:0/1342120845 conn(0x7f5acc0fba50 msgr2=0x7f5acc0fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:51:20.825 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.819+0000 7f5ad09f4640 1 -- 172.21.15.184:0/1342120845 shutdown_connections 2024-02-05T07:51:20.825 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.819+0000 7f5ad09f4640 1 -- 172.21.15.184:0/1342120845 wait complete. 2024-02-05T07:51:20.825 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.820+0000 7f5ad09f4640 1 Processor -- start 2024-02-05T07:51:20.825 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.820+0000 7f5ad09f4640 1 -- start start 2024-02-05T07:51:20.826 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ad09f4640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5acc1a5ef0 con 0x7f5acc102250 2024-02-05T07:51:20.826 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ad09f4640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5acc1a70f0 con 0x7f5acc10db60 2024-02-05T07:51:20.826 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ad09f4640 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5acc1a82f0 con 0x7f5acc10a050 2024-02-05T07:51:20.826 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac1d9b640 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f5acc10a050 0x7f5acc1a0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:33270/0 (socket says 172.21.15.184:33270) 2024-02-05T07:51:20.826 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac1d9b640 1 -- 172.21.15.184:0/4197991290 learned_addr learned my addr 172.21.15.184:0/4197991290 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:51:20.826 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5aca59c640 1 --1- 172.21.15.184:0/4197991290 >> v1:172.21.15.184:6789/0 conn(0x7f5acc102250 0x7f5acc109770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:38634/0 (socket says 172.21.15.184:38634) 2024-02-05T07:51:20.826 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553015893 0 0) 0x7f5acc1a82f0 con 0x7f5acc10a050 2024-02-05T07:51:20.826 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ab8003160 con 0x7f5acc10a050 2024-02-05T07:51:20.826 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3784515087 0 0) 0x7f5acc1a5ef0 con 0x7f5acc102250 2024-02-05T07:51:20.826 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5acc1a82f0 con 0x7f5acc102250 2024-02-05T07:51:20.826 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 719697212 0 0) 0x7f5acc1a70f0 con 0x7f5acc10db60 2024-02-05T07:51:20.826 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5acc1a5ef0 con 0x7f5acc10db60 2024-02-05T07:51:20.827 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1564949207 0 0) 0x7f5ab8003160 con 0x7f5acc10a050 2024-02-05T07:51:20.827 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5acc1a70f0 con 0x7f5acc10a050 2024-02-05T07:51:20.827 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f5ab40019a0 con 0x7f5acc10a050 2024-02-05T07:51:20.827 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 80530628 0 0) 0x7f5acc1a82f0 con 0x7f5acc102250 2024-02-05T07:51:20.827 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5ab8003160 con 0x7f5acc102250 2024-02-05T07:51:20.827 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f5abc001830 con 0x7f5acc102250 2024-02-05T07:51:20.827 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1397326147 0 0) 0x7f5acc1a5ef0 con 0x7f5acc10db60 2024-02-05T07:51:20.827 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5acc1a82f0 con 0x7f5acc10db60 2024-02-05T07:51:20.827 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f5ac40018d0 con 0x7f5acc10db60 2024-02-05T07:51:20.827 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3016119749 0 0) 0x7f5acc1a70f0 con 0x7f5acc10a050 2024-02-05T07:51:20.827 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 >> v1:172.21.15.188:6789/0 conn(0x7f5acc10db60 legacy=0x7f5acc1a45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:20.828 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 >> v1:172.21.15.184:6789/0 conn(0x7f5acc102250 legacy=0x7f5acc109770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:20.828 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc1a94f0 con 0x7f5acc10a050 2024-02-05T07:51:20.828 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ad09f4640 1 -- 172.21.15.184:0/4197991290 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5acc1a60e0 con 0x7f5acc10a050 2024-02-05T07:51:20.828 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.821+0000 7f5ad09f4640 1 -- 172.21.15.184:0/4197991290 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5acc1a6570 con 0x7f5acc10a050 2024-02-05T07:51:20.828 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.822+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f5ab4003a80 con 0x7f5acc10a050 2024-02-05T07:51:20.828 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.822+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f5ab4005b30 con 0x7f5acc10a050 2024-02-05T07:51:20.828 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.823+0000 7f5ad09f4640 1 -- 172.21.15.184:0/4197991290 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aac005080 con 0x7f5acc10a050 2024-02-05T07:51:20.828 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.823+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f5ab401c280 con 0x7f5acc10a050 2024-02-05T07:51:20.828 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.823+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(813..813 src has 253..813) v4 ==== 7805+0+0 (unknown 3848452539 0 0) 0x7f5ab4088e40 con 0x7f5acc10a050 2024-02-05T07:51:20.829 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:20.828+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f5ab4003e60 con 0x7f5acc10a050 2024-02-05T07:51:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:20 smithi188 ceph-mon[33283]: pgmap v1744: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:51:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:20 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:20 smithi188 ceph-mon[33283]: osdmap e812: 8 total, 8 up, 8 in 2024-02-05T07:51:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:20 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1622193134' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]: dispatch 2024-02-05T07:51:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:20 smithi188 ceph-mon[33283]: from='client.58334 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]: dispatch 2024-02-05T07:51:21.003 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:21.002+0000 7f5ad09f4640 1 -- 172.21.15.184:0/4197991290 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f5aac005330 con 0x7f5acc10a050 2024-02-05T07:51:21.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:20 smithi184 ceph-mon[29861]: pgmap v1744: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:51:21.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:20 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:21.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:20 smithi184 ceph-mon[29861]: osdmap e812: 8 total, 8 up, 8 in 2024-02-05T07:51:21.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:20 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1622193134' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]: dispatch 2024-02-05T07:51:21.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:20 smithi184 ceph-mon[29861]: from='client.58334 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]: dispatch 2024-02-05T07:51:21.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:20 smithi184 ceph-mon[41609]: pgmap v1744: 196 pgs: 196 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:51:21.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:20 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:21.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:20 smithi184 ceph-mon[41609]: osdmap e812: 8 total, 8 up, 8 in 2024-02-05T07:51:21.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:20 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1622193134' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]: dispatch 2024-02-05T07:51:21.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:20 smithi184 ceph-mon[41609]: from='client.58334 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]: dispatch 2024-02-05T07:51:21.624 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:21.623+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.2 v1:172.21.15.184:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd v814) v1 ==== 223+0+0 (unknown 2770374646 0 0) 0x7f5ab4054dc0 con 0x7f5acc10a050 2024-02-05T07:51:21.736 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:21.735+0000 7f5ad09f4640 1 -- 172.21.15.184:0/4197991290 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f5aac001090 con 0x7f5acc10a050 2024-02-05T07:51:21.881 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:21 smithi184 ceph-mon[29861]: from='client.58334 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]': finished 2024-02-05T07:51:21.881 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:21 smithi184 ceph-mon[29861]: osdmap e813: 8 total, 8 up, 8 in 2024-02-05T07:51:21.881 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1622193134' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]: dispatch 2024-02-05T07:51:21.881 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:21 smithi184 ceph-mon[29861]: from='client.58334 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]: dispatch 2024-02-05T07:51:21.881 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:21 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4197991290' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:51:21.881 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:21 smithi184 ceph-mon[29861]: from='client.58340 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:51:21.882 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:21 smithi184 ceph-mon[41609]: from='client.58334 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]': finished 2024-02-05T07:51:21.882 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:21 smithi184 ceph-mon[41609]: osdmap e813: 8 total, 8 up, 8 in 2024-02-05T07:51:21.882 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1622193134' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]: dispatch 2024-02-05T07:51:21.882 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:21 smithi184 ceph-mon[41609]: from='client.58334 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]: dispatch 2024-02-05T07:51:21.882 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:21 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4197991290' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:51:21.882 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:21 smithi184 ceph-mon[41609]: from='client.58340 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:51:21.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:21 smithi188 ceph-mon[33283]: from='client.58334 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]': finished 2024-02-05T07:51:21.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:21 smithi188 ceph-mon[33283]: osdmap e813: 8 total, 8 up, 8 in 2024-02-05T07:51:21.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1622193134' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]: dispatch 2024-02-05T07:51:21.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:21 smithi188 ceph-mon[33283]: from='client.58334 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pg_num": 12}]: dispatch 2024-02-05T07:51:21.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:21 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4197991290' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:51:21.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:21 smithi188 ceph-mon[33283]: from='client.58340 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:51:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:51:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:51:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:51:22.624 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.623+0000 7f5ac3fff640 1 -- 172.21.15.184:0/4197991290 <== mon.2 v1:172.21.15.184:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd v815) v1 ==== 223+0+0 (unknown 3966052998 0 0) 0x7f5ab4003c80 con 0x7f5acc10a050 2024-02-05T07:51:22.625 INFO:tasks.workunit.client.0.smithi184.stderr:set-quota max_objects = 10 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd 2024-02-05T07:51:22.627 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.626+0000 7f5ad09f4640 1 -- 172.21.15.184:0/4197991290 >> v1:172.21.15.184:6800/103463156 conn(0x7f5ab806ea80 legacy=0x7f5ab8070f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:22.627 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.626+0000 7f5ad09f4640 1 -- 172.21.15.184:0/4197991290 >> v1:172.21.15.184:6790/0 conn(0x7f5acc10a050 legacy=0x7f5acc1a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:22.627 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.626+0000 7f5ad09f4640 1 -- 172.21.15.184:0/4197991290 shutdown_connections 2024-02-05T07:51:22.628 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.626+0000 7f5ad09f4640 1 -- 172.21.15.184:0/4197991290 >> 172.21.15.184:0/4197991290 conn(0x7f5acc0fba50 msgr2=0x7f5acc0fd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:51:22.628 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.627+0000 7f5ad09f4640 1 -- 172.21.15.184:0/4197991290 shutdown_connections 2024-02-05T07:51:22.628 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.627+0000 7f5ad09f4640 1 -- 172.21.15.184:0/4197991290 wait complete. 2024-02-05T07:51:22.639 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool application enable 978227f4-3b71-45f5-b8b8-2286bb55bbcd rados 2024-02-05T07:51:22.727 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.726+0000 7f3ec428f640 1 -- 172.21.15.184:0/3873262220 >> v1:172.21.15.184:6790/0 conn(0x7f3ebc10db00 legacy=0x7f3ebc10ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:22.727 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.726+0000 7f3ec428f640 1 -- 172.21.15.184:0/3873262220 shutdown_connections 2024-02-05T07:51:22.727 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.726+0000 7f3ec428f640 1 -- 172.21.15.184:0/3873262220 >> 172.21.15.184:0/3873262220 conn(0x7f3ebc0752c0 msgr2=0x7f3ebc0756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:51:22.727 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.726+0000 7f3ec428f640 1 -- 172.21.15.184:0/3873262220 shutdown_connections 2024-02-05T07:51:22.727 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.726+0000 7f3ec428f640 1 -- 172.21.15.184:0/3873262220 wait complete. 2024-02-05T07:51:22.728 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.726+0000 7f3ec428f640 1 Processor -- start 2024-02-05T07:51:22.728 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.726+0000 7f3ec428f640 1 -- start start 2024-02-05T07:51:22.730 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3ec428f640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3ebc1a81d0 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.730 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3ec428f640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3ebc1a93d0 con 0x7f3ebc109f90 2024-02-05T07:51:22.730 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3ec428f640 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3ebc1aa5d0 con 0x7f3ebc10db00 2024-02-05T07:51:22.730 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3ec202b640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7f3ebc0ffaa0 0x7f3ebc106570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:38652/0 (socket says 172.21.15.184:38652) 2024-02-05T07:51:22.730 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3ec202b640 1 -- 172.21.15.184:0/4279838164 learned_addr learned my addr 172.21.15.184:0/4279838164 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:51:22.731 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1196663422 0 0) 0x7f3ebc1aa5d0 con 0x7f3ebc10db00 2024-02-05T07:51:22.731 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ea8003520 con 0x7f3ebc10db00 2024-02-05T07:51:22.731 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44501683 0 0) 0x7f3ebc1a81d0 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.731 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ebc1aa5d0 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.731 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011681919 0 0) 0x7f3ebc1a93d0 con 0x7f3ebc109f90 2024-02-05T07:51:22.731 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ebc1a81d0 con 0x7f3ebc109f90 2024-02-05T07:51:22.731 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1402608639 0 0) 0x7f3ebc1aa5d0 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.731 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ebc1a93d0 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.731 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f3eb80018f0 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.731 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3421949042 0 0) 0x7f3ea8003520 con 0x7f3ebc10db00 2024-02-05T07:51:22.731 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ebc1aa5d0 con 0x7f3ebc10db00 2024-02-05T07:51:22.731 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f3eb4001c00 con 0x7f3ebc10db00 2024-02-05T07:51:22.731 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 380368146 0 0) 0x7f3ebc1a81d0 con 0x7f3ebc109f90 2024-02-05T07:51:22.731 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3ea8003520 con 0x7f3ebc109f90 2024-02-05T07:51:22.732 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f3eac0019d0 con 0x7f3ebc109f90 2024-02-05T07:51:22.732 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1154374845 0 0) 0x7f3ebc1a93d0 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.732 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 >> v1:172.21.15.184:6790/0 conn(0x7f3ebc10db00 legacy=0x7f3ebc1a6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:22.732 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 >> v1:172.21.15.188:6789/0 conn(0x7f3ebc109f90 legacy=0x7f3ebc1a3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:22.732 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ebc1ab7d0 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.732 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3ec428f640 1 -- 172.21.15.184:0/4279838164 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ebc1a83c0 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.732 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3ec428f640 1 -- 172.21.15.184:0/4279838164 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ebc1a8850 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.732 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f3eb8001cc0 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.732 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.727+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f3eb8005ca0 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.732 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.728+0000 7f3ec428f640 1 -- 172.21.15.184:0/4279838164 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea0005080 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.732 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.729+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f3eb8003fe0 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.732 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.729+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(815..815 src has 253..815) v4 ==== 7805+0+0 (unknown 2285307357 0 0) 0x7f3eb8088fc0 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.735 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.734+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f3eb8055c60 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.912 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:22.911+0000 7f3ec428f640 1 -- 172.21.15.184:0/4279838164 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"} v 0) v1 -- 0x7f3ea0005330 con 0x7f3ebc0ffaa0 2024-02-05T07:51:22.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:22 smithi188 ceph-mon[33283]: pgmap v1747: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-05T07:51:22.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:22 smithi188 ceph-mon[33283]: from='client.58340 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]': finished 2024-02-05T07:51:22.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:22 smithi188 ceph-mon[33283]: osdmap e814: 8 total, 8 up, 8 in 2024-02-05T07:51:22.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:22 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4197991290' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:51:22.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:22 smithi188 ceph-mon[33283]: from='client.58340 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:51:23.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:22 smithi184 ceph-mon[29861]: pgmap v1747: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-05T07:51:23.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:22 smithi184 ceph-mon[29861]: from='client.58340 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]': finished 2024-02-05T07:51:23.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:22 smithi184 ceph-mon[29861]: osdmap e814: 8 total, 8 up, 8 in 2024-02-05T07:51:23.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:22 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4197991290' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:51:23.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:22 smithi184 ceph-mon[29861]: from='client.58340 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:51:23.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:22 smithi184 ceph-mon[41609]: pgmap v1747: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 892 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-05T07:51:23.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:22 smithi184 ceph-mon[41609]: from='client.58340 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]': finished 2024-02-05T07:51:23.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:22 smithi184 ceph-mon[41609]: osdmap e814: 8 total, 8 up, 8 in 2024-02-05T07:51:23.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:22 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4197991290' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:51:23.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:22 smithi184 ceph-mon[41609]: from='client.58340 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:51:23.625 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:23.624+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"}]=0 enabled application 'rados' on pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' v816) v1 ==== 213+0+0 (unknown 3518596253 0 0) 0x7f3eb8053fd0 con 0x7f3ebc0ffaa0 2024-02-05T07:51:23.739 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:23.738+0000 7f3ec428f640 1 -- 172.21.15.184:0/4279838164 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"} v 0) v1 -- 0x7f3ea0001090 con 0x7f3ebc0ffaa0 2024-02-05T07:51:23.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:23 smithi188 ceph-mon[33283]: from='client.58340 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]': finished 2024-02-05T07:51:23.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:23 smithi188 ceph-mon[33283]: osdmap e815: 8 total, 8 up, 8 in 2024-02-05T07:51:23.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:23 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4279838164' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"}]: dispatch 2024-02-05T07:51:24.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:23 smithi184 ceph-mon[29861]: from='client.58340 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]': finished 2024-02-05T07:51:24.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:23 smithi184 ceph-mon[29861]: osdmap e815: 8 total, 8 up, 8 in 2024-02-05T07:51:24.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:23 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4279838164' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"}]: dispatch 2024-02-05T07:51:24.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:23 smithi184 ceph-mon[41609]: from='client.58340 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "10"}]': finished 2024-02-05T07:51:24.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:23 smithi184 ceph-mon[41609]: osdmap e815: 8 total, 8 up, 8 in 2024-02-05T07:51:24.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:23 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4279838164' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"}]: dispatch 2024-02-05T07:51:24.627 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:24.626+0000 7f3eb37fe640 1 -- 172.21.15.184:0/4279838164 <== mon.0 v1:172.21.15.184:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"}]=0 enabled application 'rados' on pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' v817) v1 ==== 213+0+0 (unknown 3952636539 0 0) 0x7f3eb80557f0 con 0x7f3ebc0ffaa0 2024-02-05T07:51:24.627 INFO:tasks.workunit.client.0.smithi184.stderr:enabled application 'rados' on pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' 2024-02-05T07:51:24.631 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:24.630+0000 7f3ec428f640 1 -- 172.21.15.184:0/4279838164 >> v1:172.21.15.184:6800/103463156 conn(0x7f3ea806eb90 legacy=0x7f3ea8071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:24.631 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:24.630+0000 7f3ec428f640 1 -- 172.21.15.184:0/4279838164 >> v1:172.21.15.184:6789/0 conn(0x7f3ebc0ffaa0 legacy=0x7f3ebc106570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:24.631 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:24.630+0000 7f3ec428f640 1 -- 172.21.15.184:0/4279838164 shutdown_connections 2024-02-05T07:51:24.631 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:24.630+0000 7f3ec428f640 1 -- 172.21.15.184:0/4279838164 >> 172.21.15.184:0/4279838164 conn(0x7f3ebc0752c0 msgr2=0x7f3ebc067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:51:24.631 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:24.630+0000 7f3ec428f640 1 -- 172.21.15.184:0/4279838164 shutdown_connections 2024-02-05T07:51:24.631 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:24.630+0000 7f3ec428f640 1 -- 172.21.15.184:0/4279838164 wait complete. 2024-02-05T07:51:24.645 INFO:tasks.workunit.client.0.smithi184.stderr:++ seq 1 10 2024-02-05T07:51:24.739 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:51:24.739 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 978227f4-3b71-45f5-b8b8-2286bb55bbcd put obj1 /etc/passwd 2024-02-05T07:51:24.778 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:51:24.779 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 978227f4-3b71-45f5-b8b8-2286bb55bbcd put obj2 /etc/passwd 2024-02-05T07:51:24.814 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:51:24.814 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 978227f4-3b71-45f5-b8b8-2286bb55bbcd put obj3 /etc/passwd 2024-02-05T07:51:24.848 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:51:24.848 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 978227f4-3b71-45f5-b8b8-2286bb55bbcd put obj4 /etc/passwd 2024-02-05T07:51:24.881 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:51:24.881 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 978227f4-3b71-45f5-b8b8-2286bb55bbcd put obj5 /etc/passwd 2024-02-05T07:51:24.915 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:51:24.915 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 978227f4-3b71-45f5-b8b8-2286bb55bbcd put obj6 /etc/passwd 2024-02-05T07:51:24.947 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:51:24.947 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 978227f4-3b71-45f5-b8b8-2286bb55bbcd put obj7 /etc/passwd 2024-02-05T07:51:24.980 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:51:24.980 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 978227f4-3b71-45f5-b8b8-2286bb55bbcd put obj8 /etc/passwd 2024-02-05T07:51:24.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:24 smithi188 ceph-mon[33283]: pgmap v1750: 176 pgs: 176 active+clean; 582 KiB data, 897 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:24.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4279838164' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"}]': finished 2024-02-05T07:51:24.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:24 smithi188 ceph-mon[33283]: osdmap e816: 8 total, 8 up, 8 in 2024-02-05T07:51:24.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:24 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4279838164' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"}]: dispatch 2024-02-05T07:51:25.012 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:51:25.012 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 978227f4-3b71-45f5-b8b8-2286bb55bbcd put obj9 /etc/passwd 2024-02-05T07:51:25.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:24 smithi184 ceph-mon[29861]: pgmap v1750: 176 pgs: 176 active+clean; 582 KiB data, 897 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:25.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4279838164' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"}]': finished 2024-02-05T07:51:25.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:24 smithi184 ceph-mon[29861]: osdmap e816: 8 total, 8 up, 8 in 2024-02-05T07:51:25.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:24 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4279838164' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"}]: dispatch 2024-02-05T07:51:25.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:24 smithi184 ceph-mon[41609]: pgmap v1750: 176 pgs: 176 active+clean; 582 KiB data, 897 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:25.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4279838164' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"}]': finished 2024-02-05T07:51:25.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:24 smithi184 ceph-mon[41609]: osdmap e816: 8 total, 8 up, 8 in 2024-02-05T07:51:25.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:24 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4279838164' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"}]: dispatch 2024-02-05T07:51:25.044 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:51:25.045 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 978227f4-3b71-45f5-b8b8-2286bb55bbcd put obj10 /etc/passwd 2024-02-05T07:51:25.076 INFO:tasks.workunit.client.0.smithi184.stderr:+ sleep 30 2024-02-05T07:51:25.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:25 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/4279838164' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"}]': finished 2024-02-05T07:51:25.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:25 smithi188 ceph-mon[33283]: osdmap e817: 8 total, 8 up, 8 in 2024-02-05T07:51:26.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:25 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/4279838164' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"}]': finished 2024-02-05T07:51:26.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:25 smithi184 ceph-mon[29861]: osdmap e817: 8 total, 8 up, 8 in 2024-02-05T07:51:26.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:25 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/4279838164' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "app": "rados"}]': finished 2024-02-05T07:51:26.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:25 smithi184 ceph-mon[41609]: osdmap e817: 8 total, 8 up, 8 in 2024-02-05T07:51:26.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:26 smithi188 ceph-mon[33283]: pgmap v1753: 176 pgs: 176 active+clean; 582 KiB data, 897 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:26.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:26 smithi188 ceph-mon[33283]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:51:27.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:26 smithi184 ceph-mon[29861]: pgmap v1753: 176 pgs: 176 active+clean; 582 KiB data, 897 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:27.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:26 smithi184 ceph-mon[29861]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:51:27.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:26 smithi184 ceph-mon[41609]: pgmap v1753: 176 pgs: 176 active+clean; 582 KiB data, 897 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:27.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:26 smithi184 ceph-mon[41609]: Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-05T07:51:28.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:28 smithi188 ceph-mon[33283]: pgmap v1754: 176 pgs: 176 active+clean; 582 KiB data, 897 MiB used, 714 GiB / 715 GiB avail; 992 B/s rd, 0 op/s 2024-02-05T07:51:29.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:28 smithi184 ceph-mon[29861]: pgmap v1754: 176 pgs: 176 active+clean; 582 KiB data, 897 MiB used, 714 GiB / 715 GiB avail; 992 B/s rd, 0 op/s 2024-02-05T07:51:29.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:28 smithi184 ceph-mon[41609]: pgmap v1754: 176 pgs: 176 active+clean; 582 KiB data, 897 MiB used, 714 GiB / 715 GiB avail; 992 B/s rd, 0 op/s 2024-02-05T07:51:29.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:51:29 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:51:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:30 smithi188 ceph-mon[33283]: pgmap v1755: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 831 B/s rd, 19 KiB/s wr, 2 op/s 2024-02-05T07:51:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:30 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:30 smithi188 ceph-mon[33283]: pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' is full (reached quota's max_objects: 10) 2024-02-05T07:51:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:30 smithi188 ceph-mon[33283]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-05T07:51:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:30 smithi188 ceph-mon[33283]: osdmap e818: 8 total, 8 up, 8 in 2024-02-05T07:51:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:30.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:51:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:30 smithi184 ceph-mon[29861]: pgmap v1755: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 831 B/s rd, 19 KiB/s wr, 2 op/s 2024-02-05T07:51:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:30 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:31.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:30 smithi184 ceph-mon[29861]: pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' is full (reached quota's max_objects: 10) 2024-02-05T07:51:31.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:30 smithi184 ceph-mon[29861]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-05T07:51:31.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:30 smithi184 ceph-mon[29861]: osdmap e818: 8 total, 8 up, 8 in 2024-02-05T07:51:31.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:31.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:51:31.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:30 smithi184 ceph-mon[41609]: pgmap v1755: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 831 B/s rd, 19 KiB/s wr, 2 op/s 2024-02-05T07:51:31.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:30 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:31.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:30 smithi184 ceph-mon[41609]: pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' is full (reached quota's max_objects: 10) 2024-02-05T07:51:31.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:30 smithi184 ceph-mon[41609]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-05T07:51:31.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:30 smithi184 ceph-mon[41609]: osdmap e818: 8 total, 8 up, 8 in 2024-02-05T07:51:31.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:51:31.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:51:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:51:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:51:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:51:32.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:32 smithi188 ceph-mon[33283]: pgmap v1757: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 715 B/s rd, 17 KiB/s wr, 2 op/s 2024-02-05T07:51:33.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:32 smithi184 ceph-mon[29861]: pgmap v1757: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 715 B/s rd, 17 KiB/s wr, 2 op/s 2024-02-05T07:51:33.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:32 smithi184 ceph-mon[41609]: pgmap v1757: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 715 B/s rd, 17 KiB/s wr, 2 op/s 2024-02-05T07:51:34.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:34 smithi188 ceph-mon[33283]: pgmap v1758: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-02-05T07:51:35.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:34 smithi184 ceph-mon[29861]: pgmap v1758: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-02-05T07:51:35.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:34 smithi184 ceph-mon[41609]: pgmap v1758: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-02-05T07:51:36.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:36 smithi188 ceph-mon[33283]: pgmap v1759: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-05T07:51:37.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:36 smithi184 ceph-mon[29861]: pgmap v1759: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-05T07:51:37.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:36 smithi184 ceph-mon[41609]: pgmap v1759: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-05T07:51:38.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:38 smithi188 ceph-mon[33283]: pgmap v1760: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-05T07:51:39.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:38 smithi184 ceph-mon[29861]: pgmap v1760: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-05T07:51:39.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:38 smithi184 ceph-mon[41609]: pgmap v1760: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-05T07:51:39.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:51:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:51:40.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:40 smithi188 ceph-mon[33283]: pgmap v1761: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:51:40.999 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:40 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:41.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:40 smithi184 ceph-mon[29861]: pgmap v1761: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:51:41.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:40 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:40 smithi184 ceph-mon[41609]: pgmap v1761: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:51:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:40 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:42.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:51:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:51:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:51:42.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:42 smithi188 ceph-mon[33283]: pgmap v1762: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 980 B/s rd, 0 op/s 2024-02-05T07:51:43.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:42 smithi184 ceph-mon[29861]: pgmap v1762: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 980 B/s rd, 0 op/s 2024-02-05T07:51:43.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:42 smithi184 ceph-mon[41609]: pgmap v1762: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 980 B/s rd, 0 op/s 2024-02-05T07:51:44.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:44 smithi188 ceph-mon[33283]: pgmap v1763: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:45.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:44 smithi184 ceph-mon[29861]: pgmap v1763: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:45.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:44 smithi184 ceph-mon[41609]: pgmap v1763: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:46 smithi188 ceph-mon[33283]: pgmap v1764: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:51:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:46 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:51:46.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:46 smithi184 ceph-mon[29861]: pgmap v1764: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:51:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:46 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:51:46.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:46 smithi184 ceph-mon[41609]: pgmap v1764: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:51:46.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:46 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:51:48.747 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:48 smithi188 ceph-mon[33283]: pgmap v1765: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:51:48.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:48 smithi184 ceph-mon[29861]: pgmap v1765: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:51:48.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:48 smithi184 ceph-mon[41609]: pgmap v1765: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:51:49.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:51:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:51:50.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:50 smithi188 ceph-mon[33283]: pgmap v1766: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:50.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:50 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:50.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:50 smithi184 ceph-mon[29861]: pgmap v1766: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:50.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:50 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:50.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:50 smithi184 ceph-mon[41609]: pgmap v1766: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:50.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:50 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:51:52.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:51:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:51:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:51:52.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:52 smithi188 ceph-mon[33283]: pgmap v1767: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:51:52.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:52 smithi184 ceph-mon[29861]: pgmap v1767: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:51:52.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:52 smithi184 ceph-mon[41609]: pgmap v1767: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:51:54.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:54 smithi188 ceph-mon[33283]: pgmap v1768: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:54.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:54 smithi184 ceph-mon[29861]: pgmap v1768: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:54.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:54 smithi184 ceph-mon[41609]: pgmap v1768: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:51:55.078 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=158258 2024-02-05T07:51:55.078 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool set-quota 978227f4-3b71-45f5-b8b8-2286bb55bbcd max_objects 100 2024-02-05T07:51:55.079 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 978227f4-3b71-45f5-b8b8-2286bb55bbcd put onemore /etc/passwd 2024-02-05T07:51:55.177 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.175+0000 7ff27f197640 1 -- 172.21.15.184:0/1518161244 >> v1:172.21.15.188:6789/0 conn(0x7ff278068580 legacy=0x7ff278068960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:55.177 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.175+0000 7ff27f197640 1 -- 172.21.15.184:0/1518161244 shutdown_connections 2024-02-05T07:51:55.177 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.175+0000 7ff27f197640 1 -- 172.21.15.184:0/1518161244 >> 172.21.15.184:0/1518161244 conn(0x7ff278075ae0 msgr2=0x7ff278075ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:51:55.177 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.175+0000 7ff27f197640 1 -- 172.21.15.184:0/1518161244 shutdown_connections 2024-02-05T07:51:55.177 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.175+0000 7ff27f197640 1 -- 172.21.15.184:0/1518161244 wait complete. 2024-02-05T07:51:55.177 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.176+0000 7ff27f197640 1 Processor -- start 2024-02-05T07:51:55.177 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.176+0000 7ff27f197640 1 -- start start 2024-02-05T07:51:55.179 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.176+0000 7ff27f197640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff2781a8150 con 0x7ff278109fb0 2024-02-05T07:51:55.179 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.176+0000 7ff27f197640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff2781a9350 con 0x7ff27810daf0 2024-02-05T07:51:55.180 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.176+0000 7ff27f197640 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff2781aa550 con 0x7ff278068580 2024-02-05T07:51:55.180 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.176+0000 7ff277fff640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7ff278109fb0 0x7ff2781a3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:39456/0 (socket says 172.21.15.184:39456) 2024-02-05T07:51:55.180 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.176+0000 7ff277fff640 1 -- 172.21.15.184:0/3398505886 learned_addr learned my addr 172.21.15.184:0/3398505886 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:51:55.180 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.176+0000 7ff27cf33640 1 --1- 172.21.15.184:0/3398505886 >> v1:172.21.15.184:6790/0 conn(0x7ff278068580 0x7ff278106500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:53364/0 (socket says 172.21.15.184:53364) 2024-02-05T07:51:55.180 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663685845 0 0) 0x7ff2781aa550 con 0x7ff278068580 2024-02-05T07:51:55.180 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff260004950 con 0x7ff278068580 2024-02-05T07:51:55.180 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2659257771 0 0) 0x7ff2781a8150 con 0x7ff278109fb0 2024-02-05T07:51:55.180 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2781aa550 con 0x7ff278109fb0 2024-02-05T07:51:55.180 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220889982 0 0) 0x7ff2781a9350 con 0x7ff27810daf0 2024-02-05T07:51:55.180 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2781a8150 con 0x7ff27810daf0 2024-02-05T07:51:55.180 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2812566089 0 0) 0x7ff260004950 con 0x7ff278068580 2024-02-05T07:51:55.180 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff2781a9350 con 0x7ff278068580 2024-02-05T07:51:55.180 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1410822333 0 0) 0x7ff2781aa550 con 0x7ff278109fb0 2024-02-05T07:51:55.181 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff260004950 con 0x7ff278109fb0 2024-02-05T07:51:55.181 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7ff2680045e0 con 0x7ff278068580 2024-02-05T07:51:55.181 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7ff26c0017b0 con 0x7ff278109fb0 2024-02-05T07:51:55.181 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3084095500 0 0) 0x7ff2781a9350 con 0x7ff278068580 2024-02-05T07:51:55.181 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 >> v1:172.21.15.188:6789/0 conn(0x7ff27810daf0 legacy=0x7ff2781a6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:55.181 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 >> v1:172.21.15.184:6789/0 conn(0x7ff278109fb0 legacy=0x7ff2781a3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:55.181 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2781ab750 con 0x7ff278068580 2024-02-05T07:51:55.181 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff27f197640 1 -- 172.21.15.184:0/3398505886 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2781aa740 con 0x7ff278068580 2024-02-05T07:51:55.181 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7ff268001b90 con 0x7ff278068580 2024-02-05T07:51:55.181 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7ff268004f40 con 0x7ff278068580 2024-02-05T07:51:55.181 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.177+0000 7ff27f197640 1 -- 172.21.15.184:0/3398505886 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2781aabd0 con 0x7ff278068580 2024-02-05T07:51:55.181 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.178+0000 7ff27f197640 1 -- 172.21.15.184:0/3398505886 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2781027d0 con 0x7ff278068580 2024-02-05T07:51:55.181 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.179+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7ff2680050a0 con 0x7ff278068580 2024-02-05T07:51:55.182 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.179+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(818..818 src has 253..818) v4 ==== 7818+0+0 (unknown 2988842420 0 0) 0x7ff268089120 con 0x7ff278068580 2024-02-05T07:51:55.182 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.179+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=819}) v3 -- 0x7ff2781a9350 con 0x7ff278068580 2024-02-05T07:51:55.185 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.184+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7ff268055e10 con 0x7ff278068580 2024-02-05T07:51:55.363 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:55.362+0000 7ff27f197640 1 -- 172.21.15.184:0/3398505886 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7ff2781016c0 con 0x7ff278068580 2024-02-05T07:51:56.373 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:56.372+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.2 v1:172.21.15.184:6790/0 10 ==== osd_map(819..819 src has 253..819) v4 ==== 628+0+0 (unknown 4205016718 0 0) 0x7ff268056740 con 0x7ff278068580 2024-02-05T07:51:56.373 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:56.372+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=820}) v3 -- 0x7ff260004950 con 0x7ff278068580 2024-02-05T07:51:56.376 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:56.375+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.2 v1:172.21.15.184:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd v819) v1 ==== 225+0+0 (unknown 3103402117 0 0) 0x7ff268054180 con 0x7ff278068580 2024-02-05T07:51:56.485 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:56.484+0000 7ff27f197640 1 -- 172.21.15.184:0/3398505886 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7ff278114a50 con 0x7ff278068580 2024-02-05T07:51:56.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:56 smithi188 ceph-mon[33283]: pgmap v1769: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:51:56.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:56 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3398505886' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]: dispatch 2024-02-05T07:51:56.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:56 smithi188 ceph-mon[33283]: from='client.58451 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]: dispatch 2024-02-05T07:51:56.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:56 smithi184 ceph-mon[29861]: pgmap v1769: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:51:56.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:56 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3398505886' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]: dispatch 2024-02-05T07:51:56.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:56 smithi184 ceph-mon[29861]: from='client.58451 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]: dispatch 2024-02-05T07:51:56.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:56 smithi184 ceph-mon[41609]: pgmap v1769: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:51:56.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:56 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3398505886' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]: dispatch 2024-02-05T07:51:56.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:56 smithi184 ceph-mon[41609]: from='client.58451 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]: dispatch 2024-02-05T07:51:57.377 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:57.376+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.2 v1:172.21.15.184:6790/0 12 ==== osd_map(820..820 src has 253..820) v4 ==== 628+0+0 (unknown 1777274973 0 0) 0x7ff26805a190 con 0x7ff278068580 2024-02-05T07:51:57.378 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:57.376+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=821}) v3 -- 0x7ff2781a8150 con 0x7ff278068580 2024-02-05T07:51:57.383 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:57.382+0000 7ff275ffb640 1 -- 172.21.15.184:0/3398505886 <== mon.2 v1:172.21.15.184:6790/0 13 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd v820) v1 ==== 225+0+0 (unknown 1649647085 0 0) 0x7ff2680559a0 con 0x7ff278068580 2024-02-05T07:51:57.383 INFO:tasks.workunit.client.0.smithi184.stderr:set-quota max_objects = 100 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd 2024-02-05T07:51:57.386 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:57.385+0000 7ff27f197640 1 -- 172.21.15.184:0/3398505886 >> v1:172.21.15.184:6800/103463156 conn(0x7ff26006e780 legacy=0x7ff260070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:57.386 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:57.385+0000 7ff27f197640 1 -- 172.21.15.184:0/3398505886 >> v1:172.21.15.184:6790/0 conn(0x7ff278068580 legacy=0x7ff278106500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:51:57.386 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:57.385+0000 7ff27f197640 1 -- 172.21.15.184:0/3398505886 shutdown_connections 2024-02-05T07:51:57.386 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:57.385+0000 7ff27f197640 1 -- 172.21.15.184:0/3398505886 >> 172.21.15.184:0/3398505886 conn(0x7ff278075ae0 msgr2=0x7ff278111240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:51:57.386 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:57.385+0000 7ff27f197640 1 -- 172.21.15.184:0/3398505886 shutdown_connections 2024-02-05T07:51:57.387 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:51:57.385+0000 7ff27f197640 1 -- 172.21.15.184:0/3398505886 wait complete. 2024-02-05T07:51:57.397 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 158258 2024-02-05T07:51:57.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:57 smithi188 ceph-mon[33283]: from='client.58451 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]': finished 2024-02-05T07:51:57.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:57 smithi188 ceph-mon[33283]: osdmap e819: 8 total, 8 up, 8 in 2024-02-05T07:51:57.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:57 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3398505886' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]: dispatch 2024-02-05T07:51:57.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:57 smithi188 ceph-mon[33283]: from='client.58451 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]: dispatch 2024-02-05T07:51:57.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:57 smithi184 ceph-mon[29861]: from='client.58451 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]': finished 2024-02-05T07:51:57.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:57 smithi184 ceph-mon[29861]: osdmap e819: 8 total, 8 up, 8 in 2024-02-05T07:51:57.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:57 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3398505886' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]: dispatch 2024-02-05T07:51:57.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:57 smithi184 ceph-mon[29861]: from='client.58451 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]: dispatch 2024-02-05T07:51:57.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:57 smithi184 ceph-mon[41609]: from='client.58451 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]': finished 2024-02-05T07:51:57.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:57 smithi184 ceph-mon[41609]: osdmap e819: 8 total, 8 up, 8 in 2024-02-05T07:51:57.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:57 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3398505886' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]: dispatch 2024-02-05T07:51:57.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:57 smithi184 ceph-mon[41609]: from='client.58451 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]: dispatch 2024-02-05T07:51:58.649 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:58 smithi188 ceph-mon[33283]: pgmap v1771: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:51:58.649 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:58 smithi188 ceph-mon[33283]: from='client.58451 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]': finished 2024-02-05T07:51:58.650 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:51:58 smithi188 ceph-mon[33283]: osdmap e820: 8 total, 8 up, 8 in 2024-02-05T07:51:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:58 smithi184 ceph-mon[29861]: pgmap v1771: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:51:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:58 smithi184 ceph-mon[29861]: from='client.58451 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]': finished 2024-02-05T07:51:58.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:51:58 smithi184 ceph-mon[29861]: osdmap e820: 8 total, 8 up, 8 in 2024-02-05T07:51:58.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:58 smithi184 ceph-mon[41609]: pgmap v1771: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:51:58.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:58 smithi184 ceph-mon[41609]: from='client.58451 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "100"}]': finished 2024-02-05T07:51:58.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:51:58 smithi184 ceph-mon[41609]: osdmap e820: 8 total, 8 up, 8 in 2024-02-05T07:51:59.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:51:59 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:52:00.357 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 0 -ne 0 ']' 2024-02-05T07:52:00.357 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-02-05T07:52:00.357 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 978227f4-3b71-45f5-b8b8-2286bb55bbcd put twomore /etc/passwd 2024-02-05T07:52:00.400 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool set-quota 978227f4-3b71-45f5-b8b8-2286bb55bbcd max_bytes 100 2024-02-05T07:52:00.486 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.482+0000 7f293c702640 1 -- 172.21.15.184:0/2882698827 >> v1:172.21.15.184:6789/0 conn(0x7f293410c1a0 legacy=0x7f293410e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:00.487 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.482+0000 7f293c702640 1 -- 172.21.15.184:0/2882698827 shutdown_connections 2024-02-05T07:52:00.487 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.482+0000 7f293c702640 1 -- 172.21.15.184:0/2882698827 >> 172.21.15.184:0/2882698827 conn(0x7f29340752c0 msgr2=0x7f29340756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:52:00.487 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.482+0000 7f293c702640 1 -- 172.21.15.184:0/2882698827 shutdown_connections 2024-02-05T07:52:00.487 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.483+0000 7f293c702640 1 -- 172.21.15.184:0/2882698827 wait complete. 2024-02-05T07:52:00.487 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.483+0000 7f293c702640 1 Processor -- start 2024-02-05T07:52:00.487 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.483+0000 7f293c702640 1 -- start start 2024-02-05T07:52:00.487 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.483+0000 7f293c702640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f29341a6090 con 0x7f293410c1a0 2024-02-05T07:52:00.487 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.483+0000 7f293c702640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f29341a7290 con 0x7f2934105730 2024-02-05T07:52:00.487 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.483+0000 7f293c702640 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f29341a8490 con 0x7f29341085d0 2024-02-05T07:52:00.487 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.483+0000 7f2939c9d640 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f29341085d0 0x7f29340ff390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:34846/0 (socket says 172.21.15.184:34846) 2024-02-05T07:52:00.487 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.483+0000 7f2939c9d640 1 -- 172.21.15.184:0/3650214078 learned_addr learned my addr 172.21.15.184:0/3650214078 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:52:00.488 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.483+0000 7f293ac9f640 1 --1- 172.21.15.184:0/3650214078 >> v1:172.21.15.184:6789/0 conn(0x7f293410c1a0 0x7f29341a4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:46260/0 (socket says 172.21.15.184:46260) 2024-02-05T07:52:00.488 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339280828 0 0) 0x7f29341a8490 con 0x7f29341085d0 2024-02-05T07:52:00.488 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2920003520 con 0x7f29341085d0 2024-02-05T07:52:00.488 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869639168 0 0) 0x7f29341a6090 con 0x7f293410c1a0 2024-02-05T07:52:00.488 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29341a8490 con 0x7f293410c1a0 2024-02-05T07:52:00.488 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232728933 0 0) 0x7f29341a7290 con 0x7f2934105730 2024-02-05T07:52:00.488 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29341a6090 con 0x7f2934105730 2024-02-05T07:52:00.488 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3364985850 0 0) 0x7f2920003520 con 0x7f29341085d0 2024-02-05T07:52:00.488 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29341a7290 con 0x7f29341085d0 2024-02-05T07:52:00.488 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3227448582 0 0) 0x7f29341a8490 con 0x7f293410c1a0 2024-02-05T07:52:00.488 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2920003520 con 0x7f293410c1a0 2024-02-05T07:52:00.488 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f2924001970 con 0x7f29341085d0 2024-02-05T07:52:00.489 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f292c004770 con 0x7f293410c1a0 2024-02-05T07:52:00.489 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3444567632 0 0) 0x7f29341a6090 con 0x7f2934105730 2024-02-05T07:52:00.489 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f29341a8490 con 0x7f2934105730 2024-02-05T07:52:00.489 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f2930001830 con 0x7f2934105730 2024-02-05T07:52:00.489 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2715933858 0 0) 0x7f29341a7290 con 0x7f29341085d0 2024-02-05T07:52:00.489 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 >> v1:172.21.15.188:6789/0 conn(0x7f2934105730 legacy=0x7f29340fec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:00.489 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 >> v1:172.21.15.184:6789/0 conn(0x7f293410c1a0 legacy=0x7f29341a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:00.489 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29341a9690 con 0x7f29341085d0 2024-02-05T07:52:00.489 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f293c702640 1 -- 172.21.15.184:0/3650214078 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29341a6280 con 0x7f29341085d0 2024-02-05T07:52:00.489 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f293c702640 1 -- 172.21.15.184:0/3650214078 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f29341a6710 con 0x7f29341085d0 2024-02-05T07:52:00.489 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f2924003a80 con 0x7f29341085d0 2024-02-05T07:52:00.489 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.484+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f2924005b80 con 0x7f29341085d0 2024-02-05T07:52:00.489 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.485+0000 7f293c702640 1 -- 172.21.15.184:0/3650214078 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2918005080 con 0x7f29341085d0 2024-02-05T07:52:00.490 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.485+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f29240035f0 con 0x7f29341085d0 2024-02-05T07:52:00.490 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.486+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(821..821 src has 253..821) v4 ==== 7818+0+0 (unknown 4287146125 0 0) 0x7f2924088ca0 con 0x7f29341085d0 2024-02-05T07:52:00.491 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.491+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f2924055a90 con 0x7f29341085d0 2024-02-05T07:52:00.668 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:00.667+0000 7f293c702640 1 -- 172.21.15.184:0/3650214078 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7f2918005330 con 0x7f29341085d0 2024-02-05T07:52:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:00 smithi188 ceph-mon[33283]: pgmap v1773: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:00 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:00 smithi188 ceph-mon[33283]: pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' no longer out of quota; removing NO_QUOTA flag 2024-02-05T07:52:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:00 smithi188 ceph-mon[33283]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-05T07:52:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:00 smithi188 ceph-mon[33283]: osdmap e821: 8 total, 8 up, 8 in 2024-02-05T07:52:00.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:00 smithi184 ceph-mon[29861]: pgmap v1773: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:00.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:00 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:00.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:00 smithi184 ceph-mon[29861]: pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' no longer out of quota; removing NO_QUOTA flag 2024-02-05T07:52:00.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:00 smithi184 ceph-mon[29861]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-05T07:52:00.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:00 smithi184 ceph-mon[29861]: osdmap e821: 8 total, 8 up, 8 in 2024-02-05T07:52:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:00 smithi184 ceph-mon[41609]: pgmap v1773: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:00 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:00 smithi184 ceph-mon[41609]: pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' no longer out of quota; removing NO_QUOTA flag 2024-02-05T07:52:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:00 smithi184 ceph-mon[41609]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-05T07:52:00.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:00 smithi184 ceph-mon[41609]: osdmap e821: 8 total, 8 up, 8 in 2024-02-05T07:52:01.401 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:01.400+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.2 v1:172.21.15.184:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd v822) v1 ==== 221+0+0 (unknown 1689165329 0 0) 0x7f2924053e00 con 0x7f29341085d0 2024-02-05T07:52:01.509 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:01.508+0000 7f293c702640 1 -- 172.21.15.184:0/3650214078 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7f2918000c40 con 0x7f29341085d0 2024-02-05T07:52:01.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:01 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:52:01.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:01 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:52:01.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:01 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3650214078' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-05T07:52:01.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:01 smithi188 ceph-mon[33283]: from='client.58463 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-05T07:52:01.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:01 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:52:01.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:01 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:52:01.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:01 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3650214078' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-05T07:52:01.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:01 smithi184 ceph-mon[29861]: from='client.58463 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-05T07:52:01.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:01 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:52:01.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:01 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:52:01.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:01 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3650214078' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-05T07:52:01.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:01 smithi184 ceph-mon[41609]: from='client.58463 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-05T07:52:02.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:52:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:52:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:52:02.409 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:02.408+0000 7f292b7fe640 1 -- 172.21.15.184:0/3650214078 <== mon.2 v1:172.21.15.184:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd v823) v1 ==== 221+0+0 (unknown 3841871856 0 0) 0x7f2924053e00 con 0x7f29341085d0 2024-02-05T07:52:02.409 INFO:tasks.workunit.client.0.smithi184.stderr:set-quota max_bytes = 100 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd 2024-02-05T07:52:02.412 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:02.411+0000 7f293c702640 1 -- 172.21.15.184:0/3650214078 >> v1:172.21.15.184:6800/103463156 conn(0x7f292006e960 legacy=0x7f2920070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:02.412 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:02.411+0000 7f293c702640 1 -- 172.21.15.184:0/3650214078 >> v1:172.21.15.184:6790/0 conn(0x7f29341085d0 legacy=0x7f29340ff390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:02.412 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:02.411+0000 7f293c702640 1 -- 172.21.15.184:0/3650214078 shutdown_connections 2024-02-05T07:52:02.412 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:02.411+0000 7f293c702640 1 -- 172.21.15.184:0/3650214078 >> 172.21.15.184:0/3650214078 conn(0x7f29340752c0 msgr2=0x7f2934067b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:52:02.412 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:02.411+0000 7f293c702640 1 -- 172.21.15.184:0/3650214078 shutdown_connections 2024-02-05T07:52:02.412 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:02.411+0000 7f293c702640 1 -- 172.21.15.184:0/3650214078 wait complete. 2024-02-05T07:52:02.423 INFO:tasks.workunit.client.0.smithi184.stderr:+ sleep 30 2024-02-05T07:52:02.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:02 smithi188 ceph-mon[33283]: pgmap v1775: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:02.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:02 smithi188 ceph-mon[33283]: from='client.58463 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]': finished 2024-02-05T07:52:02.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:02 smithi188 ceph-mon[33283]: osdmap e822: 8 total, 8 up, 8 in 2024-02-05T07:52:02.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:02 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3650214078' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-05T07:52:02.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:02 smithi188 ceph-mon[33283]: from='client.58463 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-05T07:52:02.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:02 smithi184 ceph-mon[29861]: pgmap v1775: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:02.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:02 smithi184 ceph-mon[29861]: from='client.58463 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]': finished 2024-02-05T07:52:02.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:02 smithi184 ceph-mon[29861]: osdmap e822: 8 total, 8 up, 8 in 2024-02-05T07:52:02.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:02 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3650214078' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-05T07:52:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:02 smithi184 ceph-mon[29861]: from='client.58463 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-05T07:52:02.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:02 smithi184 ceph-mon[41609]: pgmap v1775: 176 pgs: 176 active+clean; 695 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:02.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:02 smithi184 ceph-mon[41609]: from='client.58463 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]': finished 2024-02-05T07:52:02.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:02 smithi184 ceph-mon[41609]: osdmap e822: 8 total, 8 up, 8 in 2024-02-05T07:52:02.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:02 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3650214078' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-05T07:52:02.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:02 smithi184 ceph-mon[41609]: from='client.58463 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-05T07:52:03.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:03 smithi188 ceph-mon[33283]: from='client.58463 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]': finished 2024-02-05T07:52:03.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:03 smithi188 ceph-mon[33283]: osdmap e823: 8 total, 8 up, 8 in 2024-02-05T07:52:03.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:03 smithi184 ceph-mon[29861]: from='client.58463 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]': finished 2024-02-05T07:52:03.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:03 smithi184 ceph-mon[29861]: osdmap e823: 8 total, 8 up, 8 in 2024-02-05T07:52:03.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:03 smithi184 ceph-mon[41609]: from='client.58463 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "100"}]': finished 2024-02-05T07:52:03.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:03 smithi184 ceph-mon[41609]: osdmap e823: 8 total, 8 up, 8 in 2024-02-05T07:52:04.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:04 smithi188 ceph-mon[33283]: pgmap v1778: 176 pgs: 176 active+clean; 717 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.8 KiB/s rd, 4.4 KiB/s wr, 2 op/s 2024-02-05T07:52:04.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:04 smithi184 ceph-mon[29861]: pgmap v1778: 176 pgs: 176 active+clean; 717 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.8 KiB/s rd, 4.4 KiB/s wr, 2 op/s 2024-02-05T07:52:04.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:04 smithi184 ceph-mon[41609]: pgmap v1778: 176 pgs: 176 active+clean; 717 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 1.8 KiB/s rd, 4.4 KiB/s wr, 2 op/s 2024-02-05T07:52:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:05 smithi188 ceph-mon[33283]: pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' is full (reached quota's max_bytes: 100 B) 2024-02-05T07:52:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:05 smithi188 ceph-mon[33283]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-05T07:52:05.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:05 smithi188 ceph-mon[33283]: osdmap e824: 8 total, 8 up, 8 in 2024-02-05T07:52:05.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:05 smithi184 ceph-mon[29861]: pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' is full (reached quota's max_bytes: 100 B) 2024-02-05T07:52:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:05 smithi184 ceph-mon[29861]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-05T07:52:05.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:05 smithi184 ceph-mon[29861]: osdmap e824: 8 total, 8 up, 8 in 2024-02-05T07:52:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:05 smithi184 ceph-mon[41609]: pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' is full (reached quota's max_bytes: 100 B) 2024-02-05T07:52:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:05 smithi184 ceph-mon[41609]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-05T07:52:05.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:05 smithi184 ceph-mon[41609]: osdmap e824: 8 total, 8 up, 8 in 2024-02-05T07:52:06.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:06 smithi188 ceph-mon[33283]: pgmap v1779: 176 pgs: 176 active+clean; 717 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-02-05T07:52:06.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:06 smithi184 ceph-mon[29861]: pgmap v1779: 176 pgs: 176 active+clean; 717 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-02-05T07:52:06.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:06 smithi184 ceph-mon[41609]: pgmap v1779: 176 pgs: 176 active+clean; 717 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-02-05T07:52:08.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:08 smithi188 ceph-mon[33283]: pgmap v1781: 176 pgs: 176 active+clean; 717 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-02-05T07:52:08.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:08 smithi184 ceph-mon[29861]: pgmap v1781: 176 pgs: 176 active+clean; 717 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-02-05T07:52:08.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:08 smithi184 ceph-mon[41609]: pgmap v1781: 176 pgs: 176 active+clean; 717 KiB data, 898 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 4.0 KiB/s wr, 1 op/s 2024-02-05T07:52:09.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:52:09 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:52:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:10 smithi188 ceph-mon[33283]: pgmap v1782: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-02-05T07:52:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:10 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:10.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:10 smithi184 ceph-mon[29861]: pgmap v1782: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-02-05T07:52:10.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:10 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:10 smithi184 ceph-mon[41609]: pgmap v1782: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 3.2 KiB/s wr, 1 op/s 2024-02-05T07:52:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:10 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:12.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:52:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:52:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:52:12.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:12 smithi188 ceph-mon[33283]: pgmap v1783: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.9 KiB/s wr, 1 op/s 2024-02-05T07:52:12.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:12 smithi184 ceph-mon[29861]: pgmap v1783: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.9 KiB/s wr, 1 op/s 2024-02-05T07:52:12.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:12 smithi184 ceph-mon[41609]: pgmap v1783: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.9 KiB/s wr, 1 op/s 2024-02-05T07:52:14.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:14 smithi188 ceph-mon[33283]: pgmap v1784: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:52:14.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:14 smithi184 ceph-mon[29861]: pgmap v1784: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:52:14.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:14 smithi184 ceph-mon[41609]: pgmap v1784: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:52:16.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:16 smithi188 ceph-mon[33283]: pgmap v1785: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:52:16.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:16 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:52:16.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:16 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:52:16.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:16 smithi184 ceph-mon[29861]: pgmap v1785: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:52:16.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:16 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:52:16.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:16 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:52:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:16 smithi184 ceph-mon[41609]: pgmap v1785: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:52:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:16 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:52:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:16 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:52:17.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:17 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:52:17.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:17 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:52:17.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:17 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:52:18.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:18 smithi188 ceph-mon[33283]: pgmap v1786: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 894 B/s rd, 0 op/s 2024-02-05T07:52:18.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:18 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:52:18.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:18 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:52:18.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:18 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:52:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:18 smithi184 ceph-mon[29861]: pgmap v1786: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 894 B/s rd, 0 op/s 2024-02-05T07:52:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:18 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:52:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:18 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:52:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:18 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:52:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:18 smithi184 ceph-mon[41609]: pgmap v1786: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 894 B/s rd, 0 op/s 2024-02-05T07:52:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:18 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:52:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:18 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:52:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:18 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:52:19.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:52:19 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:52:20.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:20 smithi188 ceph-mon[33283]: pgmap v1787: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:20.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:20 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:20.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:20 smithi184 ceph-mon[29861]: pgmap v1787: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:20.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:20 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:20.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:20 smithi184 ceph-mon[41609]: pgmap v1787: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:20.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:20 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:52:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:52:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:52:22.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:22 smithi188 ceph-mon[33283]: pgmap v1788: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:22.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:22 smithi184 ceph-mon[29861]: pgmap v1788: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:22.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:22 smithi184 ceph-mon[41609]: pgmap v1788: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:24.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:24 smithi188 ceph-mon[33283]: pgmap v1789: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:24.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:24 smithi184 ceph-mon[29861]: pgmap v1789: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:24.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:24 smithi184 ceph-mon[41609]: pgmap v1789: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:26.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:26 smithi188 ceph-mon[33283]: pgmap v1790: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:26.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:26 smithi184 ceph-mon[29861]: pgmap v1790: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:26.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:26 smithi184 ceph-mon[41609]: pgmap v1790: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:28.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:28 smithi188 ceph-mon[33283]: pgmap v1791: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:28.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:28 smithi184 ceph-mon[29861]: pgmap v1791: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:28.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:28 smithi184 ceph-mon[41609]: pgmap v1791: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:29.498 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:52:29 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:52:30.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:30 smithi188 ceph-mon[33283]: pgmap v1792: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:30.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:30 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:30.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:52:30.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:30 smithi184 ceph-mon[41609]: pgmap v1792: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:30.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:30 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:30.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:52:30.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:30 smithi184 ceph-mon[29861]: pgmap v1792: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:30.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:30 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:30.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:52:32.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:52:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:52:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:52:32.424 INFO:tasks.workunit.client.0.smithi184.stderr:+ pid=158477 2024-02-05T07:52:32.425 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool set-quota 978227f4-3b71-45f5-b8b8-2286bb55bbcd max_bytes 0 2024-02-05T07:52:32.425 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 978227f4-3b71-45f5-b8b8-2286bb55bbcd put two /etc/passwd 2024-02-05T07:52:32.522 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.518+0000 7f226d427640 1 -- 172.21.15.184:0/345977055 >> v1:172.21.15.184:6789/0 conn(0x7f226810db60 legacy=0x7f226810fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:32.522 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.518+0000 7f226d427640 1 -- 172.21.15.184:0/345977055 shutdown_connections 2024-02-05T07:52:32.522 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.518+0000 7f226d427640 1 -- 172.21.15.184:0/345977055 >> 172.21.15.184:0/345977055 conn(0x7f22680fba30 msgr2=0x7f22680fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:52:32.522 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.518+0000 7f226d427640 1 -- 172.21.15.184:0/345977055 shutdown_connections 2024-02-05T07:52:32.522 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.518+0000 7f226d427640 1 -- 172.21.15.184:0/345977055 wait complete. 2024-02-05T07:52:32.523 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.518+0000 7f226d427640 1 Processor -- start 2024-02-05T07:52:32.523 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.518+0000 7f226d427640 1 -- start start 2024-02-05T07:52:32.523 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f226d427640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f22681a5ed0 con 0x7f226810db60 2024-02-05T07:52:32.523 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f226d427640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f22681a70d0 con 0x7f226810a050 2024-02-05T07:52:32.523 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f226d427640 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f22681a82d0 con 0x7f2268102250 2024-02-05T07:52:32.523 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2266ffd640 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f2268102250 0x7f2268109750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:57032/0 (socket says 172.21.15.184:57032) 2024-02-05T07:52:32.523 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2266ffd640 1 -- 172.21.15.184:0/747521047 learned_addr learned my addr 172.21.15.184:0/747521047 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:52:32.523 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136422381 0 0) 0x7f22681a5ed0 con 0x7f226810db60 2024-02-05T07:52:32.523 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2254004950 con 0x7f226810db60 2024-02-05T07:52:32.523 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 957775798 0 0) 0x7f22681a82d0 con 0x7f2268102250 2024-02-05T07:52:32.523 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22681a5ed0 con 0x7f2268102250 2024-02-05T07:52:32.523 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744311930 0 0) 0x7f22681a70d0 con 0x7f226810a050 2024-02-05T07:52:32.523 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22681a82d0 con 0x7f226810a050 2024-02-05T07:52:32.523 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 740852117 0 0) 0x7f2254004950 con 0x7f226810db60 2024-02-05T07:52:32.524 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f22681a70d0 con 0x7f226810db60 2024-02-05T07:52:32.524 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f22600012d0 con 0x7f226810db60 2024-02-05T07:52:32.524 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1263925505 0 0) 0x7f22681a5ed0 con 0x7f2268102250 2024-02-05T07:52:32.524 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2254004950 con 0x7f2268102250 2024-02-05T07:52:32.524 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 213193925 0 0) 0x7f22681a82d0 con 0x7f226810a050 2024-02-05T07:52:32.524 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f22681a5ed0 con 0x7f226810a050 2024-02-05T07:52:32.524 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f22580018b0 con 0x7f2268102250 2024-02-05T07:52:32.524 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f2250001850 con 0x7f226810a050 2024-02-05T07:52:32.524 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3502952037 0 0) 0x7f22681a70d0 con 0x7f226810db60 2024-02-05T07:52:32.524 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 >> v1:172.21.15.184:6790/0 conn(0x7f2268102250 legacy=0x7f2268109750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:32.524 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 >> v1:172.21.15.188:6789/0 conn(0x7f226810a050 legacy=0x7f22681a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:32.524 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.519+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22681a94d0 con 0x7f226810db60 2024-02-05T07:52:32.525 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.520+0000 7f226d427640 1 -- 172.21.15.184:0/747521047 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22681a84c0 con 0x7f226810db60 2024-02-05T07:52:32.525 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.520+0000 7f226d427640 1 -- 172.21.15.184:0/747521047 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f22681a8950 con 0x7f226810db60 2024-02-05T07:52:32.525 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.520+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f2260001d80 con 0x7f226810db60 2024-02-05T07:52:32.525 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.520+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f2260005010 con 0x7f226810db60 2024-02-05T07:52:32.525 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.521+0000 7f226d427640 1 -- 172.21.15.184:0/747521047 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2248005080 con 0x7f226810db60 2024-02-05T07:52:32.525 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.521+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f2260001690 con 0x7f226810db60 2024-02-05T07:52:32.525 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.521+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(824..824 src has 253..824) v4 ==== 7818+0+0 (unknown 4196533079 0 0) 0x7f2260088260 con 0x7f226810db60 2024-02-05T07:52:32.525 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.522+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=825}) v3 -- 0x7f22681a70d0 con 0x7f226810db60 2024-02-05T07:52:32.527 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.526+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f2260054ef0 con 0x7f226810db60 2024-02-05T07:52:32.704 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:32.703+0000 7f226d427640 1 -- 172.21.15.184:0/747521047 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f2248005330 con 0x7f226810db60 2024-02-05T07:52:32.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:32 smithi188 ceph-mon[33283]: pgmap v1793: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:32.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:32 smithi184 ceph-mon[29861]: pgmap v1793: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:32.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:32 smithi184 ceph-mon[41609]: pgmap v1793: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:33.437 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:33.436+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd v825) v1 ==== 217+0+0 (unknown 3959107203 0 0) 0x7f2260053260 con 0x7f226810db60 2024-02-05T07:52:33.442 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:33.441+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.0 v1:172.21.15.184:6789/0 11 ==== osd_map(825..825 src has 253..825) v4 ==== 628+0+0 (unknown 4196890301 0 0) 0x7f2260055820 con 0x7f226810db60 2024-02-05T07:52:33.442 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:33.441+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=826}) v3 -- 0x7f22681a82d0 con 0x7f226810db60 2024-02-05T07:52:33.550 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:33.549+0000 7f226d427640 1 -- 172.21.15.184:0/747521047 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f2248000c40 con 0x7f226810db60 2024-02-05T07:52:33.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:33 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/747521047' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:52:33.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:33 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/747521047' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:52:33.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:33 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/747521047' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:52:34.439 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.437+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.0 v1:172.21.15.184:6789/0 12 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd v826) v1 ==== 217+0+0 (unknown 2650426912 0 0) 0x7f2260054a80 con 0x7f226810db60 2024-02-05T07:52:34.439 INFO:tasks.workunit.client.0.smithi184.stderr:set-quota max_bytes = 0 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd 2024-02-05T07:52:34.443 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.440+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 <== mon.0 v1:172.21.15.184:6789/0 13 ==== osd_map(826..826 src has 253..826) v4 ==== 628+0+0 (unknown 1582908748 0 0) 0x7f226005d8c0 con 0x7f226810db60 2024-02-05T07:52:34.443 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.440+0000 7f2264ff9640 1 -- 172.21.15.184:0/747521047 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=827}) v3 -- 0x7f225407be30 con 0x7f226810db60 2024-02-05T07:52:34.443 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.440+0000 7f226d427640 1 -- 172.21.15.184:0/747521047 >> v1:172.21.15.184:6800/103463156 conn(0x7f225406ec60 legacy=0x7f2254071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:34.443 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.440+0000 7f226d427640 1 -- 172.21.15.184:0/747521047 >> v1:172.21.15.184:6789/0 conn(0x7f226810db60 legacy=0x7f22681a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:34.443 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.441+0000 7f226d427640 1 -- 172.21.15.184:0/747521047 shutdown_connections 2024-02-05T07:52:34.443 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.441+0000 7f226d427640 1 -- 172.21.15.184:0/747521047 >> 172.21.15.184:0/747521047 conn(0x7f22680fba30 msgr2=0x7f226810ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:52:34.443 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.442+0000 7f226d427640 1 -- 172.21.15.184:0/747521047 shutdown_connections 2024-02-05T07:52:34.443 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.443+0000 7f226d427640 1 -- 172.21.15.184:0/747521047 wait complete. 2024-02-05T07:52:34.459 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool set-quota 978227f4-3b71-45f5-b8b8-2286bb55bbcd max_objects 0 2024-02-05T07:52:34.546 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.543+0000 7f8e53132640 1 -- 172.21.15.184:0/612772868 >> v1:172.21.15.184:6790/0 conn(0x7f8e4c100330 legacy=0x7f8e4c100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:34.547 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.543+0000 7f8e53132640 1 -- 172.21.15.184:0/612772868 shutdown_connections 2024-02-05T07:52:34.547 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.543+0000 7f8e53132640 1 -- 172.21.15.184:0/612772868 >> 172.21.15.184:0/612772868 conn(0x7f8e4c075ae0 msgr2=0x7f8e4c075ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:52:34.547 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.543+0000 7f8e53132640 1 -- 172.21.15.184:0/612772868 shutdown_connections 2024-02-05T07:52:34.547 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.543+0000 7f8e53132640 1 -- 172.21.15.184:0/612772868 wait complete. 2024-02-05T07:52:34.547 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e53132640 1 Processor -- start 2024-02-05T07:52:34.547 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e53132640 1 -- start start 2024-02-05T07:52:34.547 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e53132640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8e4c1a5f50 con 0x7f8e4c10c9e0 2024-02-05T07:52:34.547 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e53132640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8e4c1a7150 con 0x7f8e4c108e70 2024-02-05T07:52:34.547 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e53132640 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f8e4c1a8350 con 0x7f8e4c100330 2024-02-05T07:52:34.547 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e50ece640 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f8e4c100330 0x7f8e4c105490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:57040/0 (socket says 172.21.15.184:57040) 2024-02-05T07:52:34.547 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e50ece640 1 -- 172.21.15.184:0/3343775219 learned_addr learned my addr 172.21.15.184:0/3343775219 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:52:34.547 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3255710601 0 0) 0x7f8e4c1a8350 con 0x7f8e4c100330 2024-02-05T07:52:34.547 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e3c003520 con 0x7f8e4c100330 2024-02-05T07:52:34.547 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1229576523 0 0) 0x7f8e4c1a5f50 con 0x7f8e4c10c9e0 2024-02-05T07:52:34.548 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e4c1a8350 con 0x7f8e4c10c9e0 2024-02-05T07:52:34.548 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170947476 0 0) 0x7f8e4c1a7150 con 0x7f8e4c108e70 2024-02-05T07:52:34.548 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e4c1a5f50 con 0x7f8e4c108e70 2024-02-05T07:52:34.548 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4283748731 0 0) 0x7f8e3c003520 con 0x7f8e4c100330 2024-02-05T07:52:34.548 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8e4c1a7150 con 0x7f8e4c100330 2024-02-05T07:52:34.548 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f8e40004540 con 0x7f8e4c100330 2024-02-05T07:52:34.548 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 579155168 0 0) 0x7f8e4c1a8350 con 0x7f8e4c10c9e0 2024-02-05T07:52:34.548 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8e3c003520 con 0x7f8e4c10c9e0 2024-02-05T07:52:34.548 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.544+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f8e44001af0 con 0x7f8e4c10c9e0 2024-02-05T07:52:34.548 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.545+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1857496677 0 0) 0x7f8e4c1a7150 con 0x7f8e4c100330 2024-02-05T07:52:34.548 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.545+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 >> v1:172.21.15.188:6789/0 conn(0x7f8e4c108e70 legacy=0x7f8e4c1a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:34.548 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.545+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 >> v1:172.21.15.184:6789/0 conn(0x7f8e4c10c9e0 legacy=0x7f8e4c1a4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:34.548 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.545+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e4c1a9550 con 0x7f8e4c100330 2024-02-05T07:52:34.549 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.545+0000 7f8e53132640 1 -- 172.21.15.184:0/3343775219 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e4c1a6140 con 0x7f8e4c100330 2024-02-05T07:52:34.549 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.545+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f8e40001b10 con 0x7f8e4c100330 2024-02-05T07:52:34.549 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.545+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f8e40005040 con 0x7f8e4c100330 2024-02-05T07:52:34.549 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.545+0000 7f8e53132640 1 -- 172.21.15.184:0/3343775219 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e4c1a65d0 con 0x7f8e4c100330 2024-02-05T07:52:34.549 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.546+0000 7f8e53132640 1 -- 172.21.15.184:0/3343775219 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e4c1016c0 con 0x7f8e4c100330 2024-02-05T07:52:34.550 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.546+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f8e400052f0 con 0x7f8e4c100330 2024-02-05T07:52:34.550 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.546+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(826..826 src has 253..826) v4 ==== 7818+0+0 (unknown 293110375 0 0) 0x7f8e40089180 con 0x7f8e4c100330 2024-02-05T07:52:34.550 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.547+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=827}) v3 -- 0x7f8e4c1a7150 con 0x7f8e4c100330 2024-02-05T07:52:34.552 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.551+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f8e40055f50 con 0x7f8e4c100330 2024-02-05T07:52:34.726 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:34.724+0000 7f8e53132640 1 -- 172.21.15.184:0/3343775219 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f8e4c104ac0 con 0x7f8e4c100330 2024-02-05T07:52:34.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:34 smithi188 ceph-mon[33283]: pgmap v1794: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:34.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/747521047' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]': finished 2024-02-05T07:52:34.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:34 smithi188 ceph-mon[33283]: osdmap e825: 8 total, 8 up, 8 in 2024-02-05T07:52:34.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:34 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/747521047' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:52:34.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:34 smithi184 ceph-mon[29861]: pgmap v1794: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:34.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/747521047' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]': finished 2024-02-05T07:52:34.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:34 smithi184 ceph-mon[29861]: osdmap e825: 8 total, 8 up, 8 in 2024-02-05T07:52:34.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:34 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/747521047' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:52:34.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:34 smithi184 ceph-mon[41609]: pgmap v1794: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:34.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/747521047' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]': finished 2024-02-05T07:52:34.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:34 smithi184 ceph-mon[41609]: osdmap e825: 8 total, 8 up, 8 in 2024-02-05T07:52:34.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:34 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/747521047' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:52:35.352 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:35.351+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.2 v1:172.21.15.184:6790/0 10 ==== osd_map(827..827 src has 253..827) v4 ==== 628+0+0 (unknown 2150077353 0 0) 0x7f8e40056880 con 0x7f8e4c100330 2024-02-05T07:52:35.352 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:35.351+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=828}) v3 -- 0x7f8e4c1a5f50 con 0x7f8e4c100330 2024-02-05T07:52:35.356 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:35.355+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.2 v1:172.21.15.184:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd v827) v1 ==== 221+0+0 (unknown 2624074164 0 0) 0x7f8e400542c0 con 0x7f8e4c100330 2024-02-05T07:52:35.467 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:35.466+0000 7f8e53132640 1 -- 172.21.15.184:0/3343775219 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f8e4c067ec0 con 0x7f8e4c100330 2024-02-05T07:52:35.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/747521047' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]': finished 2024-02-05T07:52:35.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:35 smithi188 ceph-mon[33283]: osdmap e826: 8 total, 8 up, 8 in 2024-02-05T07:52:35.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:35 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3343775219' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:52:35.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:35 smithi188 ceph-mon[33283]: from='client.58484 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:52:35.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:35 smithi188 ceph-mon[33283]: pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' no longer out of quota; removing NO_QUOTA flag 2024-02-05T07:52:35.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:35 smithi188 ceph-mon[33283]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-05T07:52:35.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:35 smithi188 ceph-mon[33283]: from='client.58484 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]': finished 2024-02-05T07:52:35.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:35 smithi188 ceph-mon[33283]: osdmap e827: 8 total, 8 up, 8 in 2024-02-05T07:52:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/747521047' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]': finished 2024-02-05T07:52:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[29861]: osdmap e826: 8 total, 8 up, 8 in 2024-02-05T07:52:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3343775219' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:52:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[29861]: from='client.58484 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:52:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[29861]: pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' no longer out of quota; removing NO_QUOTA flag 2024-02-05T07:52:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[29861]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-05T07:52:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[29861]: from='client.58484 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]': finished 2024-02-05T07:52:35.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[29861]: osdmap e827: 8 total, 8 up, 8 in 2024-02-05T07:52:35.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/747521047' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]': finished 2024-02-05T07:52:35.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[41609]: osdmap e826: 8 total, 8 up, 8 in 2024-02-05T07:52:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3343775219' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:52:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[41609]: from='client.58484 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:52:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[41609]: pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' no longer out of quota; removing NO_QUOTA flag 2024-02-05T07:52:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[41609]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-05T07:52:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[41609]: from='client.58484 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]': finished 2024-02-05T07:52:35.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:35 smithi184 ceph-mon[41609]: osdmap e827: 8 total, 8 up, 8 in 2024-02-05T07:52:36.460 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.459+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.2 v1:172.21.15.184:6790/0 12 ==== osd_map(828..828 src has 253..828) v4 ==== 628+0+0 (unknown 3688499693 0 0) 0x7f8e4005a2d0 con 0x7f8e4c100330 2024-02-05T07:52:36.464 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.463+0000 7f8e49ffb640 1 -- 172.21.15.184:0/3343775219 <== mon.2 v1:172.21.15.184:6790/0 13 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd v828) v1 ==== 221+0+0 (unknown 334405376 0 0) 0x7f8e40055ae0 con 0x7f8e4c100330 2024-02-05T07:52:36.464 INFO:tasks.workunit.client.0.smithi184.stderr:set-quota max_objects = 0 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd 2024-02-05T07:52:36.467 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.466+0000 7f8e53132640 1 -- 172.21.15.184:0/3343775219 >> v1:172.21.15.184:6800/103463156 conn(0x7f8e3c06e710 legacy=0x7f8e3c070bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:36.468 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.466+0000 7f8e53132640 1 -- 172.21.15.184:0/3343775219 >> v1:172.21.15.184:6790/0 conn(0x7f8e4c100330 legacy=0x7f8e4c105490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:36.468 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.466+0000 7f8e53132640 1 -- 172.21.15.184:0/3343775219 shutdown_connections 2024-02-05T07:52:36.468 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.466+0000 7f8e53132640 1 -- 172.21.15.184:0/3343775219 >> 172.21.15.184:0/3343775219 conn(0x7f8e4c075ae0 msgr2=0x7f8e4c068310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:52:36.468 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.466+0000 7f8e53132640 1 -- 172.21.15.184:0/3343775219 shutdown_connections 2024-02-05T07:52:36.468 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.467+0000 7f8e53132640 1 -- 172.21.15.184:0/3343775219 wait complete. 2024-02-05T07:52:36.479 INFO:tasks.workunit.client.0.smithi184.stderr:+ wait 158477 2024-02-05T07:52:36.479 INFO:tasks.workunit.client.0.smithi184.stderr:+ '[' 0 -ne 0 ']' 2024-02-05T07:52:36.479 INFO:tasks.workunit.client.0.smithi184.stderr:+ true 2024-02-05T07:52:36.479 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 978227f4-3b71-45f5-b8b8-2286bb55bbcd put three /etc/passwd 2024-02-05T07:52:36.514 INFO:tasks.workunit.client.0.smithi184.stderr:++ uuidgen 2024-02-05T07:52:36.515 INFO:tasks.workunit.client.0.smithi184.stderr:+ pp=7442f913-a0b7-47b3-a4e1-c84de7254b55 2024-02-05T07:52:36.515 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool create 7442f913-a0b7-47b3-a4e1-c84de7254b55 12 2024-02-05T07:52:36.600 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.597+0000 7fb602be2640 1 -- 172.21.15.184:0/4270112054 >> v1:172.21.15.184:6789/0 conn(0x7fb5fc100330 legacy=0x7fb5fc100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:36.601 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.597+0000 7fb602be2640 1 -- 172.21.15.184:0/4270112054 shutdown_connections 2024-02-05T07:52:36.601 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.597+0000 7fb602be2640 1 -- 172.21.15.184:0/4270112054 >> 172.21.15.184:0/4270112054 conn(0x7fb5fc075ae0 msgr2=0x7fb5fc075ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:52:36.601 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.597+0000 7fb602be2640 1 -- 172.21.15.184:0/4270112054 shutdown_connections 2024-02-05T07:52:36.601 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.597+0000 7fb602be2640 1 -- 172.21.15.184:0/4270112054 wait complete. 2024-02-05T07:52:36.601 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.597+0000 7fb602be2640 1 Processor -- start 2024-02-05T07:52:36.601 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.597+0000 7fb602be2640 1 -- start start 2024-02-05T07:52:36.601 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb602be2640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb5fc1a5e10 con 0x7fb5fc10c9e0 2024-02-05T07:52:36.601 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb602be2640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb5fc1a7010 con 0x7fb5fc100330 2024-02-05T07:52:36.601 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb602be2640 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb5fc1a8210 con 0x7fb5fc108e70 2024-02-05T07:52:36.601 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5fbfff640 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7fb5fc108e70 0x7fb5fc1a0d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:57084/0 (socket says 172.21.15.184:57084) 2024-02-05T07:52:36.601 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5fbfff640 1 -- 172.21.15.184:0/2372430756 learned_addr learned my addr 172.21.15.184:0/2372430756 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:52:36.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361770422 0 0) 0x7fb5fc1a8210 con 0x7fb5fc108e70 2024-02-05T07:52:36.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5e4003160 con 0x7fb5fc108e70 2024-02-05T07:52:36.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3468855627 0 0) 0x7fb5fc1a5e10 con 0x7fb5fc10c9e0 2024-02-05T07:52:36.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5fc1a8210 con 0x7fb5fc10c9e0 2024-02-05T07:52:36.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500653398 0 0) 0x7fb5fc1a7010 con 0x7fb5fc100330 2024-02-05T07:52:36.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5fc1a5e10 con 0x7fb5fc100330 2024-02-05T07:52:36.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2140225799 0 0) 0x7fb5e4003160 con 0x7fb5fc108e70 2024-02-05T07:52:36.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb5fc1a7010 con 0x7fb5fc108e70 2024-02-05T07:52:36.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fb5f00018d0 con 0x7fb5fc108e70 2024-02-05T07:52:36.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2237680343 0 0) 0x7fb5fc1a8210 con 0x7fb5fc10c9e0 2024-02-05T07:52:36.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb5e4003160 con 0x7fb5fc10c9e0 2024-02-05T07:52:36.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fb5ec001070 con 0x7fb5fc10c9e0 2024-02-05T07:52:36.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 354472015 0 0) 0x7fb5fc1a7010 con 0x7fb5fc108e70 2024-02-05T07:52:36.603 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 >> v1:172.21.15.188:6789/0 conn(0x7fb5fc100330 legacy=0x7fb5fc068ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:36.603 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 >> v1:172.21.15.184:6789/0 conn(0x7fb5fc10c9e0 legacy=0x7fb5fc1a4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:36.603 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5fc1a9410 con 0x7fb5fc108e70 2024-02-05T07:52:36.603 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb602be2640 1 -- 172.21.15.184:0/2372430756 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5fc1a6000 con 0x7fb5fc108e70 2024-02-05T07:52:36.603 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fb5f0003aa0 con 0x7fb5fc108e70 2024-02-05T07:52:36.603 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.598+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fb5f0005b80 con 0x7fb5fc108e70 2024-02-05T07:52:36.603 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.599+0000 7fb602be2640 1 -- 172.21.15.184:0/2372430756 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5fc1a6490 con 0x7fb5fc108e70 2024-02-05T07:52:36.603 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.599+0000 7fb602be2640 1 -- 172.21.15.184:0/2372430756 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5fc1016c0 con 0x7fb5fc108e70 2024-02-05T07:52:36.603 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.600+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7fb5f0003610 con 0x7fb5fc108e70 2024-02-05T07:52:36.603 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.600+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(828..828 src has 253..828) v4 ==== 7818+0+0 (unknown 695957446 0 0) 0x7fb5f0088e00 con 0x7fb5fc108e70 2024-02-05T07:52:36.605 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.604+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fb5f0055af0 con 0x7fb5fc108e70 2024-02-05T07:52:36.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:36 smithi188 ceph-mon[33283]: pgmap v1797: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:36.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:36 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/3343775219' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:52:36.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:36 smithi188 ceph-mon[33283]: from='client.58484 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:52:36.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:36 smithi184 ceph-mon[29861]: pgmap v1797: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:36.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:36 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/3343775219' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:52:36.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:36 smithi184 ceph-mon[29861]: from='client.58484 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:52:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:36 smithi184 ceph-mon[41609]: pgmap v1797: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:36 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/3343775219' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:52:36.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:36 smithi184 ceph-mon[41609]: from='client.58484 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:52:36.782 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:36.781+0000 7fb602be2640 1 -- 172.21.15.184:0/2372430756 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12} v 0) v1 -- 0x7fb5fc067ec0 con 0x7fb5fc108e70 2024-02-05T07:52:37.471 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.470+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 <== mon.2 v1:172.21.15.184:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]=0 pool '7442f913-a0b7-47b3-a4e1-c84de7254b55' created v829) v1 ==== 176+0+0 (unknown 2028954192 0 0) 0x7fb5f0053e60 con 0x7fb5fc108e70 2024-02-05T07:52:37.579 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.578+0000 7fb602be2640 1 -- 172.21.15.184:0/2372430756 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12} v 0) v1 -- 0x7fb5fc1127c0 con 0x7fb5fc108e70 2024-02-05T07:52:37.580 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.579+0000 7fb5f9ffb640 1 -- 172.21.15.184:0/2372430756 <== mon.2 v1:172.21.15.184:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]=0 pool '7442f913-a0b7-47b3-a4e1-c84de7254b55' already exists v829) v1 ==== 183+0+0 (unknown 630271645 0 0) 0x7fb5f0055680 con 0x7fb5fc108e70 2024-02-05T07:52:37.580 INFO:tasks.workunit.client.0.smithi184.stderr:pool '7442f913-a0b7-47b3-a4e1-c84de7254b55' already exists 2024-02-05T07:52:37.582 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.581+0000 7fb602be2640 1 -- 172.21.15.184:0/2372430756 >> v1:172.21.15.184:6800/103463156 conn(0x7fb5e406e930 legacy=0x7fb5e4070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:37.582 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.581+0000 7fb602be2640 1 -- 172.21.15.184:0/2372430756 >> v1:172.21.15.184:6790/0 conn(0x7fb5fc108e70 legacy=0x7fb5fc1a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:37.582 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.581+0000 7fb602be2640 1 -- 172.21.15.184:0/2372430756 shutdown_connections 2024-02-05T07:52:37.582 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.581+0000 7fb602be2640 1 -- 172.21.15.184:0/2372430756 >> 172.21.15.184:0/2372430756 conn(0x7fb5fc075ae0 msgr2=0x7fb5fc10ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:52:37.583 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.581+0000 7fb602be2640 1 -- 172.21.15.184:0/2372430756 shutdown_connections 2024-02-05T07:52:37.583 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.581+0000 7fb602be2640 1 -- 172.21.15.184:0/2372430756 wait complete. 2024-02-05T07:52:37.591 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool application enable 7442f913-a0b7-47b3-a4e1-c84de7254b55 rados 2024-02-05T07:52:37.676 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.672+0000 7f9ccf5af640 1 -- 172.21.15.184:0/2027908946 >> v1:172.21.15.184:6789/0 conn(0x7f9cc8109f90 legacy=0x7f9cc810c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:37.676 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.672+0000 7f9ccf5af640 1 -- 172.21.15.184:0/2027908946 shutdown_connections 2024-02-05T07:52:37.677 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.672+0000 7f9ccf5af640 1 -- 172.21.15.184:0/2027908946 >> 172.21.15.184:0/2027908946 conn(0x7f9cc80752c0 msgr2=0x7f9cc80756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:52:37.677 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.672+0000 7f9ccf5af640 1 -- 172.21.15.184:0/2027908946 shutdown_connections 2024-02-05T07:52:37.677 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.673+0000 7f9ccf5af640 1 -- 172.21.15.184:0/2027908946 wait complete. 2024-02-05T07:52:37.677 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.673+0000 7f9ccf5af640 1 Processor -- start 2024-02-05T07:52:37.677 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.673+0000 7f9ccf5af640 1 -- start start 2024-02-05T07:52:37.677 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.673+0000 7f9ccf5af640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9cc81a5ea0 con 0x7f9cc810db00 2024-02-05T07:52:37.677 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.673+0000 7f9ccf5af640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9cc81a70a0 con 0x7f9cc8109f90 2024-02-05T07:52:37.677 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.673+0000 7f9ccf5af640 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9cc81a82a0 con 0x7f9cc80ffaa0 2024-02-05T07:52:37.677 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.673+0000 7f9ccd34b640 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f9cc80ffaa0 0x7f9cc81064b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:44382/0 (socket says 172.21.15.184:44382) 2024-02-05T07:52:37.678 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.673+0000 7f9ccd34b640 1 -- 172.21.15.184:0/1757306016 learned_addr learned my addr 172.21.15.184:0/1757306016 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:52:37.678 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77325851 0 0) 0x7f9cc81a5ea0 con 0x7f9cc810db00 2024-02-05T07:52:37.678 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cb4004950 con 0x7f9cc810db00 2024-02-05T07:52:37.678 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037419235 0 0) 0x7f9cc81a82a0 con 0x7f9cc80ffaa0 2024-02-05T07:52:37.678 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cc81a5ea0 con 0x7f9cc80ffaa0 2024-02-05T07:52:37.678 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486302293 0 0) 0x7f9cc81a70a0 con 0x7f9cc8109f90 2024-02-05T07:52:37.678 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cc81a82a0 con 0x7f9cc8109f90 2024-02-05T07:52:37.678 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1018098538 0 0) 0x7f9cb4004950 con 0x7f9cc810db00 2024-02-05T07:52:37.678 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9cc81a70a0 con 0x7f9cc810db00 2024-02-05T07:52:37.678 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9cc00013f0 con 0x7f9cc810db00 2024-02-05T07:52:37.678 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 385882541 0 0) 0x7f9cc81a5ea0 con 0x7f9cc80ffaa0 2024-02-05T07:52:37.678 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9cb4004950 con 0x7f9cc80ffaa0 2024-02-05T07:52:37.678 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3675062928 0 0) 0x7f9cc81a82a0 con 0x7f9cc8109f90 2024-02-05T07:52:37.678 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9cc81a5ea0 con 0x7f9cc8109f90 2024-02-05T07:52:37.679 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9cb8001870 con 0x7f9cc80ffaa0 2024-02-05T07:52:37.679 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9cc4001940 con 0x7f9cc8109f90 2024-02-05T07:52:37.679 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 608684645 0 0) 0x7f9cc81a70a0 con 0x7f9cc810db00 2024-02-05T07:52:37.679 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 >> v1:172.21.15.184:6790/0 conn(0x7f9cc80ffaa0 legacy=0x7f9cc81064b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:37.679 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 >> v1:172.21.15.188:6789/0 conn(0x7f9cc8109f90 legacy=0x7f9cc81a0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:37.679 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc81a94a0 con 0x7f9cc810db00 2024-02-05T07:52:37.679 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9ccf5af640 1 -- 172.21.15.184:0/1757306016 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc81a6090 con 0x7f9cc810db00 2024-02-05T07:52:37.679 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9ccf5af640 1 -- 172.21.15.184:0/1757306016 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc81a6520 con 0x7f9cc810db00 2024-02-05T07:52:37.679 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f9cc0003e00 con 0x7f9cc810db00 2024-02-05T07:52:37.679 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.674+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f9cc0004cd0 con 0x7f9cc810db00 2024-02-05T07:52:37.679 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.675+0000 7f9ccf5af640 1 -- 172.21.15.184:0/1757306016 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cac005080 con 0x7f9cc810db00 2024-02-05T07:52:37.680 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.676+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f9cc0003970 con 0x7f9cc810db00 2024-02-05T07:52:37.680 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.676+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(829..829 src has 253..829) v4 ==== 8193+0+0 (unknown 2025136982 0 0) 0x7f9cc0088100 con 0x7f9cc810db00 2024-02-05T07:52:37.681 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.680+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f9cc0054c10 con 0x7f9cc810db00 2024-02-05T07:52:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:37 smithi188 ceph-mon[33283]: from='client.58484 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]': finished 2024-02-05T07:52:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:37 smithi188 ceph-mon[33283]: osdmap e828: 8 total, 8 up, 8 in 2024-02-05T07:52:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:37 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2372430756' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]: dispatch 2024-02-05T07:52:37.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:37 smithi188 ceph-mon[33283]: from='client.58499 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]: dispatch 2024-02-05T07:52:37.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:37 smithi184 ceph-mon[29861]: from='client.58484 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]': finished 2024-02-05T07:52:37.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:37 smithi184 ceph-mon[29861]: osdmap e828: 8 total, 8 up, 8 in 2024-02-05T07:52:37.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:37 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2372430756' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]: dispatch 2024-02-05T07:52:37.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:37 smithi184 ceph-mon[29861]: from='client.58499 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]: dispatch 2024-02-05T07:52:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:37 smithi184 ceph-mon[41609]: from='client.58484 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]': finished 2024-02-05T07:52:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:37 smithi184 ceph-mon[41609]: osdmap e828: 8 total, 8 up, 8 in 2024-02-05T07:52:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:37 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2372430756' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]: dispatch 2024-02-05T07:52:37.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:37 smithi184 ceph-mon[41609]: from='client.58499 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]: dispatch 2024-02-05T07:52:37.858 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:37.857+0000 7f9ccf5af640 1 -- 172.21.15.184:0/1757306016 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"} v 0) v1 -- 0x7f9cac005330 con 0x7f9cc810db00 2024-02-05T07:52:38.467 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:38.466+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"}]=0 enabled application 'rados' on pool '7442f913-a0b7-47b3-a4e1-c84de7254b55' v830) v1 ==== 213+0+0 (unknown 177175704 0 0) 0x7f9cc0052f80 con 0x7f9cc810db00 2024-02-05T07:52:38.584 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:38.583+0000 7f9ccf5af640 1 -- 172.21.15.184:0/1757306016 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"} v 0) v1 -- 0x7f9cac001090 con 0x7f9cc810db00 2024-02-05T07:52:38.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:38 smithi188 ceph-mon[33283]: pgmap v1800: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:52:38.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:38 smithi188 ceph-mon[33283]: from='client.58499 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]': finished 2024-02-05T07:52:38.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:38 smithi188 ceph-mon[33283]: osdmap e829: 8 total, 8 up, 8 in 2024-02-05T07:52:38.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/2372430756' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]: dispatch 2024-02-05T07:52:38.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:38 smithi188 ceph-mon[33283]: from='client.58499 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]: dispatch 2024-02-05T07:52:38.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:38 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1757306016' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"}]: dispatch 2024-02-05T07:52:38.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:38 smithi184 ceph-mon[41609]: pgmap v1800: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:52:38.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:38 smithi184 ceph-mon[41609]: from='client.58499 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]': finished 2024-02-05T07:52:38.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:38 smithi184 ceph-mon[41609]: osdmap e829: 8 total, 8 up, 8 in 2024-02-05T07:52:38.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/2372430756' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]: dispatch 2024-02-05T07:52:38.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:38 smithi184 ceph-mon[41609]: from='client.58499 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]: dispatch 2024-02-05T07:52:38.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:38 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1757306016' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"}]: dispatch 2024-02-05T07:52:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:38 smithi184 ceph-mon[29861]: pgmap v1800: 176 pgs: 176 active+clean; 717 KiB data, 902 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:52:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:38 smithi184 ceph-mon[29861]: from='client.58499 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]': finished 2024-02-05T07:52:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:38 smithi184 ceph-mon[29861]: osdmap e829: 8 total, 8 up, 8 in 2024-02-05T07:52:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/2372430756' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]: dispatch 2024-02-05T07:52:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:38 smithi184 ceph-mon[29861]: from='client.58499 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pg_num": 12}]: dispatch 2024-02-05T07:52:38.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:38 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1757306016' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"}]: dispatch 2024-02-05T07:52:39.483 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.482+0000 7f9cbe7fc640 1 -- 172.21.15.184:0/1757306016 <== mon.0 v1:172.21.15.184:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"}]=0 enabled application 'rados' on pool '7442f913-a0b7-47b3-a4e1-c84de7254b55' v831) v1 ==== 213+0+0 (unknown 816745086 0 0) 0x7f9cc00547a0 con 0x7f9cc810db00 2024-02-05T07:52:39.483 INFO:tasks.workunit.client.0.smithi184.stderr:enabled application 'rados' on pool '7442f913-a0b7-47b3-a4e1-c84de7254b55' 2024-02-05T07:52:39.486 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.485+0000 7f9ccf5af640 1 -- 172.21.15.184:0/1757306016 >> v1:172.21.15.184:6800/103463156 conn(0x7f9cb406eaa0 legacy=0x7f9cb4070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:39.486 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.485+0000 7f9ccf5af640 1 -- 172.21.15.184:0/1757306016 >> v1:172.21.15.184:6789/0 conn(0x7f9cc810db00 legacy=0x7f9cc81a45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:39.486 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.485+0000 7f9ccf5af640 1 -- 172.21.15.184:0/1757306016 shutdown_connections 2024-02-05T07:52:39.486 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.485+0000 7f9ccf5af640 1 -- 172.21.15.184:0/1757306016 >> 172.21.15.184:0/1757306016 conn(0x7f9cc80752c0 msgr2=0x7f9cc8111060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:52:39.486 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.485+0000 7f9ccf5af640 1 -- 172.21.15.184:0/1757306016 shutdown_connections 2024-02-05T07:52:39.486 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.485+0000 7f9ccf5af640 1 -- 172.21.15.184:0/1757306016 wait complete. 2024-02-05T07:52:39.500 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool set-quota 7442f913-a0b7-47b3-a4e1-c84de7254b55 max_objects 10 2024-02-05T07:52:39.589 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.586+0000 7fa1b21b2640 1 -- 172.21.15.184:0/3589567568 >> v1:172.21.15.184:6789/0 conn(0x7fa1ac1022d0 legacy=0x7fa1ac1026b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:39.590 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.586+0000 7fa1b21b2640 1 -- 172.21.15.184:0/3589567568 shutdown_connections 2024-02-05T07:52:39.590 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.586+0000 7fa1b21b2640 1 -- 172.21.15.184:0/3589567568 >> 172.21.15.184:0/3589567568 conn(0x7fa1ac0fba30 msgr2=0x7fa1ac0fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:52:39.590 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.586+0000 7fa1b21b2640 1 -- 172.21.15.184:0/3589567568 shutdown_connections 2024-02-05T07:52:39.590 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.586+0000 7fa1b21b2640 1 -- 172.21.15.184:0/3589567568 wait complete. 2024-02-05T07:52:39.590 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.586+0000 7fa1b21b2640 1 Processor -- start 2024-02-05T07:52:39.590 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1b21b2640 1 -- start start 2024-02-05T07:52:39.590 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1b21b2640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa1ac1a5f30 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.590 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1b21b2640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa1ac1a7130 con 0x7fa1ac10dbe0 2024-02-05T07:52:39.590 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1b21b2640 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa1ac1a8330 con 0x7fa1ac1022d0 2024-02-05T07:52:39.590 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1ab7fe640 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7fa1ac1022d0 0x7fa1ac109840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:44392/0 (socket says 172.21.15.184:44392) 2024-02-05T07:52:39.590 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1aaffd640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fa1ac10a0d0 0x7fa1ac1a0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:36056/0 (socket says 172.21.15.184:36056) 2024-02-05T07:52:39.590 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1ab7fe640 1 -- 172.21.15.184:0/1582825497 learned_addr learned my addr 172.21.15.184:0/1582825497 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:52:39.590 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505025649 0 0) 0x7fa1ac1a5f30 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.591 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa194003160 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.591 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845608550 0 0) 0x7fa1ac1a8330 con 0x7fa1ac1022d0 2024-02-05T07:52:39.591 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1ac1a5f30 con 0x7fa1ac1022d0 2024-02-05T07:52:39.591 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2286438865 0 0) 0x7fa1ac1a7130 con 0x7fa1ac10dbe0 2024-02-05T07:52:39.591 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1ac1a8330 con 0x7fa1ac10dbe0 2024-02-05T07:52:39.591 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3243470504 0 0) 0x7fa194003160 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.591 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa1ac1a7130 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.591 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1798148410 0 0) 0x7fa1ac1a5f30 con 0x7fa1ac1022d0 2024-02-05T07:52:39.591 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa194003160 con 0x7fa1ac1022d0 2024-02-05T07:52:39.591 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fa1a00018b0 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.591 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fa19c0044b0 con 0x7fa1ac1022d0 2024-02-05T07:52:39.591 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3736107014 0 0) 0x7fa1ac1a8330 con 0x7fa1ac10dbe0 2024-02-05T07:52:39.591 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa1ac1a5f30 con 0x7fa1ac10dbe0 2024-02-05T07:52:39.591 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.587+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fa1a40013f0 con 0x7fa1ac10dbe0 2024-02-05T07:52:39.592 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.588+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3040654725 0 0) 0x7fa1ac1a7130 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.592 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.588+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 >> v1:172.21.15.184:6790/0 conn(0x7fa1ac1022d0 legacy=0x7fa1ac109840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:39.592 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.588+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 >> v1:172.21.15.188:6789/0 conn(0x7fa1ac10dbe0 legacy=0x7fa1ac1a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:39.592 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.588+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ac1a9530 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.592 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.588+0000 7fa1b21b2640 1 -- 172.21.15.184:0/1582825497 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ac1a6120 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.592 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.588+0000 7fa1b21b2640 1 -- 172.21.15.184:0/1582825497 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1ac1a65b0 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.592 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.588+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fa1a0001aa0 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.592 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.588+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fa1a0005c10 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.592 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.589+0000 7fa1b21b2640 1 -- 172.21.15.184:0/1582825497 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa198005080 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.593 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.589+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7fa1a00038c0 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.593 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.590+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(831..831 src has 253..831) v4 ==== 8206+0+0 (unknown 1713899172 0 0) 0x7fa1a0088f50 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.595 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.594+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fa1a0055900 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:52:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:52:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1757306016' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"}]': finished 2024-02-05T07:52:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:39 smithi188 ceph-mon[33283]: osdmap e830: 8 total, 8 up, 8 in 2024-02-05T07:52:39.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:39 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1757306016' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"}]: dispatch 2024-02-05T07:52:39.770 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:39.769+0000 7fa1b21b2640 1 -- 172.21.15.184:0/1582825497 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7fa198005330 con 0x7fa1ac10a0d0 2024-02-05T07:52:39.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1757306016' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"}]': finished 2024-02-05T07:52:39.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:39 smithi184 ceph-mon[29861]: osdmap e830: 8 total, 8 up, 8 in 2024-02-05T07:52:39.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:39 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1757306016' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"}]: dispatch 2024-02-05T07:52:39.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1757306016' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"}]': finished 2024-02-05T07:52:39.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:39 smithi184 ceph-mon[41609]: osdmap e830: 8 total, 8 up, 8 in 2024-02-05T07:52:39.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:39 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1757306016' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"}]: dispatch 2024-02-05T07:52:40.487 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:40.486+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 7442f913-a0b7-47b3-a4e1-c84de7254b55 v832) v1 ==== 223+0+0 (unknown 3735158670 0 0) 0x7fa1a0001d40 con 0x7fa1ac10a0d0 2024-02-05T07:52:40.598 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:40.597+0000 7fa1b21b2640 1 -- 172.21.15.184:0/1582825497 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7fa198001090 con 0x7fa1ac10a0d0 2024-02-05T07:52:40.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:40 smithi188 ceph-mon[33283]: pgmap v1803: 188 pgs: 12 unknown, 176 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-02-05T07:52:40.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:40 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:40.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1757306016' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"}]': finished 2024-02-05T07:52:40.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:40 smithi188 ceph-mon[33283]: osdmap e831: 8 total, 8 up, 8 in 2024-02-05T07:52:40.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:40 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1582825497' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:52:40.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:40 smithi184 ceph-mon[29861]: pgmap v1803: 188 pgs: 12 unknown, 176 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-02-05T07:52:40.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:40 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:40.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1757306016' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"}]': finished 2024-02-05T07:52:40.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:40 smithi184 ceph-mon[29861]: osdmap e831: 8 total, 8 up, 8 in 2024-02-05T07:52:40.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:40 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1582825497' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:52:40.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:40 smithi184 ceph-mon[41609]: pgmap v1803: 188 pgs: 12 unknown, 176 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-02-05T07:52:40.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:40 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:40.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1757306016' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "app": "rados"}]': finished 2024-02-05T07:52:40.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:40 smithi184 ceph-mon[41609]: osdmap e831: 8 total, 8 up, 8 in 2024-02-05T07:52:40.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:40 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1582825497' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:52:41.499 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:41.497+0000 7fa1a8ff9640 1 -- 172.21.15.184:0/1582825497 <== mon.0 v1:172.21.15.184:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 7442f913-a0b7-47b3-a4e1-c84de7254b55 v833) v1 ==== 223+0+0 (unknown 2548325118 0 0) 0x7fa1a0053f00 con 0x7fa1ac10a0d0 2024-02-05T07:52:41.499 INFO:tasks.workunit.client.0.smithi184.stderr:set-quota max_objects = 10 for pool 7442f913-a0b7-47b3-a4e1-c84de7254b55 2024-02-05T07:52:41.502 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:41.501+0000 7fa1b21b2640 1 -- 172.21.15.184:0/1582825497 >> v1:172.21.15.184:6800/103463156 conn(0x7fa19406e9f0 legacy=0x7fa194070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:41.502 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:41.501+0000 7fa1b21b2640 1 -- 172.21.15.184:0/1582825497 >> v1:172.21.15.184:6789/0 conn(0x7fa1ac10a0d0 legacy=0x7fa1ac1a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:52:41.502 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:41.501+0000 7fa1b21b2640 1 -- 172.21.15.184:0/1582825497 shutdown_connections 2024-02-05T07:52:41.503 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:41.501+0000 7fa1b21b2640 1 -- 172.21.15.184:0/1582825497 >> 172.21.15.184:0/1582825497 conn(0x7fa1ac0fba30 msgr2=0x7fa1ac0fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:52:41.503 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:41.501+0000 7fa1b21b2640 1 -- 172.21.15.184:0/1582825497 shutdown_connections 2024-02-05T07:52:41.503 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:52:41.501+0000 7fa1b21b2640 1 -- 172.21.15.184:0/1582825497 wait complete. 2024-02-05T07:52:41.515 INFO:tasks.workunit.client.0.smithi184.stderr:+ sleep 30 2024-02-05T07:52:41.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1582825497' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"}]': finished 2024-02-05T07:52:41.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:41 smithi184 ceph-mon[29861]: osdmap e832: 8 total, 8 up, 8 in 2024-02-05T07:52:41.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:41 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1582825497' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:52:41.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1582825497' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"}]': finished 2024-02-05T07:52:41.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:41 smithi184 ceph-mon[41609]: osdmap e832: 8 total, 8 up, 8 in 2024-02-05T07:52:41.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:41 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1582825497' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:52:41.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1582825497' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"}]': finished 2024-02-05T07:52:41.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:41 smithi188 ceph-mon[33283]: osdmap e832: 8 total, 8 up, 8 in 2024-02-05T07:52:41.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:41 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1582825497' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"}]: dispatch 2024-02-05T07:52:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:52:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:52:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:52:42.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:42 smithi184 ceph-mon[29861]: pgmap v1806: 188 pgs: 12 unknown, 176 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-02-05T07:52:42.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1582825497' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"}]': finished 2024-02-05T07:52:42.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:42 smithi184 ceph-mon[29861]: osdmap e833: 8 total, 8 up, 8 in 2024-02-05T07:52:42.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:42 smithi184 ceph-mon[41609]: pgmap v1806: 188 pgs: 12 unknown, 176 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-02-05T07:52:42.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1582825497' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"}]': finished 2024-02-05T07:52:42.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:42 smithi184 ceph-mon[41609]: osdmap e833: 8 total, 8 up, 8 in 2024-02-05T07:52:42.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:42 smithi188 ceph-mon[33283]: pgmap v1806: 188 pgs: 12 unknown, 176 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-02-05T07:52:42.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1582825497' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "field": "max_objects", "val": "10"}]': finished 2024-02-05T07:52:42.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:42 smithi188 ceph-mon[33283]: osdmap e833: 8 total, 8 up, 8 in 2024-02-05T07:52:44.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:44 smithi184 ceph-mon[29861]: pgmap v1808: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:44.772 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:44 smithi184 ceph-mon[41609]: pgmap v1808: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:44.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:44 smithi188 ceph-mon[33283]: pgmap v1808: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:46 smithi188 ceph-mon[33283]: pgmap v1809: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:46 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:52:46.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:46 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:52:46.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:46 smithi184 ceph-mon[29861]: pgmap v1809: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:46 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:52:46.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:46 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:52:46.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:46 smithi184 ceph-mon[41609]: pgmap v1809: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:46.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:46 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:52:46.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:46 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:52:48.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:48 smithi188 ceph-mon[33283]: pgmap v1810: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 699 B/s rd, 0 op/s 2024-02-05T07:52:48.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:48 smithi184 ceph-mon[29861]: pgmap v1810: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 699 B/s rd, 0 op/s 2024-02-05T07:52:48.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:48 smithi184 ceph-mon[41609]: pgmap v1810: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 699 B/s rd, 0 op/s 2024-02-05T07:52:49.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:52:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:52:50.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:50 smithi188 ceph-mon[33283]: pgmap v1811: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:50.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:50 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:50.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:50 smithi184 ceph-mon[29861]: pgmap v1811: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:50.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:50 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:50.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:50 smithi184 ceph-mon[41609]: pgmap v1811: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:52:50.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:50 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:52:52.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:52:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:52:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:52:52.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:52 smithi188 ceph-mon[33283]: pgmap v1812: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:52:52.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:52 smithi184 ceph-mon[29861]: pgmap v1812: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:52:52.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:52 smithi184 ceph-mon[41609]: pgmap v1812: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:52:54.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:54 smithi188 ceph-mon[33283]: pgmap v1813: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-05T07:52:54.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:54 smithi184 ceph-mon[29861]: pgmap v1813: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-05T07:52:54.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:54 smithi184 ceph-mon[41609]: pgmap v1813: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-05T07:52:56.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:56 smithi188 ceph-mon[33283]: pgmap v1814: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:56.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:56 smithi184 ceph-mon[29861]: pgmap v1814: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:56.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:56 smithi184 ceph-mon[41609]: pgmap v1814: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:58.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:52:58 smithi188 ceph-mon[33283]: pgmap v1815: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:58.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:52:58 smithi184 ceph-mon[29861]: pgmap v1815: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:58.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:52:58 smithi184 ceph-mon[41609]: pgmap v1815: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:52:59.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:52:59 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:53:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:00 smithi188 ceph-mon[33283]: pgmap v1816: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:00 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:00.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:53:00.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:00 smithi184 ceph-mon[29861]: pgmap v1816: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:00.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:00 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:00.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:53:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:00 smithi184 ceph-mon[41609]: pgmap v1816: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:00 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:00.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:53:02.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:53:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:53:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:53:02.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:02 smithi188 ceph-mon[33283]: pgmap v1817: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:53:02.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:02 smithi184 ceph-mon[29861]: pgmap v1817: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:53:02.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:02 smithi184 ceph-mon[41609]: pgmap v1817: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:53:04.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:04 smithi188 ceph-mon[33283]: pgmap v1818: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:04.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:04 smithi184 ceph-mon[29861]: pgmap v1818: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:04.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:04 smithi184 ceph-mon[41609]: pgmap v1818: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:06.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:06 smithi188 ceph-mon[33283]: pgmap v1819: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:53:06.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:06 smithi184 ceph-mon[29861]: pgmap v1819: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:53:06.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:06 smithi184 ceph-mon[41609]: pgmap v1819: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:53:08.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:08 smithi188 ceph-mon[33283]: pgmap v1820: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:53:08.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:08 smithi184 ceph-mon[29861]: pgmap v1820: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:53:08.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:08 smithi184 ceph-mon[41609]: pgmap v1820: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:53:09.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:53:09 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:53:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:10 smithi188 ceph-mon[33283]: pgmap v1821: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:10.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:10 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:10.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:10 smithi184 ceph-mon[29861]: pgmap v1821: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:10.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:10 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:10 smithi184 ceph-mon[41609]: pgmap v1821: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:10.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:10 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:11.517 INFO:tasks.workunit.client.0.smithi184.stderr:++ seq 1 10 2024-02-05T07:53:11.518 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:53:11.518 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 7442f913-a0b7-47b3-a4e1-c84de7254b55 put obj1 /etc/passwd 2024-02-05T07:53:11.557 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:53:11.557 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 7442f913-a0b7-47b3-a4e1-c84de7254b55 put obj2 /etc/passwd 2024-02-05T07:53:11.593 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:53:11.593 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 7442f913-a0b7-47b3-a4e1-c84de7254b55 put obj3 /etc/passwd 2024-02-05T07:53:11.626 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:53:11.627 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 7442f913-a0b7-47b3-a4e1-c84de7254b55 put obj4 /etc/passwd 2024-02-05T07:53:11.660 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:53:11.660 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 7442f913-a0b7-47b3-a4e1-c84de7254b55 put obj5 /etc/passwd 2024-02-05T07:53:11.692 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:53:11.693 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 7442f913-a0b7-47b3-a4e1-c84de7254b55 put obj6 /etc/passwd 2024-02-05T07:53:11.725 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:53:11.725 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 7442f913-a0b7-47b3-a4e1-c84de7254b55 put obj7 /etc/passwd 2024-02-05T07:53:11.757 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:53:11.757 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 7442f913-a0b7-47b3-a4e1-c84de7254b55 put obj8 /etc/passwd 2024-02-05T07:53:11.789 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:53:11.789 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 7442f913-a0b7-47b3-a4e1-c84de7254b55 put obj9 /etc/passwd 2024-02-05T07:53:11.822 INFO:tasks.workunit.client.0.smithi184.stderr:+ for f in `seq 1 10` 2024-02-05T07:53:11.822 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 7442f913-a0b7-47b3-a4e1-c84de7254b55 put obj10 /etc/passwd 2024-02-05T07:53:11.855 INFO:tasks.workunit.client.0.smithi184.stderr:+ sleep 30 2024-02-05T07:53:12.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:53:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:53:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:53:12.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:12 smithi188 ceph-mon[33283]: pgmap v1822: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:53:12.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:12 smithi184 ceph-mon[29861]: pgmap v1822: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:53:12.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:12 smithi184 ceph-mon[41609]: pgmap v1822: 188 pgs: 188 active+clean; 740 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:53:14.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:14 smithi188 ceph-mon[33283]: pgmap v1823: 188 pgs: 188 active+clean; 852 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-02-05T07:53:14.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:14 smithi184 ceph-mon[29861]: pgmap v1823: 188 pgs: 188 active+clean; 852 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-02-05T07:53:14.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:14 smithi184 ceph-mon[41609]: pgmap v1823: 188 pgs: 188 active+clean; 852 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-02-05T07:53:15.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:15 smithi188 ceph-mon[33283]: pool '7442f913-a0b7-47b3-a4e1-c84de7254b55' is full (reached quota's max_objects: 10) 2024-02-05T07:53:15.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:15 smithi188 ceph-mon[33283]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-05T07:53:15.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:15 smithi188 ceph-mon[33283]: osdmap e834: 8 total, 8 up, 8 in 2024-02-05T07:53:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:53:15.749 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:15 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:53:15.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:15 smithi184 ceph-mon[41609]: pool '7442f913-a0b7-47b3-a4e1-c84de7254b55' is full (reached quota's max_objects: 10) 2024-02-05T07:53:15.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:15 smithi184 ceph-mon[41609]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-05T07:53:15.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:15 smithi184 ceph-mon[41609]: osdmap e834: 8 total, 8 up, 8 in 2024-02-05T07:53:15.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:53:15.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:15 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:53:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:15 smithi184 ceph-mon[29861]: pool '7442f913-a0b7-47b3-a4e1-c84de7254b55' is full (reached quota's max_objects: 10) 2024-02-05T07:53:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:15 smithi184 ceph-mon[29861]: Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-05T07:53:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:15 smithi184 ceph-mon[29861]: osdmap e834: 8 total, 8 up, 8 in 2024-02-05T07:53:15.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:53:15.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:15 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:53:16.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:16 smithi188 ceph-mon[33283]: pgmap v1824: 188 pgs: 188 active+clean; 852 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 10 KiB/s wr, 1 op/s 2024-02-05T07:53:16.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:16 smithi184 ceph-mon[29861]: pgmap v1824: 188 pgs: 188 active+clean; 852 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 10 KiB/s wr, 1 op/s 2024-02-05T07:53:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:16 smithi184 ceph-mon[41609]: pgmap v1824: 188 pgs: 188 active+clean; 852 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 10 KiB/s wr, 1 op/s 2024-02-05T07:53:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:17 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:53:18.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:17 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:53:18.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:17 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:53:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:18 smithi188 ceph-mon[33283]: pgmap v1826: 188 pgs: 188 active+clean; 852 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-05T07:53:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:18 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:53:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:18 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:53:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:18 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:53:19.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:18 smithi184 ceph-mon[29861]: pgmap v1826: 188 pgs: 188 active+clean; 852 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-05T07:53:19.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:18 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:53:19.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:18 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:53:19.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:18 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:53:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:18 smithi184 ceph-mon[41609]: pgmap v1826: 188 pgs: 188 active+clean; 852 KiB data, 903 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-05T07:53:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:18 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-05T07:53:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:18 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-05T07:53:19.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:18 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' 2024-02-05T07:53:19.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:53:19 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:53:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:20 smithi188 ceph-mon[33283]: pgmap v1827: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-05T07:53:20.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:20 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:21.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:20 smithi184 ceph-mon[29861]: pgmap v1827: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-05T07:53:21.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:20 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:21.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:20 smithi184 ceph-mon[41609]: pgmap v1827: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-05T07:53:21.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:20 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:53:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:53:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:53:22.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:22 smithi188 ceph-mon[33283]: pgmap v1828: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-05T07:53:23.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:22 smithi184 ceph-mon[29861]: pgmap v1828: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-05T07:53:23.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:22 smithi184 ceph-mon[41609]: pgmap v1828: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-05T07:53:24.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:24 smithi188 ceph-mon[33283]: pgmap v1829: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:53:25.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:24 smithi184 ceph-mon[29861]: pgmap v1829: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:53:25.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:24 smithi184 ceph-mon[41609]: pgmap v1829: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:53:26.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:26 smithi188 ceph-mon[33283]: pgmap v1830: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:53:27.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:26 smithi184 ceph-mon[29861]: pgmap v1830: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:53:27.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:26 smithi184 ceph-mon[41609]: pgmap v1830: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:53:28.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:28 smithi188 ceph-mon[33283]: pgmap v1831: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 893 B/s rd, 0 op/s 2024-02-05T07:53:29.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:28 smithi184 ceph-mon[29861]: pgmap v1831: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 893 B/s rd, 0 op/s 2024-02-05T07:53:29.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:28 smithi184 ceph-mon[41609]: pgmap v1831: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 893 B/s rd, 0 op/s 2024-02-05T07:53:29.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:53:29 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:53:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:30 smithi188 ceph-mon[33283]: pgmap v1832: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:30 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:30.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:30 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:53:31.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:30 smithi184 ceph-mon[29861]: pgmap v1832: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:31.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:30 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:31.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:30 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:53:31.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:30 smithi184 ceph-mon[41609]: pgmap v1832: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:31.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:30 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:31.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:30 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:53:32.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:53:31 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:53:31] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:53:32.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:32 smithi188 ceph-mon[33283]: pgmap v1833: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:53:33.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:32 smithi184 ceph-mon[29861]: pgmap v1833: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:53:33.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:32 smithi184 ceph-mon[41609]: pgmap v1833: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:53:34.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:34 smithi188 ceph-mon[33283]: pgmap v1834: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:35.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:34 smithi184 ceph-mon[29861]: pgmap v1834: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:35.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:34 smithi184 ceph-mon[41609]: pgmap v1834: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:36.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:36 smithi188 ceph-mon[33283]: pgmap v1835: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:53:37.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:36 smithi184 ceph-mon[29861]: pgmap v1835: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:53:37.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:36 smithi184 ceph-mon[41609]: pgmap v1835: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:53:38.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:38 smithi188 ceph-mon[33283]: pgmap v1836: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:53:39.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:38 smithi184 ceph-mon[29861]: pgmap v1836: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:53:39.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:38 smithi184 ceph-mon[41609]: pgmap v1836: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:53:39.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:53:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:53:40.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:40 smithi188 ceph-mon[33283]: pgmap v1837: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:40.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:40 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:41.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:40 smithi184 ceph-mon[29861]: pgmap v1837: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:41.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:40 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:40 smithi184 ceph-mon[41609]: pgmap v1837: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:41.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:40 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:41.856 INFO:tasks.workunit.client.0.smithi184.stderr:+ rados -p 978227f4-3b71-45f5-b8b8-2286bb55bbcd put threemore /etc/passwd 2024-02-05T07:53:41.894 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool set-quota 978227f4-3b71-45f5-b8b8-2286bb55bbcd max_bytes 0 2024-02-05T07:53:41.983 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.980+0000 7f5e46b0d640 1 -- 172.21.15.184:0/2184938863 >> v1:172.21.15.184:6789/0 conn(0x7f5e4010dad0 legacy=0x7f5e4010ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:53:41.983 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.980+0000 7f5e46b0d640 1 -- 172.21.15.184:0/2184938863 shutdown_connections 2024-02-05T07:53:41.983 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.980+0000 7f5e46b0d640 1 -- 172.21.15.184:0/2184938863 >> 172.21.15.184:0/2184938863 conn(0x7f5e400fcb20 msgr2=0x7f5e400fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:53:41.983 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.980+0000 7f5e46b0d640 1 -- 172.21.15.184:0/2184938863 shutdown_connections 2024-02-05T07:53:41.984 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.980+0000 7f5e46b0d640 1 -- 172.21.15.184:0/2184938863 wait complete. 2024-02-05T07:53:41.984 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.980+0000 7f5e46b0d640 1 Processor -- start 2024-02-05T07:53:41.984 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.980+0000 7f5e46b0d640 1 -- start start 2024-02-05T07:53:41.984 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.980+0000 7f5e46b0d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5e401a5dd0 con 0x7f5e4010dad0 2024-02-05T07:53:41.984 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.980+0000 7f5e46b0d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5e401a6fd0 con 0x7f5e40109f60 2024-02-05T07:53:41.984 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.980+0000 7f5e46b0d640 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5e401a81d0 con 0x7f5e401012e0 2024-02-05T07:53:41.984 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.980+0000 7f5e448a9640 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f5e401012e0 0x7f5e401063f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:59962/0 (socket says 172.21.15.184:59962) 2024-02-05T07:53:41.984 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.980+0000 7f5e448a9640 1 -- 172.21.15.184:0/42805012 learned_addr learned my addr 172.21.15.184:0/42805012 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:53:41.984 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1286326917 0 0) 0x7f5e401a81d0 con 0x7f5e401012e0 2024-02-05T07:53:41.984 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e30003160 con 0x7f5e401012e0 2024-02-05T07:53:41.984 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554638264 0 0) 0x7f5e401a5dd0 con 0x7f5e4010dad0 2024-02-05T07:53:41.984 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e401a81d0 con 0x7f5e4010dad0 2024-02-05T07:53:41.984 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1639784323 0 0) 0x7f5e30003160 con 0x7f5e401012e0 2024-02-05T07:53:41.985 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5e401a5dd0 con 0x7f5e401012e0 2024-02-05T07:53:41.985 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701681828 0 0) 0x7f5e401a6fd0 con 0x7f5e40109f60 2024-02-05T07:53:41.985 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e30003160 con 0x7f5e40109f60 2024-02-05T07:53:41.985 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2559844920 0 0) 0x7f5e401a81d0 con 0x7f5e4010dad0 2024-02-05T07:53:41.985 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5e401a6fd0 con 0x7f5e4010dad0 2024-02-05T07:53:41.985 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f5e340019c0 con 0x7f5e401012e0 2024-02-05T07:53:41.985 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f5e38001ce0 con 0x7f5e4010dad0 2024-02-05T07:53:41.985 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2808297411 0 0) 0x7f5e401a5dd0 con 0x7f5e401012e0 2024-02-05T07:53:41.985 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 >> v1:172.21.15.188:6789/0 conn(0x7f5e40109f60 legacy=0x7f5e401a0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:53:41.985 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 >> v1:172.21.15.184:6789/0 conn(0x7f5e4010dad0 legacy=0x7f5e401a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:53:41.985 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e401a93d0 con 0x7f5e401012e0 2024-02-05T07:53:41.985 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e46b0d640 1 -- 172.21.15.184:0/42805012 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e401a5fc0 con 0x7f5e401012e0 2024-02-05T07:53:41.985 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f5e34001cf0 con 0x7f5e401012e0 2024-02-05T07:53:41.986 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f5e34005c80 con 0x7f5e401012e0 2024-02-05T07:53:41.986 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.981+0000 7f5e46b0d640 1 -- 172.21.15.184:0/42805012 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e401a6450 con 0x7f5e401012e0 2024-02-05T07:53:41.986 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.983+0000 7f5e46b0d640 1 -- 172.21.15.184:0/42805012 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e401027b0 con 0x7f5e401012e0 2024-02-05T07:53:41.986 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.983+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f5e340038c0 con 0x7f5e401012e0 2024-02-05T07:53:41.986 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.983+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(834..834 src has 253..834) v4 ==== 8206+0+0 (unknown 4015484973 0 0) 0x7f5e34089160 con 0x7f5e401012e0 2024-02-05T07:53:41.987 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.983+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=835}) v3 -- 0x7f5e401a5dd0 con 0x7f5e401012e0 2024-02-05T07:53:41.988 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:41.988+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f5e34055c60 con 0x7f5e401012e0 2024-02-05T07:53:42.164 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:42.163+0000 7f5e46b0d640 1 -- 172.21.15.184:0/42805012 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f5e40068310 con 0x7f5e401012e0 2024-02-05T07:53:42.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:53:41 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:53:41] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:53:42.574 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:42.573+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.2 v1:172.21.15.184:6790/0 10 ==== osd_map(835..835 src has 253..835) v4 ==== 628+0+0 (unknown 2861724299 0 0) 0x7f5e34056590 con 0x7f5e401012e0 2024-02-05T07:53:42.574 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:42.573+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=836}) v3 -- 0x7f5e401a6fd0 con 0x7f5e401012e0 2024-02-05T07:53:42.579 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:42.577+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.2 v1:172.21.15.184:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd v835) v1 ==== 217+0+0 (unknown 28854315 0 0) 0x7f5e34053fd0 con 0x7f5e401012e0 2024-02-05T07:53:42.686 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:42.685+0000 7f5e46b0d640 1 -- 172.21.15.184:0/42805012 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7f5e401049c0 con 0x7f5e401012e0 2024-02-05T07:53:42.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:42 smithi188 ceph-mon[33283]: pgmap v1838: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:53:42.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:42 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/42805012' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:53:42.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:42 smithi188 ceph-mon[33283]: from='client.58616 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:53:43.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:42 smithi184 ceph-mon[29861]: pgmap v1838: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:53:43.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:42 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/42805012' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:53:43.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:42 smithi184 ceph-mon[29861]: from='client.58616 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:53:43.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:42 smithi184 ceph-mon[41609]: pgmap v1838: 188 pgs: 188 active+clean; 852 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:53:43.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:42 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/42805012' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:53:43.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:42 smithi184 ceph-mon[41609]: from='client.58616 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:53:43.593 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.592+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.2 v1:172.21.15.184:6790/0 12 ==== osd_map(836..836 src has 253..836) v4 ==== 628+0+0 (unknown 3914161455 0 0) 0x7f5e34059fe0 con 0x7f5e401012e0 2024-02-05T07:53:43.594 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.592+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=837}) v3 -- 0x7f5e401a81d0 con 0x7f5e401012e0 2024-02-05T07:53:43.598 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.597+0000 7f5e3dffb640 1 -- 172.21.15.184:0/42805012 <== mon.2 v1:172.21.15.184:6790/0 13 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd v836) v1 ==== 217+0+0 (unknown 1021412515 0 0) 0x7f5e340557f0 con 0x7f5e401012e0 2024-02-05T07:53:43.598 INFO:tasks.workunit.client.0.smithi184.stderr:set-quota max_bytes = 0 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd 2024-02-05T07:53:43.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.601+0000 7f5e46b0d640 1 -- 172.21.15.184:0/42805012 >> v1:172.21.15.184:6800/103463156 conn(0x7f5e3006e9c0 legacy=0x7f5e30070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:53:43.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.601+0000 7f5e46b0d640 1 -- 172.21.15.184:0/42805012 >> v1:172.21.15.184:6790/0 conn(0x7f5e401012e0 legacy=0x7f5e401063f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:53:43.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.601+0000 7f5e46b0d640 1 -- 172.21.15.184:0/42805012 shutdown_connections 2024-02-05T07:53:43.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.601+0000 7f5e46b0d640 1 -- 172.21.15.184:0/42805012 >> 172.21.15.184:0/42805012 conn(0x7f5e400fcb20 msgr2=0x7f5e40110ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:53:43.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.601+0000 7f5e46b0d640 1 -- 172.21.15.184:0/42805012 shutdown_connections 2024-02-05T07:53:43.602 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.601+0000 7f5e46b0d640 1 -- 172.21.15.184:0/42805012 wait complete. 2024-02-05T07:53:43.613 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool set-quota 978227f4-3b71-45f5-b8b8-2286bb55bbcd max_objects 0 2024-02-05T07:53:43.703 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.699+0000 7faec7af0640 1 -- 172.21.15.184:0/3898337184 >> v1:172.21.15.184:6790/0 conn(0x7faec0100330 legacy=0x7faec0100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:53:43.703 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.699+0000 7faec7af0640 1 -- 172.21.15.184:0/3898337184 shutdown_connections 2024-02-05T07:53:43.704 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.699+0000 7faec7af0640 1 -- 172.21.15.184:0/3898337184 >> 172.21.15.184:0/3898337184 conn(0x7faec0075ae0 msgr2=0x7faec0075ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:53:43.704 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.699+0000 7faec7af0640 1 -- 172.21.15.184:0/3898337184 shutdown_connections 2024-02-05T07:53:43.704 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.699+0000 7faec7af0640 1 -- 172.21.15.184:0/3898337184 wait complete. 2024-02-05T07:53:43.704 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.699+0000 7faec7af0640 1 Processor -- start 2024-02-05T07:53:43.704 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faec7af0640 1 -- start start 2024-02-05T07:53:43.704 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faec7af0640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7faec01a5d40 con 0x7faec0108e70 2024-02-05T07:53:43.704 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faec7af0640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7faec01a6f20 con 0x7faec0100330 2024-02-05T07:53:43.704 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faec7af0640 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7faec01a8120 con 0x7faec010c9e0 2024-02-05T07:53:43.704 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faec608d640 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7faec010c9e0 0x7faec01a4490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:59974/0 (socket says 172.21.15.184:59974) 2024-02-05T07:53:43.704 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faec608d640 1 -- 172.21.15.184:0/1876760405 learned_addr learned my addr 172.21.15.184:0/1876760405 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:53:43.704 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faec508b640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7faec0108e70 0x7faec01a0d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:54750/0 (socket says 172.21.15.184:54750) 2024-02-05T07:53:43.705 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306523963 0 0) 0x7faec01a5d40 con 0x7faec0108e70 2024-02-05T07:53:43.705 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeac003160 con 0x7faec0108e70 2024-02-05T07:53:43.705 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108417574 0 0) 0x7faec01a8120 con 0x7faec010c9e0 2024-02-05T07:53:43.705 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faec01a5d40 con 0x7faec010c9e0 2024-02-05T07:53:43.705 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057268050 0 0) 0x7faec01a6f20 con 0x7faec0100330 2024-02-05T07:53:43.705 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faec01a8120 con 0x7faec0100330 2024-02-05T07:53:43.705 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 246293995 0 0) 0x7faeac003160 con 0x7faec0108e70 2024-02-05T07:53:43.705 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faec01a6f20 con 0x7faec0108e70 2024-02-05T07:53:43.706 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3518117457 0 0) 0x7faec01a5d40 con 0x7faec010c9e0 2024-02-05T07:53:43.706 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faeac003160 con 0x7faec010c9e0 2024-02-05T07:53:43.706 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7faeb00019f0 con 0x7faec0108e70 2024-02-05T07:53:43.706 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7faeb8001cc0 con 0x7faec010c9e0 2024-02-05T07:53:43.706 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3953936805 0 0) 0x7faec01a8120 con 0x7faec0100330 2024-02-05T07:53:43.706 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faec01a5d40 con 0x7faec0100330 2024-02-05T07:53:43.706 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7faebc003790 con 0x7faec0100330 2024-02-05T07:53:43.706 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.0 v1:172.21.15.184:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4198186971 0 0) 0x7faec01a6f20 con 0x7faec0108e70 2024-02-05T07:53:43.706 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 >> v1:172.21.15.184:6790/0 conn(0x7faec010c9e0 legacy=0x7faec01a4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:53:43.706 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 >> v1:172.21.15.188:6789/0 conn(0x7faec0100330 legacy=0x7faec0105320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:53:43.707 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.700+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 --> v1:172.21.15.184:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec01a9320 con 0x7faec0108e70 2024-02-05T07:53:43.707 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.701+0000 7faec7af0640 1 -- 172.21.15.184:0/1876760405 --> v1:172.21.15.184:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec01a5f30 con 0x7faec0108e70 2024-02-05T07:53:43.707 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.701+0000 7faec7af0640 1 -- 172.21.15.184:0/1876760405 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7faec01a63c0 con 0x7faec0108e70 2024-02-05T07:53:43.707 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.701+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.0 v1:172.21.15.184:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7faeb0003a80 con 0x7faec0108e70 2024-02-05T07:53:43.707 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.701+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.0 v1:172.21.15.184:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7faeb0005a80 con 0x7faec0108e70 2024-02-05T07:53:43.707 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.702+0000 7faec7af0640 1 -- 172.21.15.184:0/1876760405 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea4005080 con 0x7faec0108e70 2024-02-05T07:53:43.707 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.702+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.0 v1:172.21.15.184:6789/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7faeb001c110 con 0x7faec0108e70 2024-02-05T07:53:43.707 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.702+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.0 v1:172.21.15.184:6789/0 8 ==== osd_map(836..836 src has 253..836) v4 ==== 8206+0+0 (unknown 2088963601 0 0) 0x7faeb0088f20 con 0x7faec0108e70 2024-02-05T07:53:43.707 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.703+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=837}) v3 -- 0x7faec01a6f20 con 0x7faec0108e70 2024-02-05T07:53:43.708 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.707+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.0 v1:172.21.15.184:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7faeb0055a40 con 0x7faec0108e70 2024-02-05T07:53:43.882 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:43.881+0000 7faec7af0640 1 -- 172.21.15.184:0/1876760405 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7faea4005330 con 0x7faec0108e70 2024-02-05T07:53:43.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:43 smithi188 ceph-mon[33283]: from='client.58616 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]': finished 2024-02-05T07:53:43.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:43 smithi188 ceph-mon[33283]: osdmap e835: 8 total, 8 up, 8 in 2024-02-05T07:53:43.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:43 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/42805012' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:53:43.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:43 smithi188 ceph-mon[33283]: from='client.58616 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:53:44.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:43 smithi184 ceph-mon[29861]: from='client.58616 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]': finished 2024-02-05T07:53:44.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:43 smithi184 ceph-mon[29861]: osdmap e835: 8 total, 8 up, 8 in 2024-02-05T07:53:44.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:43 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/42805012' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:53:44.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:43 smithi184 ceph-mon[29861]: from='client.58616 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:53:44.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:43 smithi184 ceph-mon[41609]: from='client.58616 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]': finished 2024-02-05T07:53:44.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:43 smithi184 ceph-mon[41609]: osdmap e835: 8 total, 8 up, 8 in 2024-02-05T07:53:44.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:43 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/42805012' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:53:44.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:43 smithi184 ceph-mon[41609]: from='client.58616 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-05T07:53:44.593 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:44.592+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.0 v1:172.21.15.184:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd v837) v1 ==== 221+0+0 (unknown 1367361253 0 0) 0x7faeb0053db0 con 0x7faec0108e70 2024-02-05T07:53:44.596 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:44.595+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.0 v1:172.21.15.184:6789/0 11 ==== osd_map(837..837 src has 253..837) v4 ==== 628+0+0 (unknown 4141009951 0 0) 0x7faeb0056370 con 0x7faec0108e70 2024-02-05T07:53:44.596 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:44.595+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=838}) v3 -- 0x7faeac003160 con 0x7faec0108e70 2024-02-05T07:53:44.706 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:44.705+0000 7faec7af0640 1 -- 172.21.15.184:0/1876760405 --> v1:172.21.15.184:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7faea4001110 con 0x7faec0108e70 2024-02-05T07:53:44.922 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:44 smithi184 ceph-mon[29861]: pgmap v1840: 188 pgs: 188 active+clean; 863 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1.2 KiB/s wr, 1 op/s 2024-02-05T07:53:44.922 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:44 smithi184 ceph-mon[29861]: from='client.58616 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]': finished 2024-02-05T07:53:44.922 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:44 smithi184 ceph-mon[29861]: osdmap e836: 8 total, 8 up, 8 in 2024-02-05T07:53:44.922 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:44 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1876760405' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:53:44.922 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:44 smithi184 ceph-mon[41609]: pgmap v1840: 188 pgs: 188 active+clean; 863 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1.2 KiB/s wr, 1 op/s 2024-02-05T07:53:44.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:44 smithi184 ceph-mon[41609]: from='client.58616 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]': finished 2024-02-05T07:53:44.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:44 smithi184 ceph-mon[41609]: osdmap e836: 8 total, 8 up, 8 in 2024-02-05T07:53:44.923 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:44 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1876760405' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:53:44.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:44 smithi188 ceph-mon[33283]: pgmap v1840: 188 pgs: 188 active+clean; 863 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 1.2 KiB/s wr, 1 op/s 2024-02-05T07:53:44.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:44 smithi188 ceph-mon[33283]: from='client.58616 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_bytes", "val": "0"}]': finished 2024-02-05T07:53:44.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:44 smithi188 ceph-mon[33283]: osdmap e836: 8 total, 8 up, 8 in 2024-02-05T07:53:44.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:44 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1876760405' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:53:45.611 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:45.610+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.0 v1:172.21.15.184:6789/0 12 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd v838) v1 ==== 221+0+0 (unknown 3567075895 0 0) 0x7faeb00555d0 con 0x7faec0108e70 2024-02-05T07:53:45.611 INFO:tasks.workunit.client.0.smithi184.stderr:set-quota max_objects = 0 for pool 978227f4-3b71-45f5-b8b8-2286bb55bbcd 2024-02-05T07:53:45.611 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:45.610+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 <== mon.0 v1:172.21.15.184:6789/0 13 ==== osd_map(838..838 src has 253..838) v4 ==== 628+0+0 (unknown 3628124100 0 0) 0x7faeb0056370 con 0x7faec0108e70 2024-02-05T07:53:45.612 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:45.610+0000 7faeb6ffd640 1 -- 172.21.15.184:0/1876760405 --> v1:172.21.15.184:6789/0 -- mon_subscribe({osdmap=839}) v3 -- 0x7faec01a8120 con 0x7faec0108e70 2024-02-05T07:53:45.615 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:45.614+0000 7faec7af0640 1 -- 172.21.15.184:0/1876760405 >> v1:172.21.15.184:6800/103463156 conn(0x7faeac06e9a0 legacy=0x7faeac070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:53:45.615 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:45.614+0000 7faec7af0640 1 -- 172.21.15.184:0/1876760405 >> v1:172.21.15.184:6789/0 conn(0x7faec0108e70 legacy=0x7faec01a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:53:45.615 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:45.614+0000 7faec7af0640 1 -- 172.21.15.184:0/1876760405 shutdown_connections 2024-02-05T07:53:45.615 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:45.614+0000 7faec7af0640 1 -- 172.21.15.184:0/1876760405 >> 172.21.15.184:0/1876760405 conn(0x7faec0075ae0 msgr2=0x7faec0068310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:53:45.615 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:45.614+0000 7faec7af0640 1 -- 172.21.15.184:0/1876760405 shutdown_connections 2024-02-05T07:53:45.615 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:53:45.614+0000 7faec7af0640 1 -- 172.21.15.184:0/1876760405 wait complete. 2024-02-05T07:53:45.628 INFO:tasks.workunit.client.0.smithi184.stderr:+ sleep 30 2024-02-05T07:53:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1876760405' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]': finished 2024-02-05T07:53:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:45 smithi188 ceph-mon[33283]: osdmap e837: 8 total, 8 up, 8 in 2024-02-05T07:53:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:45 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1876760405' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:53:45.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:45 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:53:46.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1876760405' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]': finished 2024-02-05T07:53:46.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:45 smithi184 ceph-mon[29861]: osdmap e837: 8 total, 8 up, 8 in 2024-02-05T07:53:46.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:45 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1876760405' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:53:46.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:45 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:53:46.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1876760405' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]': finished 2024-02-05T07:53:46.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:45 smithi184 ceph-mon[41609]: osdmap e837: 8 total, 8 up, 8 in 2024-02-05T07:53:46.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:45 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1876760405' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]: dispatch 2024-02-05T07:53:46.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:45 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:53:46.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:46 smithi188 ceph-mon[33283]: pgmap v1843: 188 pgs: 188 active+clean; 863 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 2.0 KiB/s wr, 0 op/s 2024-02-05T07:53:46.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:46 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1876760405' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]': finished 2024-02-05T07:53:46.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:46 smithi188 ceph-mon[33283]: osdmap e838: 8 total, 8 up, 8 in 2024-02-05T07:53:47.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:46 smithi184 ceph-mon[29861]: pgmap v1843: 188 pgs: 188 active+clean; 863 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 2.0 KiB/s wr, 0 op/s 2024-02-05T07:53:47.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:46 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1876760405' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]': finished 2024-02-05T07:53:47.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:46 smithi184 ceph-mon[29861]: osdmap e838: 8 total, 8 up, 8 in 2024-02-05T07:53:47.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:46 smithi184 ceph-mon[41609]: pgmap v1843: 188 pgs: 188 active+clean; 863 KiB data, 921 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 2.0 KiB/s wr, 0 op/s 2024-02-05T07:53:47.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:46 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1876760405' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "field": "max_objects", "val": "0"}]': finished 2024-02-05T07:53:47.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:46 smithi184 ceph-mon[41609]: osdmap e838: 8 total, 8 up, 8 in 2024-02-05T07:53:48.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:48 smithi188 ceph-mon[33283]: pgmap v1845: 188 pgs: 188 active+clean; 863 KiB data, 921 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:53:49.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:48 smithi184 ceph-mon[29861]: pgmap v1845: 188 pgs: 188 active+clean; 863 KiB data, 921 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:53:49.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:48 smithi184 ceph-mon[41609]: pgmap v1845: 188 pgs: 188 active+clean; 863 KiB data, 921 MiB used, 714 GiB / 715 GiB avail 2024-02-05T07:53:49.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:53:49 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:53:50.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:50 smithi188 ceph-mon[33283]: pgmap v1846: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:53:50.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:50 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:51.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:50 smithi184 ceph-mon[29861]: pgmap v1846: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:53:51.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:50 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:51.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:50 smithi184 ceph-mon[41609]: pgmap v1846: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:53:51.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:50 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:53:52.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:53:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:53:51] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:53:52.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:52 smithi188 ceph-mon[33283]: pgmap v1847: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 707 B/s rd, 0 op/s 2024-02-05T07:53:53.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:52 smithi184 ceph-mon[29861]: pgmap v1847: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 707 B/s rd, 0 op/s 2024-02-05T07:53:53.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:52 smithi184 ceph-mon[41609]: pgmap v1847: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 707 B/s rd, 0 op/s 2024-02-05T07:53:54.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:54 smithi188 ceph-mon[33283]: pgmap v1848: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:55.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:54 smithi184 ceph-mon[29861]: pgmap v1848: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:55.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:54 smithi184 ceph-mon[41609]: pgmap v1848: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:53:56.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:56 smithi188 ceph-mon[33283]: pgmap v1849: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:53:57.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:56 smithi184 ceph-mon[29861]: pgmap v1849: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:53:57.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:56 smithi184 ceph-mon[41609]: pgmap v1849: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:53:58.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:53:58 smithi188 ceph-mon[33283]: pgmap v1850: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 912 B/s rd, 0 op/s 2024-02-05T07:53:59.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:53:58 smithi184 ceph-mon[29861]: pgmap v1850: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 912 B/s rd, 0 op/s 2024-02-05T07:53:59.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:53:58 smithi184 ceph-mon[41609]: pgmap v1850: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 912 B/s rd, 0 op/s 2024-02-05T07:53:59.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:53:59 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:54:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:00 smithi188 ceph-mon[33283]: pgmap v1851: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:54:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:00 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:54:00.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:00 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:54:01.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:00 smithi184 ceph-mon[29861]: pgmap v1851: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:54:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:00 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:54:01.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:00 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:54:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:00 smithi184 ceph-mon[41609]: pgmap v1851: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:54:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:00 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:54:01.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:00 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:54:02.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:01 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:54:01] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:54:02.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:02 smithi188 ceph-mon[33283]: pgmap v1852: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:54:03.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:02 smithi184 ceph-mon[29861]: pgmap v1852: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:54:03.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:02 smithi184 ceph-mon[41609]: pgmap v1852: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:54:04.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:04 smithi188 ceph-mon[33283]: pgmap v1853: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:54:05.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:04 smithi184 ceph-mon[29861]: pgmap v1853: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:54:05.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:04 smithi184 ceph-mon[41609]: pgmap v1853: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:54:06.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:06 smithi188 ceph-mon[33283]: pgmap v1854: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:54:07.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:06 smithi184 ceph-mon[29861]: pgmap v1854: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:54:07.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:06 smithi184 ceph-mon[41609]: pgmap v1854: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:54:08.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:08 smithi188 ceph-mon[33283]: pgmap v1855: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:54:09.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:08 smithi184 ceph-mon[29861]: pgmap v1855: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:54:09.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:08 smithi184 ceph-mon[41609]: pgmap v1855: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:54:09.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:54:09 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:54:10.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:10 smithi188 ceph-mon[33283]: pgmap v1856: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:54:10.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:10 smithi188 ceph-mon[33283]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:54:11.020 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:10 smithi184 ceph-mon[29861]: pgmap v1856: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:54:11.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:10 smithi184 ceph-mon[29861]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:54:11.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:10 smithi184 ceph-mon[41609]: pgmap v1856: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:54:11.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:10 smithi184 ceph-mon[41609]: from='client.14562 v1:172.21.15.188:0/1171860782' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-05T07:54:12.271 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:11 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:54:11] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:54:12.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:12 smithi188 ceph-mon[33283]: pgmap v1857: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:54:13.022 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:12 smithi184 ceph-mon[29861]: pgmap v1857: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:54:13.022 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:12 smithi184 ceph-mon[41609]: pgmap v1857: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-05T07:54:14.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:14 smithi188 ceph-mon[33283]: pgmap v1858: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:54:15.021 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:14 smithi184 ceph-mon[29861]: pgmap v1858: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:54:15.021 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:14 smithi184 ceph-mon[41609]: pgmap v1858: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-05T07:54:15.629 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool delete 978227f4-3b71-45f5-b8b8-2286bb55bbcd 978227f4-3b71-45f5-b8b8-2286bb55bbcd --yes-i-really-really-mean-it 2024-02-05T07:54:15.723 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.719+0000 7f803e49d640 1 -- 172.21.15.184:0/1013635919 >> v1:172.21.15.184:6789/0 conn(0x7f8038068580 legacy=0x7f8038068960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:54:15.724 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.719+0000 7f803e49d640 1 -- 172.21.15.184:0/1013635919 shutdown_connections 2024-02-05T07:54:15.724 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.719+0000 7f803e49d640 1 -- 172.21.15.184:0/1013635919 >> 172.21.15.184:0/1013635919 conn(0x7f8038075ae0 msgr2=0x7f8038075ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:54:15.724 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.719+0000 7f803e49d640 1 -- 172.21.15.184:0/1013635919 shutdown_connections 2024-02-05T07:54:15.724 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.719+0000 7f803e49d640 1 -- 172.21.15.184:0/1013635919 wait complete. 2024-02-05T07:54:15.724 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.720+0000 7f803e49d640 1 Processor -- start 2024-02-05T07:54:15.724 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.720+0000 7f803e49d640 1 -- start start 2024-02-05T07:54:15.724 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.720+0000 7f803e49d640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f80381a5e80 con 0x7f803810daf0 2024-02-05T07:54:15.724 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.720+0000 7f803e49d640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f80381a7080 con 0x7f8038068580 2024-02-05T07:54:15.724 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.720+0000 7f803e49d640 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f80381a8280 con 0x7f8038109fb0 2024-02-05T07:54:15.724 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.720+0000 7f80377fe640 1 --1- >> v1:172.21.15.184:6790/0 conn(0x7f8038109fb0 0x7f80381a0e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6790/0 says I am v1:172.21.15.184:41968/0 (socket says 172.21.15.184:41968) 2024-02-05T07:54:15.725 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.720+0000 7f80377fe640 1 -- 172.21.15.184:0/733546957 learned_addr learned my addr 172.21.15.184:0/733546957 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:54:15.725 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.720+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116367024 0 0) 0x7f80381a8280 con 0x7f8038109fb0 2024-02-05T07:54:15.725 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.720+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8020004950 con 0x7f8038109fb0 2024-02-05T07:54:15.725 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.720+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077464753 0 0) 0x7f80381a5e80 con 0x7f803810daf0 2024-02-05T07:54:15.725 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.720+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80381a8280 con 0x7f803810daf0 2024-02-05T07:54:15.725 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.720+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249131903 0 0) 0x7f80381a7080 con 0x7f8038068580 2024-02-05T07:54:15.725 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80381a5e80 con 0x7f8038068580 2024-02-05T07:54:15.725 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4104566829 0 0) 0x7f8020004950 con 0x7f8038109fb0 2024-02-05T07:54:15.725 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f80381a7080 con 0x7f8038109fb0 2024-02-05T07:54:15.725 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f802c0018d0 con 0x7f8038109fb0 2024-02-05T07:54:15.725 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4084217983 0 0) 0x7f80381a8280 con 0x7f803810daf0 2024-02-05T07:54:15.726 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f8020004950 con 0x7f803810daf0 2024-02-05T07:54:15.726 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2147575863 0 0) 0x7f80381a5e80 con 0x7f8038068580 2024-02-05T07:54:15.726 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f80381a8280 con 0x7f8038068580 2024-02-05T07:54:15.726 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f8030001b70 con 0x7f803810daf0 2024-02-05T07:54:15.726 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f80280043b0 con 0x7f8038068580 2024-02-05T07:54:15.726 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3983536113 0 0) 0x7f80381a7080 con 0x7f8038109fb0 2024-02-05T07:54:15.727 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 >> v1:172.21.15.188:6789/0 conn(0x7f8038068580 legacy=0x7f80381064a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:54:15.727 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 >> v1:172.21.15.184:6789/0 conn(0x7f803810daf0 legacy=0x7f80381a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:54:15.727 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80381a9480 con 0x7f8038109fb0 2024-02-05T07:54:15.727 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f803e49d640 1 -- 172.21.15.184:0/733546957 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80381a6070 con 0x7f8038109fb0 2024-02-05T07:54:15.727 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f803e49d640 1 -- 172.21.15.184:0/733546957 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f80381a6580 con 0x7f8038109fb0 2024-02-05T07:54:15.727 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7f802c003a80 con 0x7f8038109fb0 2024-02-05T07:54:15.727 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.721+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7f802c005b10 con 0x7f8038109fb0 2024-02-05T07:54:15.727 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.722+0000 7f803e49d640 1 -- 172.21.15.184:0/733546957 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8024005080 con 0x7f8038109fb0 2024-02-05T07:54:15.727 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.722+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7f802c0035f0 con 0x7f8038109fb0 2024-02-05T07:54:15.728 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.723+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(838..838 src has 253..838) v4 ==== 8206+0+0 (unknown 231678981 0 0) 0x7f802c088fb0 con 0x7f8038109fb0 2024-02-05T07:54:15.729 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.723+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=839}) v3 -- 0x7f80381a7080 con 0x7f8038109fb0 2024-02-05T07:54:15.729 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.727+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7f802c055b70 con 0x7f8038109fb0 2024-02-05T07:54:15.901 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:15.900+0000 7f803e49d640 1 -- 172.21.15.184:0/733546957 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8024005330 con 0x7f8038109fb0 2024-02-05T07:54:16.658 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.657+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.2 v1:172.21.15.184:6790/0 10 ==== osd_map(839..839 src has 253..839) v4 ==== 296+0+0 (unknown 1233592323 0 0) 0x7f802c0564a0 con 0x7f8038109fb0 2024-02-05T07:54:16.659 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.657+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=840}) v3 -- 0x7f80381a5e80 con 0x7f8038109fb0 2024-02-05T07:54:16.662 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.661+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.2 v1:172.21.15.184:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]=0 pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' removed v839) v1 ==== 248+0+0 (unknown 3519481882 0 0) 0x7f802c053ee0 con 0x7f8038109fb0 2024-02-05T07:54:16.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:16 smithi188 ceph-mon[33283]: pgmap v1859: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:54:16.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:16 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:54:16.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:16 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/733546957' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:16.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:16 smithi188 ceph-mon[33283]: from='client.58628 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:16.770 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:16 smithi184 ceph-mon[29861]: pgmap v1859: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:54:16.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:16 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:54:16.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:16 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/733546957' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:16.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:16 smithi184 ceph-mon[29861]: from='client.58628 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:16 smithi184 ceph-mon[41609]: pgmap v1859: 188 pgs: 188 active+clean; 863 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-05T07:54:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:16 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-05T07:54:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:16 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/733546957' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:16.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:16 smithi184 ceph-mon[41609]: from='client.58628 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:16.777 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.776+0000 7f803e49d640 1 -- 172.21.15.184:0/733546957 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8024005b40 con 0x7f8038109fb0 2024-02-05T07:54:16.778 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.777+0000 7f80357fa640 1 -- 172.21.15.184:0/733546957 <== mon.2 v1:172.21.15.184:6790/0 12 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]=0 pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' does not exist v839) v1 ==== 255+0+0 (unknown 3534642124 0 0) 0x7f802c053ee0 con 0x7f8038109fb0 2024-02-05T07:54:16.778 INFO:tasks.workunit.client.0.smithi184.stderr:pool '978227f4-3b71-45f5-b8b8-2286bb55bbcd' does not exist 2024-02-05T07:54:16.781 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.779+0000 7f803e49d640 1 -- 172.21.15.184:0/733546957 >> v1:172.21.15.184:6800/103463156 conn(0x7f802006ead0 legacy=0x7f8020070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:54:16.781 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.779+0000 7f803e49d640 1 -- 172.21.15.184:0/733546957 >> v1:172.21.15.184:6790/0 conn(0x7f8038109fb0 legacy=0x7f80381a0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:54:16.781 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.780+0000 7f803e49d640 1 -- 172.21.15.184:0/733546957 shutdown_connections 2024-02-05T07:54:16.781 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.780+0000 7f803e49d640 1 -- 172.21.15.184:0/733546957 >> 172.21.15.184:0/733546957 conn(0x7f8038075ae0 msgr2=0x7f8038110820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:54:16.781 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.780+0000 7f803e49d640 1 -- 172.21.15.184:0/733546957 shutdown_connections 2024-02-05T07:54:16.781 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.780+0000 7f803e49d640 1 -- 172.21.15.184:0/733546957 wait complete. 2024-02-05T07:54:16.790 INFO:tasks.workunit.client.0.smithi184.stderr:+ ceph osd pool delete 7442f913-a0b7-47b3-a4e1-c84de7254b55 7442f913-a0b7-47b3-a4e1-c84de7254b55 --yes-i-really-really-mean-it 2024-02-05T07:54:16.874 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.871+0000 7fa2bd71e640 1 -- 172.21.15.184:0/2458191472 >> v1:172.21.15.184:6790/0 conn(0x7fa2b8101300 legacy=0x7fa2b81016e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:54:16.874 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.871+0000 7fa2bd71e640 1 -- 172.21.15.184:0/2458191472 shutdown_connections 2024-02-05T07:54:16.874 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.871+0000 7fa2bd71e640 1 -- 172.21.15.184:0/2458191472 >> 172.21.15.184:0/2458191472 conn(0x7fa2b80fcb60 msgr2=0x7fa2b80fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:54:16.874 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.871+0000 7fa2bd71e640 1 -- 172.21.15.184:0/2458191472 shutdown_connections 2024-02-05T07:54:16.875 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.871+0000 7fa2bd71e640 1 -- 172.21.15.184:0/2458191472 wait complete. 2024-02-05T07:54:16.875 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.871+0000 7fa2bd71e640 1 Processor -- start 2024-02-05T07:54:16.875 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.871+0000 7fa2bd71e640 1 -- start start 2024-02-05T07:54:16.875 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa2bd71e640 1 -- --> v1:172.21.15.184:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa2b81a5d70 con 0x7fa2b8109f80 2024-02-05T07:54:16.875 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa2bd71e640 1 -- --> v1:172.21.15.188:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa2b81a6f70 con 0x7fa2b810daf0 2024-02-05T07:54:16.875 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa2bd71e640 1 -- --> v1:172.21.15.184:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa2b81a8170 con 0x7fa2b8101300 2024-02-05T07:54:16.875 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa2b67fc640 1 --1- >> v1:172.21.15.184:6789/0 conn(0x7fa2b8109f80 0x7fa2b81a0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.184:6789/0 says I am v1:172.21.15.184:59698/0 (socket says 172.21.15.184:59698) 2024-02-05T07:54:16.875 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa2b67fc640 1 -- 172.21.15.184:0/1372603888 learned_addr learned my addr 172.21.15.184:0/1372603888 (peer_addr_for_me v1:172.21.15.184:0/0) 2024-02-05T07:54:16.875 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.2 v1:172.21.15.184:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38783759 0 0) 0x7fa2b81a8170 con 0x7fa2b8101300 2024-02-05T07:54:16.875 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 --> v1:172.21.15.184:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2a0003520 con 0x7fa2b8101300 2024-02-05T07:54:16.875 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.0 v1:172.21.15.184:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1133456269 0 0) 0x7fa2b81a5d70 con 0x7fa2b8109f80 2024-02-05T07:54:16.875 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 --> v1:172.21.15.184:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2b81a8170 con 0x7fa2b8109f80 2024-02-05T07:54:16.875 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.1 v1:172.21.15.188:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031235958 0 0) 0x7fa2b81a6f70 con 0x7fa2b810daf0 2024-02-05T07:54:16.876 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 --> v1:172.21.15.188:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2b81a5d70 con 0x7fa2b810daf0 2024-02-05T07:54:16.876 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.2 v1:172.21.15.184:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 273354172 0 0) 0x7fa2a0003520 con 0x7fa2b8101300 2024-02-05T07:54:16.876 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 --> v1:172.21.15.184:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa2b81a6f70 con 0x7fa2b8101300 2024-02-05T07:54:16.876 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.2 v1:172.21.15.184:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fa2a80046f0 con 0x7fa2b8101300 2024-02-05T07:54:16.876 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.0 v1:172.21.15.184:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1638913348 0 0) 0x7fa2b81a8170 con 0x7fa2b8109f80 2024-02-05T07:54:16.876 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 --> v1:172.21.15.184:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa2a0003520 con 0x7fa2b8109f80 2024-02-05T07:54:16.876 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.0 v1:172.21.15.184:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fa2ac001910 con 0x7fa2b8109f80 2024-02-05T07:54:16.876 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.1 v1:172.21.15.188:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3575637584 0 0) 0x7fa2b81a5d70 con 0x7fa2b810daf0 2024-02-05T07:54:16.876 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 --> v1:172.21.15.188:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa2b81a8170 con 0x7fa2b810daf0 2024-02-05T07:54:16.876 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.1 v1:172.21.15.188:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fa2b0001070 con 0x7fa2b810daf0 2024-02-05T07:54:16.876 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.2 v1:172.21.15.184:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3479871640 0 0) 0x7fa2b81a6f70 con 0x7fa2b8101300 2024-02-05T07:54:16.876 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 >> v1:172.21.15.188:6789/0 conn(0x7fa2b810daf0 legacy=0x7fa2b81a4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:54:16.876 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 >> v1:172.21.15.184:6789/0 conn(0x7fa2b8109f80 legacy=0x7fa2b81a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:54:16.877 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 --> v1:172.21.15.184:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b81a9370 con 0x7fa2b8101300 2024-02-05T07:54:16.877 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa2bd71e640 1 -- 172.21.15.184:0/1372603888 --> v1:172.21.15.184:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b81a8360 con 0x7fa2b8101300 2024-02-05T07:54:16.877 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa2bd71e640 1 -- 172.21.15.184:0/1372603888 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b81a87f0 con 0x7fa2b8101300 2024-02-05T07:54:16.877 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.2 v1:172.21.15.184:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1315394423 0 0) 0x7fa2a8001460 con 0x7fa2b8101300 2024-02-05T07:54:16.877 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.872+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.2 v1:172.21.15.184:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 2521660925 0 0) 0x7fa2a8004fc0 con 0x7fa2b8101300 2024-02-05T07:54:16.878 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.873+0000 7fa2bd71e640 1 -- 172.21.15.184:0/1372603888 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a4005080 con 0x7fa2b8101300 2024-02-05T07:54:16.878 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.874+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.2 v1:172.21.15.184:6790/0 7 ==== mgrmap(e 21) v1 ==== 91430+0+0 (unknown 3400996958 0 0) 0x7fa2a8003970 con 0x7fa2b8101300 2024-02-05T07:54:16.878 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.874+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.2 v1:172.21.15.184:6790/0 8 ==== osd_map(839..839 src has 253..839) v4 ==== 7818+0+0 (unknown 3649610217 0 0) 0x7fa2a8088320 con 0x7fa2b8101300 2024-02-05T07:54:16.878 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.874+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=840}) v3 -- 0x7fa2b81a6f70 con 0x7fa2b8101300 2024-02-05T07:54:16.879 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:16.879+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.2 v1:172.21.15.184:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (unknown 1092875540 0 1883366685) 0x7fa2a8054fb0 con 0x7fa2b8101300 2024-02-05T07:54:17.055 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:17.053+0000 7fa2bd71e640 1 -- 172.21.15.184:0/1372603888 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa2a4005330 con 0x7fa2b8101300 2024-02-05T07:54:17.664 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:17.662+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.2 v1:172.21.15.184:6790/0 10 ==== osd_map(840..840 src has 253..840) v4 ==== 296+0+0 (unknown 585151810 0 0) 0x7fa2a80558e0 con 0x7fa2b8101300 2024-02-05T07:54:17.664 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:17.662+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 --> v1:172.21.15.184:6790/0 -- mon_subscribe({osdmap=841}) v3 -- 0x7fa2a0003520 con 0x7fa2b8101300 2024-02-05T07:54:17.673 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:17.672+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.2 v1:172.21.15.184:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]=0 pool '7442f913-a0b7-47b3-a4e1-c84de7254b55' removed v840) v1 ==== 248+0+0 (unknown 1948177969 0 0) 0x7fa2a8053320 con 0x7fa2b8101300 2024-02-05T07:54:17.783 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:17.782+0000 7fa2bd71e640 1 -- 172.21.15.184:0/1372603888 --> v1:172.21.15.184:6790/0 -- mon_command({"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa2a4001140 con 0x7fa2b8101300 2024-02-05T07:54:17.783 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:17.783+0000 7fa29ffff640 1 -- 172.21.15.184:0/1372603888 <== mon.2 v1:172.21.15.184:6790/0 12 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]=0 pool '7442f913-a0b7-47b3-a4e1-c84de7254b55' does not exist v840) v1 ==== 255+0+0 (unknown 2814169771 0 0) 0x7fa2a8054b40 con 0x7fa2b8101300 2024-02-05T07:54:17.784 INFO:tasks.workunit.client.0.smithi184.stderr:pool '7442f913-a0b7-47b3-a4e1-c84de7254b55' does not exist 2024-02-05T07:54:17.786 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:17.784+0000 7fa2bd71e640 1 -- 172.21.15.184:0/1372603888 >> v1:172.21.15.184:6800/103463156 conn(0x7fa2a006eb40 legacy=0x7fa2a0071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:54:17.786 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:17.784+0000 7fa2bd71e640 1 -- 172.21.15.184:0/1372603888 >> v1:172.21.15.184:6790/0 conn(0x7fa2b8101300 legacy=0x7fa2b8106380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-05T07:54:17.786 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:17.785+0000 7fa2bd71e640 1 -- 172.21.15.184:0/1372603888 shutdown_connections 2024-02-05T07:54:17.786 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:17.785+0000 7fa2bd71e640 1 -- 172.21.15.184:0/1372603888 >> 172.21.15.184:0/1372603888 conn(0x7fa2b80fcb60 msgr2=0x7fa2b80fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-05T07:54:17.786 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:17.785+0000 7fa2bd71e640 1 -- 172.21.15.184:0/1372603888 shutdown_connections 2024-02-05T07:54:17.786 INFO:tasks.workunit.client.0.smithi184.stderr:2024-02-05T07:54:17.785+0000 7fa2bd71e640 1 -- 172.21.15.184:0/1372603888 wait complete. 2024-02-05T07:54:17.795 INFO:tasks.workunit.client.0.smithi184.stderr:+ echo OK 2024-02-05T07:54:17.796 INFO:tasks.workunit.client.0.smithi184.stdout:OK 2024-02-05T07:54:17.796 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-05T07:54:17.797 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-05T07:54:17.866 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2024-02-05T07:54:17.866 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-05T07:54:17.930 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:17 smithi184 ceph-mon[29861]: from='client.58628 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]': finished 2024-02-05T07:54:17.930 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:17 smithi184 ceph-mon[29861]: osdmap e839: 8 total, 8 up, 8 in 2024-02-05T07:54:17.930 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/733546957' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:17.930 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:17 smithi184 ceph-mon[29861]: from='client.58628 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:17.930 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:17 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1372603888' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:17.930 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:17 smithi184 ceph-mon[29861]: from='client.58634 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:17.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:17 smithi184 ceph-mon[41609]: from='client.58628 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]': finished 2024-02-05T07:54:17.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:17 smithi184 ceph-mon[41609]: osdmap e839: 8 total, 8 up, 8 in 2024-02-05T07:54:17.930 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/733546957' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:17.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:17 smithi184 ceph-mon[41609]: from='client.58628 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:17.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:17 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1372603888' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:17.931 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:17 smithi184 ceph-mon[41609]: from='client.58634 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:17 smithi188 ceph-mon[33283]: from='client.58628 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]': finished 2024-02-05T07:54:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:17 smithi188 ceph-mon[33283]: osdmap e839: 8 total, 8 up, 8 in 2024-02-05T07:54:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/733546957' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:17 smithi188 ceph-mon[33283]: from='client.58628 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "pool2": "978227f4-3b71-45f5-b8b8-2286bb55bbcd", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:17 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1372603888' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:17.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:17 smithi188 ceph-mon[33283]: from='client.58634 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:18.168 DEBUG:teuthology.parallel:result is None 2024-02-05T07:54:18.169 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-05T07:54:18.243 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-05T07:54:18.243 DEBUG:teuthology.orchestra.run.smithi184:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-02-05T07:54:18.302 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-02-05T07:54:18.302 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-05T07:54:18.314 INFO:tasks.cephadm:Teardown begin 2024-02-05T07:54:18.314 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-05T07:54:18.369 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-05T07:54:18.402 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-05T07:54:18.402 DEBUG:teuthology.orchestra.run.smithi184:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-05T07:54:18.423 DEBUG:teuthology.orchestra.run.smithi188:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-05T07:54:18.458 INFO:tasks.cephadm:Stopping all daemons... 2024-02-05T07:54:18.458 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-02-05T07:54:18.458 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mon.a 2024-02-05T07:54:18.770 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-mon[41609]: pgmap v1861: 176 pgs: 176 active+clean; 695 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:54:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-mon[41609]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-05T07:54:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-mon[41609]: from='client.58634 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]': finished 2024-02-05T07:54:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-mon[41609]: osdmap e840: 8 total, 8 up, 8 in 2024-02-05T07:54:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-mon[41609]: from='client.? v1:172.21.15.184:0/1372603888' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-mon[41609]: from='client.58634 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:18.771 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-mon[41609]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:54:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:18 smithi184 systemd[1]: Stopping Ceph mon.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:54:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-mon[29861]: pgmap v1861: 176 pgs: 176 active+clean; 695 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:54:18.771 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-mon[29861]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-05T07:54:18.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-mon[29861]: from='client.58634 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]': finished 2024-02-05T07:54:18.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-mon[29861]: osdmap e840: 8 total, 8 up, 8 in 2024-02-05T07:54:18.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-mon[29861]: from='client.? v1:172.21.15.184:0/1372603888' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:18.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-mon[29861]: from='client.58634 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:18.772 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-mon[29861]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:54:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:18 smithi188 ceph-mon[33283]: pgmap v1861: 176 pgs: 176 active+clean; 695 KiB data, 923 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-05T07:54:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:18 smithi188 ceph-mon[33283]: Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-05T07:54:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:18 smithi188 ceph-mon[33283]: from='client.58634 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]': finished 2024-02-05T07:54:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:18 smithi188 ceph-mon[33283]: osdmap e840: 8 total, 8 up, 8 in 2024-02-05T07:54:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:18 smithi188 ceph-mon[33283]: from='client.? v1:172.21.15.184:0/1372603888' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:18 smithi188 ceph-mon[33283]: from='client.58634 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "pool2": "7442f913-a0b7-47b3-a4e1-c84de7254b55", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-05T07:54:18.998 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:18 smithi188 ceph-mon[33283]: from='mgr.14610 v1:172.21.15.184:0/1725034800' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-05T07:54:19.084 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-a[29839]: 2024-02-05T07:54:18.788+0000 7f3f231bb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-05T07:54:19.084 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-a[29839]: 2024-02-05T07:54:18.788+0000 7f3f231bb700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-02-05T07:54:19.084 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:18 smithi184 podman[159318]: 2024-02-05 07:54:18.860093065 +0000 UTC m=+0.203632868 container died d42de0bd7fb18e329b7b9a32f32f92fe37b2f94b8d9db998232d367524467078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-02-05T07:54:19.085 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:54:18] ENGINE Bus STOPPING 2024-02-05T07:54:19.085 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:54:18] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-05T07:54:19.085 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:54:18] ENGINE Bus STOPPED 2024-02-05T07:54:19.085 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:54:18] ENGINE Bus STARTING 2024-02-05T07:54:19.085 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:54:18] ENGINE Serving on http://:::9283 2024-02-05T07:54:19.085 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:18 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:54:18] ENGINE Bus STARTED 2024-02-05T07:54:19.476 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:19 smithi184 podman[159318]: 2024-02-05 07:54:19.274565771 +0000 UTC m=+0.618105566 container cleanup d42de0bd7fb18e329b7b9a32f32f92fe37b2f94b8d9db998232d367524467078 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-a, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, ceph=True, maintainer=Guillaume Abrioux ) 2024-02-05T07:54:19.476 INFO:journalctl@ceph.mon.a.smithi184.stdout:Feb 05 07:54:19 smithi184 bash[159318]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-a 2024-02-05T07:54:19.618 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mon.a.service' 2024-02-05T07:54:19.660 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-05T07:54:19.661 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-02-05T07:54:19.661 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-02-05T07:54:19.661 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mon.c 2024-02-05T07:54:19.748 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:54:19 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug there is no tcmu-runner data available 2024-02-05T07:54:19.991 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:19 smithi184 systemd[1]: Stopping Ceph mon.c for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:54:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:19 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-c[41586]: 2024-02-05T07:54:19.989+0000 7f5c65aa2700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-05T07:54:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:19 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-c[41586]: 2024-02-05T07:54:19.989+0000 7f5c65aa2700 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-02-05T07:54:20.272 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:20 smithi184 podman[159562]: 2024-02-05 07:54:20.14427716 +0000 UTC m=+0.266406270 container died af1dea666a1e14d9aa23d20cbe090f1e01f6ddad7532f685a75a119338d9164b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-05T07:54:20.273 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:19 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:54:19] ENGINE Bus STOPPING 2024-02-05T07:54:20.273 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:20 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:54:20] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-05T07:54:20.273 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:20 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:54:20] ENGINE Bus STOPPED 2024-02-05T07:54:20.273 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:20 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:54:20] ENGINE Bus STARTING 2024-02-05T07:54:20.273 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:20 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:54:20] ENGINE Serving on http://:::9283 2024-02-05T07:54:20.274 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:20 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: [05/Feb/2024:07:54:20] ENGINE Bus STARTED 2024-02-05T07:54:20.765 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:20 smithi184 podman[159562]: 2024-02-05 07:54:20.513377307 +0000 UTC m=+0.635506460 container cleanup af1dea666a1e14d9aa23d20cbe090f1e01f6ddad7532f685a75a119338d9164b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-c, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, ceph=True, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-02-05T07:54:20.765 INFO:journalctl@ceph.mon.c.smithi184.stdout:Feb 05 07:54:20 smithi184 bash[159562]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-c 2024-02-05T07:54:20.932 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mon.c.service' 2024-02-05T07:54:20.970 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-05T07:54:20.971 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-02-05T07:54:20.971 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-02-05T07:54:20.971 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mon.b 2024-02-05T07:54:21.363 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:21 smithi188 systemd[1]: Stopping Ceph mon.b for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:54:21.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:21 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-b[33246]: 2024-02-05T07:54:21.361+0000 7fb14dbe7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-05T07:54:21.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:21 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-b[33246]: 2024-02-05T07:54:21.361+0000 7fb14dbe7700 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-02-05T07:54:21.748 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:21 smithi188 podman[78434]: 2024-02-05 07:54:21.587810562 +0000 UTC m=+0.420421112 container died 82e6b8bfd0210874c82d7e520993ea59f0759808ac829030c516a53fea8e1b9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-b, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-02-05T07:54:22.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:22 smithi188 podman[78434]: 2024-02-05 07:54:22.060166724 +0000 UTC m=+0.892777319 container cleanup 82e6b8bfd0210874c82d7e520993ea59f0759808ac829030c516a53fea8e1b9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-b, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-02-05T07:54:22.248 INFO:journalctl@ceph.mon.b.smithi188.stdout:Feb 05 07:54:22 smithi188 bash[78434]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mon-b 2024-02-05T07:54:22.270 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:21 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y[30118]: ::ffff:172.21.15.188 - - [05/Feb/2024:07:54:21] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-05T07:54:22.486 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mon.b.service' 2024-02-05T07:54:22.533 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-05T07:54:22.533 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-02-05T07:54:22.533 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-02-05T07:54:22.533 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mgr.y 2024-02-05T07:54:22.889 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:22 smithi184 systemd[1]: Stopping Ceph mgr.y for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:54:23.194 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:22 smithi184 podman[159704]: 2024-02-05 07:54:22.893045581 +0000 UTC m=+0.163560090 container died 344e075574d1e70c2ce973f0fe3902971ece7e55d7e0bd62986dea0d11ae0afb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-02-05T07:54:23.521 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:23 smithi184 podman[159704]: 2024-02-05 07:54:23.259027539 +0000 UTC m=+0.529542037 container cleanup 344e075574d1e70c2ce973f0fe3902971ece7e55d7e0bd62986dea0d11ae0afb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-05T07:54:23.521 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:23 smithi184 bash[159704]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y 2024-02-05T07:54:23.521 INFO:journalctl@ceph.mgr.y.smithi184.stdout:Feb 05 07:54:23 smithi184 podman[159721]: 2024-02-05 07:54:23.418837581 +0000 UTC m=+0.523172380 container remove 344e075574d1e70c2ce973f0fe3902971ece7e55d7e0bd62986dea0d11ae0afb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:164d3be4a527be775f4d3c343ea591122f1b8921, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-y, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be) 2024-02-05T07:54:23.666 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mgr.y.service' 2024-02-05T07:54:23.703 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-05T07:54:23.704 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-02-05T07:54:23.704 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-02-05T07:54:23.704 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mgr.x 2024-02-05T07:54:23.998 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:54:23 smithi188 systemd[1]: Stopping Ceph mgr.x for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:54:24.291 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:54:24 smithi188 podman[78570]: 2024-02-05 07:54:24.031954152 +0000 UTC m=+0.135864598 container died be566d4e8ebac598bb792db16a93872cb9429a7b85885ac9bbfef27613140514 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be) 2024-02-05T07:54:24.658 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:54:24 smithi188 podman[78570]: 2024-02-05 07:54:24.406301594 +0000 UTC m=+0.510212040 container cleanup be566d4e8ebac598bb792db16a93872cb9429a7b85885ac9bbfef27613140514 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x, ceph=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-05T07:54:24.658 INFO:journalctl@ceph.mgr.x.smithi188.stdout:Feb 05 07:54:24 smithi188 bash[78570]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-mgr-x 2024-02-05T07:54:24.826 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@mgr.x.service' 2024-02-05T07:54:24.863 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-05T07:54:24.864 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-02-05T07:54:24.864 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-05T07:54:24.864 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.0 2024-02-05T07:54:25.159 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:54:24 smithi184 systemd[1]: Stopping Ceph osd.0 for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:54:25.520 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:54:25 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-0[45904]: 2024-02-05T07:54:25.157+0000 7f23b9b37700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-05T07:54:25.521 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:54:25 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-0[45904]: 2024-02-05T07:54:25.157+0000 7f23b9b37700 -1 osd.0 840 *** Got signal Terminated *** 2024-02-05T07:54:25.521 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:54:25 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-0[45904]: 2024-02-05T07:54:25.157+0000 7f23b9b37700 -1 osd.0 840 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-05T07:54:30.848 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:54:30 smithi184 podman[159837]: 2024-02-05 07:54:30.57505729 +0000 UTC m=+5.521821923 container died 41528a9f0cfe4f3b7734691f6a50c7b81d8da3c622264acf749c4fd90e8471ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, ceph=True, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-02-05T07:54:31.190 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:54:30 smithi184 podman[159837]: 2024-02-05 07:54:30.946662206 +0000 UTC m=+5.893426822 container cleanup 41528a9f0cfe4f3b7734691f6a50c7b81d8da3c622264acf749c4fd90e8471ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-0, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-02-05T07:54:31.190 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:54:30 smithi184 bash[159837]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-0 2024-02-05T07:54:31.515 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:54:31 smithi184 podman[159857]: 2024-02-05 07:54:31.189605719 +0000 UTC m=+0.618447983 container remove 41528a9f0cfe4f3b7734691f6a50c7b81d8da3c622264acf749c4fd90e8471ff (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-0, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-02-05T07:54:31.771 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:54:31 smithi184 podman[159957]: 2024-02-05 07:54:31.417817299 +0000 UTC m=+0.018782494 image pull 8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0 2024-02-05T07:54:31.771 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:54:31 smithi184 podman[159957]: 2024-02-05 07:54:31.515428364 +0000 UTC m=+0.116393554 container create 32b50de0ad2518ceaad7a591122363f8abafe4feac3cdbfdae95f4e055c0befe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-02-05T07:54:31.771 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:54:31 smithi184 podman[159957]: 2024-02-05 07:54:31.701127698 +0000 UTC m=+0.302092890 container init 32b50de0ad2518ceaad7a591122363f8abafe4feac3cdbfdae95f4e055c0befe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-0-deactivate, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131) 2024-02-05T07:54:31.771 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:54:31 smithi184 podman[159957]: 2024-02-05 07:54:31.706879951 +0000 UTC m=+0.307845151 container start 32b50de0ad2518ceaad7a591122363f8abafe4feac3cdbfdae95f4e055c0befe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-05T07:54:32.271 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:54:31 smithi184 podman[159957]: 2024-02-05 07:54:31.809452918 +0000 UTC m=+0.410418122 container attach 32b50de0ad2518ceaad7a591122363f8abafe4feac3cdbfdae95f4e055c0befe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-0-deactivate, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-05T07:54:32.271 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:54:31 smithi184 podman[159957]: 2024-02-05 07:54:31.997799059 +0000 UTC m=+0.598764255 container died 32b50de0ad2518ceaad7a591122363f8abafe4feac3cdbfdae95f4e055c0befe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-0-deactivate, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-05T07:54:32.528 INFO:journalctl@ceph.osd.0.smithi184.stdout:Feb 05 07:54:32 smithi184 podman[160002]: 2024-02-05 07:54:32.513051491 +0000 UTC m=+0.506661318 container remove 32b50de0ad2518ceaad7a591122363f8abafe4feac3cdbfdae95f4e055c0befe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, ceph=True, GIT_CLEAN=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-02-05T07:54:32.533 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.0.service' 2024-02-05T07:54:32.574 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-05T07:54:32.574 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-05T07:54:32.574 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-05T07:54:32.575 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.1 2024-02-05T07:54:32.903 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:54:32 smithi184 systemd[1]: Stopping Ceph osd.1 for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:54:33.271 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:54:32 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-1[51940]: 2024-02-05T07:54:32.901+0000 7f517a9e0700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-05T07:54:33.271 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:54:32 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-1[51940]: 2024-02-05T07:54:32.901+0000 7f517a9e0700 -1 osd.1 840 *** Got signal Terminated *** 2024-02-05T07:54:33.271 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:54:32 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-1[51940]: 2024-02-05T07:54:32.901+0000 7f517a9e0700 -1 osd.1 840 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-05T07:54:38.668 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:54:38 smithi184 podman[160086]: 2024-02-05 07:54:38.355086241 +0000 UTC m=+5.559316654 container died b3f59e24e1517e6c33bf629e2ded7164cc020b6d7153b66b3b0365e93393234e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-1, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131) 2024-02-05T07:54:38.968 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:54:38 smithi184 podman[160086]: 2024-02-05 07:54:38.765621944 +0000 UTC m=+5.969852353 container cleanup b3f59e24e1517e6c33bf629e2ded7164cc020b6d7153b66b3b0365e93393234e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-1, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be) 2024-02-05T07:54:38.968 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:54:38 smithi184 bash[160086]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-1 2024-02-05T07:54:39.270 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:54:38 smithi184 podman[160109]: 2024-02-05 07:54:38.967039971 +0000 UTC m=+0.605792025 container remove b3f59e24e1517e6c33bf629e2ded7164cc020b6d7153b66b3b0365e93393234e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-1, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-05T07:54:39.679 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:54:39 smithi184 podman[160203]: 2024-02-05 07:54:39.278136627 +0000 UTC m=+0.017325857 image pull 8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0 2024-02-05T07:54:39.679 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:54:39 smithi184 podman[160203]: 2024-02-05 07:54:39.376522872 +0000 UTC m=+0.115712095 container create 8dafd52f6fe355bb5afb4bf66555112507e07edb666270933982271f04d36e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, io.buildah.version=1.33.2, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux ) 2024-02-05T07:54:39.679 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:54:39 smithi184 podman[160203]: 2024-02-05 07:54:39.587578609 +0000 UTC m=+0.326767832 container init 8dafd52f6fe355bb5afb4bf66555112507e07edb666270933982271f04d36e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-1-deactivate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-05T07:54:39.680 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:54:39 smithi184 podman[160203]: 2024-02-05 07:54:39.592911739 +0000 UTC m=+0.332100963 container start 8dafd52f6fe355bb5afb4bf66555112507e07edb666270933982271f04d36e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-1-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.2, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-05T07:54:39.680 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:54:39 smithi184 podman[160203]: 2024-02-05 07:54:39.678793028 +0000 UTC m=+0.417982254 container attach 8dafd52f6fe355bb5afb4bf66555112507e07edb666270933982271f04d36e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-1-deactivate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-02-05T07:54:40.021 INFO:journalctl@ceph.osd.1.smithi184.stdout:Feb 05 07:54:39 smithi184 podman[160203]: 2024-02-05 07:54:39.886101838 +0000 UTC m=+0.625291061 container died 8dafd52f6fe355bb5afb4bf66555112507e07edb666270933982271f04d36e56 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-1-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2) 2024-02-05T07:54:40.521 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.1.service' 2024-02-05T07:54:40.565 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-05T07:54:40.566 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-05T07:54:40.566 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-05T07:54:40.566 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.2 2024-02-05T07:54:40.771 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:54:40 smithi184 systemd[1]: Stopping Ceph osd.2 for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:54:41.270 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:54:40 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-2[58237]: 2024-02-05T07:54:40.895+0000 7f25c081a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-05T07:54:41.271 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:54:40 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-2[58237]: 2024-02-05T07:54:40.895+0000 7f25c081a700 -1 osd.2 840 *** Got signal Terminated *** 2024-02-05T07:54:41.271 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:54:40 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-2[58237]: 2024-02-05T07:54:40.895+0000 7f25c081a700 -1 osd.2 840 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-05T07:54:46.646 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:54:46 smithi184 podman[160333]: 2024-02-05 07:54:46.347135857 +0000 UTC m=+5.554812665 container died a3aa59d2501b36d333499017af1a70d18f187feeaa5af971bbe066d1f1b3a59d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be) 2024-02-05T07:54:46.961 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:54:46 smithi184 podman[160333]: 2024-02-05 07:54:46.743025795 +0000 UTC m=+5.950702602 container cleanup a3aa59d2501b36d333499017af1a70d18f187feeaa5af971bbe066d1f1b3a59d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-2, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-02-05T07:54:46.961 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:54:46 smithi184 bash[160333]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-2 2024-02-05T07:54:47.259 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:54:46 smithi184 podman[160355]: 2024-02-05 07:54:46.961187242 +0000 UTC m=+0.605377260 container remove a3aa59d2501b36d333499017af1a70d18f187feeaa5af971bbe066d1f1b3a59d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-02-05T07:54:47.522 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:54:47 smithi184 podman[160452]: 2024-02-05 07:54:47.162250671 +0000 UTC m=+0.017945630 image pull 8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0 2024-02-05T07:54:47.522 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:54:47 smithi184 podman[160452]: 2024-02-05 07:54:47.27883847 +0000 UTC m=+0.134533480 container create 878d8e6b8ec1c884ef963cbb77cdc01aae42a15d016cdd033e23d9be0161c601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-2-deactivate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-05T07:54:47.522 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:54:47 smithi184 podman[160452]: 2024-02-05 07:54:47.47255716 +0000 UTC m=+0.328252111 container init 878d8e6b8ec1c884ef963cbb77cdc01aae42a15d016cdd033e23d9be0161c601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, io.buildah.version=1.33.2) 2024-02-05T07:54:47.522 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:54:47 smithi184 podman[160452]: 2024-02-05 07:54:47.478143537 +0000 UTC m=+0.333838495 container start 878d8e6b8ec1c884ef963cbb77cdc01aae42a15d016cdd033e23d9be0161c601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_CLEAN=True, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2) 2024-02-05T07:54:48.000 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:54:47 smithi184 podman[160452]: 2024-02-05 07:54:47.539102781 +0000 UTC m=+0.394797747 container attach 878d8e6b8ec1c884ef963cbb77cdc01aae42a15d016cdd033e23d9be0161c601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-02-05T07:54:48.001 INFO:journalctl@ceph.osd.2.smithi184.stdout:Feb 05 07:54:47 smithi184 podman[160452]: 2024-02-05 07:54:47.765736677 +0000 UTC m=+0.621431629 container died 878d8e6b8ec1c884ef963cbb77cdc01aae42a15d016cdd033e23d9be0161c601 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-05T07:54:48.279 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.2.service' 2024-02-05T07:54:48.321 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-05T07:54:48.322 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-05T07:54:48.322 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-05T07:54:48.322 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.3 2024-02-05T07:54:48.520 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:48 smithi184 systemd[1]: Stopping Ceph osd.3 for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:54:49.021 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:48 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3[64329]: 2024-02-05T07:54:48.656+0000 7f19f2f60700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-05T07:54:49.021 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:48 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3[64329]: 2024-02-05T07:54:48.656+0000 7f19f2f60700 -1 osd.3 840 *** Got signal Terminated *** 2024-02-05T07:54:49.021 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:48 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3[64329]: 2024-02-05T07:54:48.656+0000 7f19f2f60700 -1 osd.3 840 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-05T07:54:51.749 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:54:51 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:54:51.370+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:54:52.271 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:51 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3[64329]: 2024-02-05T07:54:51.937+0000 7f19eb553700 -1 osd.3 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:28.225903+0000 front 2024-02-05T07:54:28.226049+0000 (oldest deadline 2024-02-05T07:54:51.726093+0000) 2024-02-05T07:54:52.748 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:54:52 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:54:52.323+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:54:53.270 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:52 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3[64329]: 2024-02-05T07:54:52.949+0000 7f19eb553700 -1 osd.3 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:28.225903+0000 front 2024-02-05T07:54:28.226049+0000 (oldest deadline 2024-02-05T07:54:51.726093+0000) 2024-02-05T07:54:53.748 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:54:53 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:54:53.352+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:54:54.248 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:54:53 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:54:53.799+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:54:54.271 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:54 smithi184 podman[160583]: 2024-02-05 07:54:54.009115868 +0000 UTC m=+5.458089284 container died bfc757f5aea6a95354c6db640b276a1b6aa56d8824a8aa08a4ee40882e1f4190 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240131, io.buildah.version=1.33.2) 2024-02-05T07:54:54.663 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:54 smithi184 podman[160583]: 2024-02-05 07:54:54.370163523 +0000 UTC m=+5.819136936 container cleanup bfc757f5aea6a95354c6db640b276a1b6aa56d8824a8aa08a4ee40882e1f4190 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-05T07:54:54.663 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:54 smithi184 bash[160583]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3 2024-02-05T07:54:54.748 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:54:54 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:54:54.308+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:54:54.993 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:54 smithi184 podman[160613]: 2024-02-05 07:54:54.663248633 +0000 UTC m=+0.652226803 container remove bfc757f5aea6a95354c6db640b276a1b6aa56d8824a8aa08a4ee40882e1f4190 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-02-05T07:54:55.248 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:54:54 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:54:54.822+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:54:55.271 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:54 smithi184 podman[160712]: 2024-02-05 07:54:54.897229435 +0000 UTC m=+0.019074280 image pull 8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0 2024-02-05T07:54:55.271 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:54 smithi184 podman[160712]: 2024-02-05 07:54:54.997553335 +0000 UTC m=+0.119398220 container create 7af21694d7817eeef6e439202e82f2d7e7f1c0a60d439081602d6190cc8f2298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-02-05T07:54:55.271 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:55 smithi184 podman[160712]: 2024-02-05 07:54:55.208307652 +0000 UTC m=+0.330152495 container init 7af21694d7817eeef6e439202e82f2d7e7f1c0a60d439081602d6190cc8f2298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-02-05T07:54:55.271 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:55 smithi184 podman[160712]: 2024-02-05 07:54:55.214179348 +0000 UTC m=+0.336024200 container start 7af21694d7817eeef6e439202e82f2d7e7f1c0a60d439081602d6190cc8f2298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3-deactivate, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-02-05T07:54:55.748 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:54:55 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:54:55.346+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:54:55.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:54:55 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:54:55.463+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:54:55.770 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:55 smithi184 podman[160712]: 2024-02-05 07:54:55.274804525 +0000 UTC m=+0.396649371 container attach 7af21694d7817eeef6e439202e82f2d7e7f1c0a60d439081602d6190cc8f2298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, io.buildah.version=1.33.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131) 2024-02-05T07:54:55.771 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:55 smithi184 podman[160712]: 2024-02-05 07:54:55.497005852 +0000 UTC m=+0.618850695 container died 7af21694d7817eeef6e439202e82f2d7e7f1c0a60d439081602d6190cc8f2298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.build-date=20240131, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-05T07:54:56.043 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 05 07:54:56 smithi184 podman[160758]: 2024-02-05 07:54:56.028003311 +0000 UTC m=+0.521641517 container remove 7af21694d7817eeef6e439202e82f2d7e7f1c0a60d439081602d6190cc8f2298 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be) 2024-02-05T07:54:56.049 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.3.service' 2024-02-05T07:54:56.089 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-05T07:54:56.089 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-05T07:54:56.090 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-05T07:54:56.090 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.4 2024-02-05T07:54:56.121 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:54:55 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4[38737]: 2024-02-05T07:54:55.854+0000 7f02fd34b700 -1 osd.4 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:24.596322+0000 front 2024-02-05T07:54:24.596312+0000 (oldest deadline 2024-02-05T07:54:55.796725+0000) 2024-02-05T07:54:56.121 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:54:55 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:54:55.807+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:54:56.393 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:54:56 smithi188 systemd[1]: Stopping Ceph osd.4 for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:54:56.748 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:54:56 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:54:56.395+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:54:56.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:54:56 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:54:56.499+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:54:56.748 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:54:56 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4[38737]: 2024-02-05T07:54:56.391+0000 7f0300d50700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-05T07:54:56.749 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:54:56 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4[38737]: 2024-02-05T07:54:56.391+0000 7f0300d50700 -1 osd.4 840 *** Got signal Terminated *** 2024-02-05T07:54:56.749 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:54:56 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4[38737]: 2024-02-05T07:54:56.391+0000 7f0300d50700 -1 osd.4 840 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-05T07:54:57.248 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:54:56 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4[38737]: 2024-02-05T07:54:56.860+0000 7f02fd34b700 -1 osd.4 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:24.596322+0000 front 2024-02-05T07:54:24.596312+0000 (oldest deadline 2024-02-05T07:54:55.796725+0000) 2024-02-05T07:54:57.248 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:54:56 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:54:56.790+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:54:57.748 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:54:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:54:57.409+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:54:57.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:54:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:54:57.481+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:54:58.248 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:54:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:54:57.777+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:54:58.248 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:54:57 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4[38737]: 2024-02-05T07:54:57.823+0000 7f02fd34b700 -1 osd.4 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:24.596322+0000 front 2024-02-05T07:54:24.596312+0000 (oldest deadline 2024-02-05T07:54:55.796725+0000) 2024-02-05T07:54:58.737 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:54:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:54:58.454+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:54:58.738 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:54:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:54:58.470+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:54:58.738 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:54:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:54:58.470+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:54:58.998 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:54:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:54:58.736+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:54:58.998 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:54:58 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4[38737]: 2024-02-05T07:54:58.870+0000 7f02fd34b700 -1 osd.4 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:24.596322+0000 front 2024-02-05T07:54:24.596312+0000 (oldest deadline 2024-02-05T07:54:55.796725+0000) 2024-02-05T07:54:59.748 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:54:59 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:54:59.425+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:54:59.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:54:59 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:54:59.446+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:54:59.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:54:59 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:54:59.446+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:00.248 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:54:59 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4[38737]: 2024-02-05T07:54:59.866+0000 7f02fd34b700 -1 osd.4 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:24.596322+0000 front 2024-02-05T07:54:24.596312+0000 (oldest deadline 2024-02-05T07:54:55.796725+0000) 2024-02-05T07:55:00.248 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:54:59 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:54:59.786+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:55:00.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:00 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:00.440+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:00.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:00 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:00.440+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:00.748 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:00 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:00.472+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:00.749 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:00 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:00.472+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:01.248 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:55:00 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4[38737]: 2024-02-05T07:55:00.914+0000 7f02fd34b700 -1 osd.4 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:24.596322+0000 front 2024-02-05T07:54:24.596312+0000 (oldest deadline 2024-02-05T07:54:55.796725+0000) 2024-02-05T07:55:01.248 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:55:00 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4[38737]: 2024-02-05T07:55:00.914+0000 7f02fd34b700 -1 osd.4 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:35.797356+0000 front 2024-02-05T07:54:35.797265+0000 (oldest deadline 2024-02-05T07:54:59.897381+0000) 2024-02-05T07:55:01.248 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:00 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:00.765+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:55:01.248 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:00 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:00.765+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.046411+0000 front 2024-02-05T07:54:37.046394+0000 (oldest deadline 2024-02-05T07:55:00.546336+0000) 2024-02-05T07:55:01.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:01 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:01.441+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:01.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:01 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:01.441+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:01.748 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:01 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:01.432+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:01.749 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:01 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:01.432+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:02.107 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:55:01 smithi188 podman[78718]: 2024-02-05 07:55:01.843267514 +0000 UTC m=+5.561437438 container died 51fc9cc680d7d6e286a72b7e2cb2c15a28efafef33b2a98755bceb133dd23cfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-05T07:55:02.108 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:01 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:01.772+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:55:02.108 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:01 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:01.772+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.046411+0000 front 2024-02-05T07:54:37.046394+0000 (oldest deadline 2024-02-05T07:55:00.546336+0000) 2024-02-05T07:55:02.390 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:55:02 smithi188 podman[78718]: 2024-02-05 07:55:02.213926638 +0000 UTC m=+5.932096563 container cleanup 51fc9cc680d7d6e286a72b7e2cb2c15a28efafef33b2a98755bceb133dd23cfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.license=GPLv2) 2024-02-05T07:55:02.390 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:55:02 smithi188 bash[78718]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4 2024-02-05T07:55:02.731 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:55:02 smithi188 podman[78740]: 2024-02-05 07:55:02.498645058 +0000 UTC m=+0.650746789 container remove 51fc9cc680d7d6e286a72b7e2cb2c15a28efafef33b2a98755bceb133dd23cfc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0) 2024-02-05T07:55:02.731 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:02 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:02.389+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:02.731 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:02 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:02.389+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:02.731 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:02 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:02.485+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:02.732 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:02 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:02.485+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:02.998 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:02 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:02.729+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:55:02.999 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:02 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:02.729+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.046411+0000 front 2024-02-05T07:54:37.046394+0000 (oldest deadline 2024-02-05T07:55:00.546336+0000) 2024-02-05T07:55:02.999 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:55:02 smithi188 podman[78841]: 2024-02-05 07:55:02.737090049 +0000 UTC m=+0.018178090 image pull 8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0 2024-02-05T07:55:02.999 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:55:02 smithi188 podman[78841]: 2024-02-05 07:55:02.84954755 +0000 UTC m=+0.130635588 container create 49d64358baa18539d3af61ec3326ba7918c9a533501e707fa46c00a6c72d1ada (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4-deactivate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, GIT_CLEAN=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-02-05T07:55:03.346 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:55:03 smithi188 podman[78841]: 2024-02-05 07:55:03.052438025 +0000 UTC m=+0.333526061 container init 49d64358baa18539d3af61ec3326ba7918c9a533501e707fa46c00a6c72d1ada (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4-deactivate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131) 2024-02-05T07:55:03.347 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:55:03 smithi188 podman[78841]: 2024-02-05 07:55:03.058587141 +0000 UTC m=+0.339675181 container start 49d64358baa18539d3af61ec3326ba7918c9a533501e707fa46c00a6c72d1ada (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.2) 2024-02-05T07:55:03.347 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:55:03 smithi188 podman[78841]: 2024-02-05 07:55:03.15216355 +0000 UTC m=+0.433251596 container attach 49d64358baa18539d3af61ec3326ba7918c9a533501e707fa46c00a6c72d1ada (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be) 2024-02-05T07:55:03.640 INFO:journalctl@ceph.osd.4.smithi188.stdout:Feb 05 07:55:03 smithi188 podman[78841]: 2024-02-05 07:55:03.35273587 +0000 UTC m=+0.633823909 container died 49d64358baa18539d3af61ec3326ba7918c9a533501e707fa46c00a6c72d1ada (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, io.buildah.version=1.33.2, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-02-05T07:55:03.640 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:03 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:03.344+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:03.640 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:03 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:03.344+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:03.640 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:03 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:03.490+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:03.640 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:03 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:03.490+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:03.906 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:03 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:03.682+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:55:03.906 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:03 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:03.682+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.046411+0000 front 2024-02-05T07:54:37.046394+0000 (oldest deadline 2024-02-05T07:55:00.546336+0000) 2024-02-05T07:55:03.922 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.4.service' 2024-02-05T07:55:04.003 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-05T07:55:04.003 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-05T07:55:04.003 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-05T07:55:04.004 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.5 2024-02-05T07:55:04.248 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:04 smithi188 systemd[1]: Stopping Ceph osd.5 for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:55:04.677 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:04 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:04.332+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:04.677 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:04 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:04.332+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:04.678 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:04 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:04.472+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:04.678 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:04 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:04.472+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:04.678 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:04 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:04.360+0000 7f7cc9bfc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-05T07:55:04.678 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:04 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:04.360+0000 7f7cc9bfc700 -1 osd.5 840 *** Got signal Terminated *** 2024-02-05T07:55:04.678 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:04 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:04.360+0000 7f7cc9bfc700 -1 osd.5 840 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-05T07:55:04.678 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:04 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:04.675+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:55:04.678 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:04 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:04.675+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.046411+0000 front 2024-02-05T07:54:37.046394+0000 (oldest deadline 2024-02-05T07:55:00.546336+0000) 2024-02-05T07:55:05.498 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:05 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:05.362+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:05.498 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:05 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:05.362+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:05.999 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:05 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:05.504+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:06.000 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:05 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:05.504+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:06.000 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:05 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:05.655+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:55:06.000 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:05 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:05.655+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.046411+0000 front 2024-02-05T07:54:37.046394+0000 (oldest deadline 2024-02-05T07:55:00.546336+0000) 2024-02-05T07:55:06.651 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:06 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:06.485+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:06.651 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:06 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:06.485+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:06.651 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:06 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:06.376+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:06.652 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:06 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:06.376+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:06.998 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:06 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:06.649+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:55:06.998 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:06 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:06.649+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.046411+0000 front 2024-02-05T07:54:37.046394+0000 (oldest deadline 2024-02-05T07:55:00.546336+0000) 2024-02-05T07:55:06.998 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:06 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:06.649+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.647404+0000 front 2024-02-05T07:54:44.647370+0000 (oldest deadline 2024-02-05T07:55:06.347256+0000) 2024-02-05T07:55:07.647 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:07.336+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:07.648 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:07.336+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:07.648 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:07.336+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:43.665653+0000 front 2024-02-05T07:54:43.665520+0000 (oldest deadline 2024-02-05T07:55:07.165474+0000) 2024-02-05T07:55:07.648 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:07.507+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:07.648 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:07.507+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:07.648 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:07.507+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:07.998 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:07.645+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:55:07.998 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:07.645+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.046411+0000 front 2024-02-05T07:54:37.046394+0000 (oldest deadline 2024-02-05T07:55:00.546336+0000) 2024-02-05T07:55:07.998 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:07 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:07.645+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.647404+0000 front 2024-02-05T07:54:44.647370+0000 (oldest deadline 2024-02-05T07:55:06.347256+0000) 2024-02-05T07:55:08.669 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:08.337+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:08.669 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:08.337+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:08.669 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:08.337+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:43.665653+0000 front 2024-02-05T07:54:43.665520+0000 (oldest deadline 2024-02-05T07:55:07.165474+0000) 2024-02-05T07:55:08.669 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:08.509+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:08.669 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:08.509+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:08.670 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:08.509+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:08.998 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:08.667+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:30.045527+0000 front 2024-02-05T07:54:30.045582+0000 (oldest deadline 2024-02-05T07:54:52.945346+0000) 2024-02-05T07:55:08.998 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:08.667+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.046411+0000 front 2024-02-05T07:54:37.046394+0000 (oldest deadline 2024-02-05T07:55:00.546336+0000) 2024-02-05T07:55:08.998 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:08 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5[45060]: 2024-02-05T07:55:08.667+0000 7f7cc21ef700 -1 osd.5 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.647404+0000 front 2024-02-05T07:54:44.647370+0000 (oldest deadline 2024-02-05T07:55:06.347256+0000) 2024-02-05T07:55:09.557 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:09 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:09.295+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:09.557 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:09 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:09.295+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:09.557 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:09 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:09.295+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:43.665653+0000 front 2024-02-05T07:54:43.665520+0000 (oldest deadline 2024-02-05T07:55:07.165474+0000) 2024-02-05T07:55:09.905 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:09 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:09.556+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:09.905 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:09 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:09.556+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:09.905 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:09 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:09.556+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:09.905 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:09 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:09.557+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:10.210 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:09 smithi188 podman[78973]: 2024-02-05 07:55:09.904499751 +0000 UTC m=+5.671631082 container died a80eab32441d4ab1c926d2e4c2168f8479259dc335beb190c1e6793703f2179e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-02-05T07:55:10.485 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:10 smithi188 podman[78973]: 2024-02-05 07:55:10.300086737 +0000 UTC m=+6.067218062 container cleanup a80eab32441d4ab1c926d2e4c2168f8479259dc335beb190c1e6793703f2179e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.build-date=20240131) 2024-02-05T07:55:10.485 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:10 smithi188 bash[78973]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5 2024-02-05T07:55:10.485 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:10 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:10.316+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:10.486 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:10 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:10.316+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:10.486 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:10 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:10.316+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:43.665653+0000 front 2024-02-05T07:54:43.665520+0000 (oldest deadline 2024-02-05T07:55:07.165474+0000) 2024-02-05T07:55:10.748 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:10 smithi188 podman[79006]: 2024-02-05 07:55:10.484708015 +0000 UTC m=+0.576511727 container remove a80eab32441d4ab1c926d2e4c2168f8479259dc335beb190c1e6793703f2179e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be) 2024-02-05T07:55:10.749 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:10 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:10.532+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:10.749 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:10 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:10.532+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:10.749 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:10 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:10.532+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:10.749 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:10 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:10.532+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:11.171 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:10 smithi188 podman[79104]: 2024-02-05 07:55:10.815839996 +0000 UTC m=+0.018606653 image pull 8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0 2024-02-05T07:55:11.172 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:10 smithi188 podman[79104]: 2024-02-05 07:55:10.943921965 +0000 UTC m=+0.146688664 container create 40881bd77ae88838d197f2faf14b283b8d2163cac556ea1170fec87093cb2ae1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5-deactivate, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-02-05T07:55:11.466 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:11 smithi188 podman[79104]: 2024-02-05 07:55:11.171243174 +0000 UTC m=+0.374009831 container init 40881bd77ae88838d197f2faf14b283b8d2163cac556ea1170fec87093cb2ae1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-02-05T07:55:11.466 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:11 smithi188 podman[79104]: 2024-02-05 07:55:11.176914593 +0000 UTC m=+0.379681251 container start 40881bd77ae88838d197f2faf14b283b8d2163cac556ea1170fec87093cb2ae1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, ceph=True) 2024-02-05T07:55:11.466 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:11 smithi188 podman[79104]: 2024-02-05 07:55:11.254345307 +0000 UTC m=+0.457111966 container attach 40881bd77ae88838d197f2faf14b283b8d2163cac556ea1170fec87093cb2ae1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5-deactivate, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-02-05T07:55:11.466 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:11 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:11.317+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:11.466 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:11 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:11.317+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:11.466 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:11 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:11.317+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:43.665653+0000 front 2024-02-05T07:54:43.665520+0000 (oldest deadline 2024-02-05T07:55:07.165474+0000) 2024-02-05T07:55:11.748 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:11 smithi188 podman[79104]: 2024-02-05 07:55:11.466168752 +0000 UTC m=+0.668935412 container died 40881bd77ae88838d197f2faf14b283b8d2163cac556ea1170fec87093cb2ae1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, org.label-schema.schema-version=1.0) 2024-02-05T07:55:11.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:11 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:11.572+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:11.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:11 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:11.572+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:11.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:11 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:11.572+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:11.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:11 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:11.572+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:12.082 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.5.service' 2024-02-05T07:55:12.107 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:12 smithi188 podman[79150]: 2024-02-05 07:55:12.058187032 +0000 UTC m=+0.587348008 container remove 40881bd77ae88838d197f2faf14b283b8d2163cac556ea1170fec87093cb2ae1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-05T07:55:12.107 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:12 smithi188 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.5.service: Deactivated successfully. 2024-02-05T07:55:12.107 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:12 smithi188 systemd[1]: Stopped Ceph osd.5 for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:55:12.107 INFO:journalctl@ceph.osd.5.smithi188.stdout:Feb 05 07:55:12 smithi188 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.5.service: Consumed 57.268s CPU time. 2024-02-05T07:55:12.122 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-05T07:55:12.122 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-05T07:55:12.123 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-02-05T07:55:12.123 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.6 2024-02-05T07:55:12.472 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:12 smithi188 systemd[1]: Stopping Ceph osd.6 for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:55:12.473 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:12.321+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:12.473 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:12.321+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:12.473 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:12.321+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:43.665653+0000 front 2024-02-05T07:54:43.665520+0000 (oldest deadline 2024-02-05T07:55:07.165474+0000) 2024-02-05T07:55:12.473 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:12.471+0000 7f1dbcfbd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-05T07:55:12.473 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:12.471+0000 7f1dbcfbd700 -1 osd.6 840 *** Got signal Terminated *** 2024-02-05T07:55:12.473 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:12.471+0000 7f1dbcfbd700 -1 osd.6 840 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-05T07:55:12.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:12.537+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:12.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:12.537+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:12.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:12.537+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:12.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:12 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:12.537+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:13.630 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:13.316+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:13.630 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:13.316+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:13.630 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:13.316+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:43.665653+0000 front 2024-02-05T07:54:43.665520+0000 (oldest deadline 2024-02-05T07:55:07.165474+0000) 2024-02-05T07:55:13.631 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:13.529+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:13.631 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:13.529+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:13.631 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:13.529+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:13.631 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:13.530+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:13.998 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:13.629Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.184:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.184:8765: connect: connection refused" 2024-02-05T07:55:13.998 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:13.631Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.184:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.184:8765: connect: connection refused" 2024-02-05T07:55:13.998 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:13.633Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.184:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.184:8765: connect: connection refused" 2024-02-05T07:55:13.999 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:13 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:13.633Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.184:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.184:8765: connect: connection refused" 2024-02-05T07:55:14.711 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:14 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:14.343+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:14.711 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:14 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:14.344+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:14.711 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:14 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:14.344+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:43.665653+0000 front 2024-02-05T07:54:43.665520+0000 (oldest deadline 2024-02-05T07:55:07.165474+0000) 2024-02-05T07:55:14.712 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:14 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:14.520+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:14.712 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:14 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:14.520+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:14.712 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:14 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:14.520+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:14.712 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:14 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:14.520+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:15.748 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:15 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:15.334+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:15.749 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:15 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:15.334+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:15.749 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:15 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:15.334+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:43.665653+0000 front 2024-02-05T07:54:43.665520+0000 (oldest deadline 2024-02-05T07:55:07.165474+0000) 2024-02-05T07:55:15.749 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:15 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:15.523+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:15.749 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:15 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:15.523+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:15.749 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:15 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:15.523+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:15.749 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:15 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:15.523+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6815 osd.3 since back 2024-02-05T07:54:50.575164+0000 front 2024-02-05T07:54:50.575153+0000 (oldest deadline 2024-02-05T07:55:14.675162+0000) 2024-02-05T07:55:15.749 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:15 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:15.524+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:16.575 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:16 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:16.298+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:16.575 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:16 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:16.298+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:16.575 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:16 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:16.298+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:43.665653+0000 front 2024-02-05T07:54:43.665520+0000 (oldest deadline 2024-02-05T07:55:07.165474+0000) 2024-02-05T07:55:16.575 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:16 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:16.298+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6815 osd.3 since back 2024-02-05T07:54:50.066662+0000 front 2024-02-05T07:54:50.066553+0000 (oldest deadline 2024-02-05T07:55:15.366539+0000) 2024-02-05T07:55:16.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:16 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:16.573+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:16.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:16 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:16.573+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:16.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:16 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:16.573+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:16.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:16 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:16.573+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6815 osd.3 since back 2024-02-05T07:54:50.575164+0000 front 2024-02-05T07:54:50.575153+0000 (oldest deadline 2024-02-05T07:55:14.675162+0000) 2024-02-05T07:55:16.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:16 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:16.573+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:17.600 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:17.328+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:27.462856+0000 front 2024-02-05T07:54:27.462814+0000 (oldest deadline 2024-02-05T07:54:50.962960+0000) 2024-02-05T07:55:17.600 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:17.328+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:37.864841+0000 front 2024-02-05T07:54:37.864737+0000 (oldest deadline 2024-02-05T07:55:00.164609+0000) 2024-02-05T07:55:17.600 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:17.328+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:43.665653+0000 front 2024-02-05T07:54:43.665520+0000 (oldest deadline 2024-02-05T07:55:07.165474+0000) 2024-02-05T07:55:17.600 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6[51317]: 2024-02-05T07:55:17.328+0000 7f1db95b8700 -1 osd.6 840 heartbeat_check: no reply from 172.21.15.184:6815 osd.3 since back 2024-02-05T07:54:50.066662+0000 front 2024-02-05T07:54:50.066553+0000 (oldest deadline 2024-02-05T07:55:15.366539+0000) 2024-02-05T07:55:17.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:17.598+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:17.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:17.598+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:17.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:17.598+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:17.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:17.598+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6815 osd.3 since back 2024-02-05T07:54:50.575164+0000 front 2024-02-05T07:54:50.575153+0000 (oldest deadline 2024-02-05T07:55:14.675162+0000) 2024-02-05T07:55:17.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:17 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:17.599+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:18.320 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:18 smithi188 podman[79236]: 2024-02-05 07:55:18.006922269 +0000 UTC m=+5.655845225 container died 2396148bddba00cea32074bd8e1e2d2c4c42ed4db47378122811a7600f0ab7bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-05T07:55:18.653 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:18 smithi188 podman[79236]: 2024-02-05 07:55:18.418703333 +0000 UTC m=+6.067626289 container cleanup 2396148bddba00cea32074bd8e1e2d2c4c42ed4db47378122811a7600f0ab7bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-05T07:55:18.654 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:18 smithi188 bash[79236]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6 2024-02-05T07:55:18.654 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:18.559+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:18.654 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:18.559+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:18.654 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:18.559+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:18.654 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:18.559+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6815 osd.3 since back 2024-02-05T07:54:50.575164+0000 front 2024-02-05T07:54:50.575153+0000 (oldest deadline 2024-02-05T07:55:14.675162+0000) 2024-02-05T07:55:18.654 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:18 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:18.560+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:18.959 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:18 smithi188 podman[79258]: 2024-02-05 07:55:18.653147443 +0000 UTC m=+0.640659613 container remove 2396148bddba00cea32074bd8e1e2d2c4c42ed4db47378122811a7600f0ab7bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.build-date=20240131, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-05T07:55:19.216 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:18 smithi188 podman[79355]: 2024-02-05 07:55:18.861168875 +0000 UTC m=+0.017680913 image pull 8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0 2024-02-05T07:55:19.216 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:18 smithi188 podman[79355]: 2024-02-05 07:55:18.962212972 +0000 UTC m=+0.118725011 container create 723076ac359facf9ab67bc17aec6659855387b3cc71aec3dc9c73223f0d682ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6-deactivate, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-05T07:55:19.216 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:19 smithi188 podman[79355]: 2024-02-05 07:55:19.215128208 +0000 UTC m=+0.371640248 container init 723076ac359facf9ab67bc17aec6659855387b3cc71aec3dc9c73223f0d682ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6-deactivate, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-02-05T07:55:19.498 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:19 smithi188 podman[79355]: 2024-02-05 07:55:19.220931573 +0000 UTC m=+0.377443612 container start 723076ac359facf9ab67bc17aec6659855387b3cc71aec3dc9c73223f0d682ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6-deactivate, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD) 2024-02-05T07:55:19.499 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:19 smithi188 podman[79355]: 2024-02-05 07:55:19.306679 +0000 UTC m=+0.463191038 container attach 723076ac359facf9ab67bc17aec6659855387b3cc71aec3dc9c73223f0d682ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6-deactivate, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD) 2024-02-05T07:55:19.793 INFO:journalctl@ceph.osd.6.smithi188.stdout:Feb 05 07:55:19 smithi188 podman[79355]: 2024-02-05 07:55:19.509930011 +0000 UTC m=+0.666442050 container died 723076ac359facf9ab67bc17aec6659855387b3cc71aec3dc9c73223f0d682ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-6-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, GIT_CLEAN=True) 2024-02-05T07:55:19.794 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:19 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:19.592+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:19.794 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:19 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:19.592+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:19.794 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:19 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:19.592+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:19.794 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:19 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:19.592+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6815 osd.3 since back 2024-02-05T07:54:50.575164+0000 front 2024-02-05T07:54:50.575153+0000 (oldest deadline 2024-02-05T07:55:14.675162+0000) 2024-02-05T07:55:19.794 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:19 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:19.592+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:20.077 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.6.service' 2024-02-05T07:55:20.117 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-05T07:55:20.117 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-02-05T07:55:20.118 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-02-05T07:55:20.118 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.7 2024-02-05T07:55:20.441 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:20 smithi188 systemd[1]: Stopping Ceph osd.7 for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:55:20.441 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:20 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:20.440+0000 7f4d6f551700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-05T07:55:20.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:20 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:20.440+0000 7f4d6f551700 -1 osd.7 840 *** Got signal Terminated *** 2024-02-05T07:55:20.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:20 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:20.440+0000 7f4d6f551700 -1 osd.7 840 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-05T07:55:20.748 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:20 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:20.568+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:20.749 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:20 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:20.568+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:20.749 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:20 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:20.568+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:20.749 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:20 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:20.568+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6815 osd.3 since back 2024-02-05T07:54:50.575164+0000 front 2024-02-05T07:54:50.575153+0000 (oldest deadline 2024-02-05T07:55:14.675162+0000) 2024-02-05T07:55:20.749 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:20 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:20.568+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:21.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:21 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:21.536+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:21.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:21 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:21.536+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:21.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:21 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:21.536+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:21.999 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:21 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:21.536+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6815 osd.3 since back 2024-02-05T07:54:50.575164+0000 front 2024-02-05T07:54:50.575153+0000 (oldest deadline 2024-02-05T07:55:14.675162+0000) 2024-02-05T07:55:21.999 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:21 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:21.536+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:22.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:22 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:22.543+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:22.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:22 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:22.543+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:22.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:22 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:22.543+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:22.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:22 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:22.543+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6815 osd.3 since back 2024-02-05T07:54:50.575164+0000 front 2024-02-05T07:54:50.575153+0000 (oldest deadline 2024-02-05T07:55:14.675162+0000) 2024-02-05T07:55:22.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:22 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:22.543+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:23.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:23 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:23.587+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:23.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:23 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:23.587+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:23.999 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:23 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:23.587+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:23.999 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:23 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:23.587+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6815 osd.3 since back 2024-02-05T07:54:50.575164+0000 front 2024-02-05T07:54:50.575153+0000 (oldest deadline 2024-02-05T07:55:14.675162+0000) 2024-02-05T07:55:23.999 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:23 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:23.587+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:24.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:24 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:24.579+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6803 osd.0 since back 2024-02-05T07:54:29.572478+0000 front 2024-02-05T07:54:29.572368+0000 (oldest deadline 2024-02-05T07:54:54.872258+0000) 2024-02-05T07:55:24.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:24 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:24.579+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6807 osd.1 since back 2024-02-05T07:54:34.872828+0000 front 2024-02-05T07:54:34.872722+0000 (oldest deadline 2024-02-05T07:54:58.372627+0000) 2024-02-05T07:55:24.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:24 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:24.579+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6811 osd.2 since back 2024-02-05T07:54:44.273803+0000 front 2024-02-05T07:54:44.273820+0000 (oldest deadline 2024-02-05T07:55:07.173616+0000) 2024-02-05T07:55:24.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:24 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:24.579+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.184:6815 osd.3 since back 2024-02-05T07:54:50.575164+0000 front 2024-02-05T07:54:50.575153+0000 (oldest deadline 2024-02-05T07:55:14.675162+0000) 2024-02-05T07:55:24.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:24 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:24.579+0000 7f4d67b44700 -1 osd.7 840 heartbeat_check: no reply from 172.21.15.188:6802 osd.4 since back 2024-02-05T07:54:59.276505+0000 front 2024-02-05T07:54:59.276576+0000 (oldest deadline 2024-02-05T07:55:23.976563+0000) 2024-02-05T07:55:24.998 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:24 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7[57329]: 2024-02-05T07:55:24.579+0000 7f4d67b44700 -1 osd.7 840 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24457.0:2226 2.0 2:353ec8f9:::gateway.conf:head [getxattr epoch in=5b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e840) 2024-02-05T07:55:26.247 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:25 smithi188 podman[79484]: 2024-02-05 07:55:25.965490186 +0000 UTC m=+5.628124442 container died e830761169c287151c375ec0a8d74d2bdc6f044a76e1f997aed2fe36d74f7bec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, maintainer=Guillaume Abrioux ) 2024-02-05T07:55:26.498 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:26 smithi188 podman[79484]: 2024-02-05 07:55:26.345175405 +0000 UTC m=+6.007809662 container cleanup e830761169c287151c375ec0a8d74d2bdc6f044a76e1f997aed2fe36d74f7bec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240131, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.schema-version=1.0) 2024-02-05T07:55:26.498 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:26 smithi188 bash[79484]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7 2024-02-05T07:55:26.908 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:26 smithi188 podman[79506]: 2024-02-05 07:55:26.58786683 +0000 UTC m=+0.625061648 container remove e830761169c287151c375ec0a8d74d2bdc6f044a76e1f997aed2fe36d74f7bec (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240131) 2024-02-05T07:55:27.233 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:26 smithi188 podman[79605]: 2024-02-05 07:55:26.811360205 +0000 UTC m=+0.018257464 image pull 8f4bf3e8b16aa617a3377544276cd5a5b73be8802746138ce876732ceeade8e1 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0 2024-02-05T07:55:27.233 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:26 smithi188 podman[79605]: 2024-02-05 07:55:26.913846529 +0000 UTC m=+0.120743842 container create d1d65536b897bd15fb7d2d06d15cda8056350dc297388db2e4875fb786a34275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7-deactivate, io.buildah.version=1.33.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240131, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-05T07:55:27.234 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:27 smithi188 podman[79605]: 2024-02-05 07:55:27.141369947 +0000 UTC m=+0.348267201 container init d1d65536b897bd15fb7d2d06d15cda8056350dc297388db2e4875fb786a34275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7-deactivate, GIT_CLEAN=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.license=GPLv2, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.2, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-02-05T07:55:27.234 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:27 smithi188 podman[79605]: 2024-02-05 07:55:27.147067566 +0000 UTC m=+0.353964823 container start d1d65536b897bd15fb7d2d06d15cda8056350dc297388db2e4875fb786a34275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7-deactivate, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, io.buildah.version=1.33.2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-05T07:55:27.234 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:27 smithi188 podman[79605]: 2024-02-05 07:55:27.23272065 +0000 UTC m=+0.439617918 container attach d1d65536b897bd15fb7d2d06d15cda8056350dc297388db2e4875fb786a34275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, ceph=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.2) 2024-02-05T07:55:27.498 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:27 smithi188 podman[79605]: 2024-02-05 07:55:27.435099038 +0000 UTC m=+0.641996293 container died d1d65536b897bd15fb7d2d06d15cda8056350dc297388db2e4875fb786a34275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240131, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, io.buildah.version=1.33.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-05T07:55:27.985 INFO:journalctl@ceph.osd.7.smithi188.stdout:Feb 05 07:55:27 smithi188 podman[79651]: 2024-02-05 07:55:27.969011053 +0000 UTC m=+0.528813095 container remove d1d65536b897bd15fb7d2d06d15cda8056350dc297388db2e4875fb786a34275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.2, org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-02-05T07:55:27.991 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@osd.7.service' 2024-02-05T07:55:28.032 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-05T07:55:28.032 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-02-05T07:55:28.032 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-02-05T07:55:28.032 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@rgw.foo.a 2024-02-05T07:55:28.339 INFO:journalctl@ceph.rgw.foo.a.smithi184.stdout:Feb 05 07:55:28 smithi184 systemd[1]: Stopping Ceph rgw.foo.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:55:28.590 INFO:journalctl@ceph.rgw.foo.a.smithi184.stdout:Feb 05 07:55:28 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-rgw-foo-a[69302]: 2024-02-05T07:55:28.337+0000 7f7098c22700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-05T07:55:28.590 INFO:journalctl@ceph.rgw.foo.a.smithi184.stdout:Feb 05 07:55:28 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-rgw-foo-a[69302]: 2024-02-05T07:55:28.337+0000 7f70a748dac0 -1 shutting down 2024-02-05T07:55:38.727 INFO:journalctl@ceph.rgw.foo.a.smithi184.stdout:Feb 05 07:55:38 smithi184 bash[160843]: time="2024-02-05T07:55:38Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-rgw-foo-a in 10 seconds, resorting to SIGKILL" 2024-02-05T07:55:38.727 INFO:journalctl@ceph.rgw.foo.a.smithi184.stdout:Feb 05 07:55:38 smithi184 podman[160843]: 2024-02-05 07:55:38.367533341 +0000 UTC m=+10.142145458 container died d7f70fe8f46338e69850a7b5d67ce829e9662b7a951e6017ed668faa8a92bb5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-rgw-foo-a, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240131, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, GIT_CLEAN=True, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275) 2024-02-05T07:55:39.020 INFO:journalctl@ceph.rgw.foo.a.smithi184.stdout:Feb 05 07:55:38 smithi184 podman[160843]: 2024-02-05 07:55:38.824824542 +0000 UTC m=+10.599436662 container cleanup d7f70fe8f46338e69850a7b5d67ce829e9662b7a951e6017ed668faa8a92bb5a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-rgw-foo-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240131, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-05T07:55:39.021 INFO:journalctl@ceph.rgw.foo.a.smithi184.stdout:Feb 05 07:55:38 smithi184 bash[160843]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-rgw-foo-a 2024-02-05T07:55:39.245 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@rgw.foo.a.service' 2024-02-05T07:55:39.283 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-05T07:55:39.283 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-02-05T07:55:39.284 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-02-05T07:55:39.284 DEBUG:teuthology.orchestra.run.smithi188:> sudo systemctl stop ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@prometheus.a 2024-02-05T07:55:39.673 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:39 smithi188 systemd[1]: Stopping Ceph prometheus.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:55:39.934 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:39.672Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-05T07:55:39.934 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:39.672Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-02-05T07:55:39.934 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:39.672Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-02-05T07:55:39.935 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:39.672Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-05T07:55:39.935 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:39.672Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-02-05T07:55:39.935 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:39.672Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-02-05T07:55:39.935 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:39.672Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-02-05T07:55:39.935 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:39.672Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-02-05T07:55:39.935 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:39.672Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-02-05T07:55:39.935 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:39.673Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-02-05T07:55:39.935 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:39.673Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-02-05T07:55:39.935 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:39 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a[67789]: ts=2024-02-05T07:55:39.673Z caller=main.go:1147 level=info msg="See you next time!" 2024-02-05T07:55:39.935 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:39 smithi188 podman[79735]: 2024-02-05 07:55:39.683262417 +0000 UTC m=+0.204187933 container died 639dafe5f2ed55eabc8832a4bd429fc0eb30d198ceb6bd6bc367d63a1af5dece (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-02-05T07:55:40.196 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:40 smithi188 podman[79735]: 2024-02-05 07:55:40.029133825 +0000 UTC m=+0.550059325 container cleanup 639dafe5f2ed55eabc8832a4bd429fc0eb30d198ceb6bd6bc367d63a1af5dece (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-02-05T07:55:40.196 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:40 smithi188 bash[79735]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a 2024-02-05T07:55:40.455 INFO:journalctl@ceph.prometheus.a.smithi188.stdout:Feb 05 07:55:40 smithi188 podman[79754]: 2024-02-05 07:55:40.195806496 +0000 UTC m=+0.514940244 container remove 639dafe5f2ed55eabc8832a4bd429fc0eb30d198ceb6bd6bc367d63a1af5dece (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-prometheus-a, maintainer=The Prometheus Authors ) 2024-02-05T07:55:40.468 DEBUG:teuthology.orchestra.run.smithi188:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@prometheus.a.service' 2024-02-05T07:55:40.505 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-05T07:55:40.506 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-02-05T07:55:40.506 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm rm-cluster --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 --force --keep-logs 2024-02-05T07:55:40.694 INFO:teuthology.orchestra.run.smithi184.stdout:Deleting cluster with fsid: ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:55:42.475 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:55:42 smithi184 systemd[1]: Stopping Ceph alertmanager.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:55:42.771 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:55:42 smithi184 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a[80311]: ts=2024-02-05T07:55:42.474Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-02-05T07:55:42.771 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:55:42 smithi184 podman[161366]: 2024-02-05 07:55:42.515848814 +0000 UTC m=+0.147013022 container died dde10d75aa33646347ca79b6e296ee5a3e891aef0d412345939df73f439b0031 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-02-05T07:55:43.073 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:55:42 smithi184 podman[161366]: 2024-02-05 07:55:42.85483899 +0000 UTC m=+0.486003197 container cleanup dde10d75aa33646347ca79b6e296ee5a3e891aef0d412345939df73f439b0031 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-02-05T07:55:43.074 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:55:42 smithi184 bash[161366]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a 2024-02-05T07:55:43.074 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:55:42 smithi184 podman[161385]: 2024-02-05 07:55:42.997607592 +0000 UTC m=+0.480157492 container remove dde10d75aa33646347ca79b6e296ee5a3e891aef0d412345939df73f439b0031 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-alertmanager-a, maintainer=The Prometheus Authors ) 2024-02-05T07:55:43.074 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:55:43 smithi184 podman[161385]: 2024-02-05 07:55:43.073341574 +0000 UTC m=+0.555891475 volume remove 16ad05d7ee50eb614c5ad0176d4745997d86f5aa1500120ec409969a41e1c712 2024-02-05T07:55:43.329 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:55:43 smithi184 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@alertmanager.a.service: Deactivated successfully. 2024-02-05T07:55:43.330 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:55:43 smithi184 systemd[1]: Stopped Ceph alertmanager.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:55:43.330 INFO:journalctl@ceph.alertmanager.a.smithi184.stdout:Feb 05 07:55:43 smithi184 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@alertmanager.a.service: Consumed 2.465s CPU time. 2024-02-05T07:55:43.758 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:55:43 smithi184 systemd[1]: Stopping Ceph node-exporter.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:55:44.020 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:55:43 smithi184 podman[161503]: 2024-02-05 07:55:43.756636232 +0000 UTC m=+0.119195117 container died 2fa7beb4099097a81cf69646a005956d6e6a6fffa519ee58bd927c0605eb9cbf (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-02-05T07:55:44.361 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:55:44 smithi184 podman[161503]: 2024-02-05 07:55:44.167873282 +0000 UTC m=+0.530432169 container cleanup 2fa7beb4099097a81cf69646a005956d6e6a6fffa519ee58bd927c0605eb9cbf (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-02-05T07:55:44.361 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:55:44 smithi184 bash[161503]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a 2024-02-05T07:55:44.729 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:55:44 smithi184 podman[161522]: 2024-02-05 07:55:44.360524328 +0000 UTC m=+0.608620551 container remove 2fa7beb4099097a81cf69646a005956d6e6a6fffa519ee58bd927c0605eb9cbf (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-a, maintainer=The Prometheus Authors ) 2024-02-05T07:55:44.729 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:55:44 smithi184 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-02-05T07:55:44.729 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:55:44 smithi184 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-02-05T07:55:44.730 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:55:44 smithi184 systemd[1]: Stopped Ceph node-exporter.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:55:44.730 INFO:journalctl@ceph.node-exporter.a.smithi184.stdout:Feb 05 07:55:44 smithi184 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@node-exporter.a.service: Consumed 5.277s CPU time. 2024-02-05T07:55:45.196 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm rm-cluster --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 --force --keep-logs 2024-02-05T07:55:45.388 INFO:teuthology.orchestra.run.smithi188.stdout:Deleting cluster with fsid: ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:55:46.985 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:55:46 smithi188 systemd[1]: Stopping Ceph iscsi.iscsi.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:55:47.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:55:46 smithi188 ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a[62325]: debug Shutdown received 2024-02-05T07:55:57.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:55:56 smithi188 bash[80164]: time="2024-02-05T07:55:56Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a in 10 seconds, resorting to SIGKILL" 2024-02-05T07:55:57.249 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:55:57 smithi188 podman[80164]: 2024-02-05 07:55:57.005242078 +0000 UTC m=+10.136112318 container died 087d8997c522f9b47a98cdc98d1a72871c145f4a664c41ee251811185fb79792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a, org.label-schema.schema-version=1.0, io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240131, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-02-05T07:55:57.648 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:55:57 smithi188 podman[80164]: 2024-02-05 07:55:57.37935942 +0000 UTC m=+10.510229659 container cleanup 087d8997c522f9b47a98cdc98d1a72871c145f4a664c41ee251811185fb79792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a, org.label-schema.schema-version=1.0, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.2, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-02-05T07:55:57.648 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:55:57 smithi188 bash[80164]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a 2024-02-05T07:55:57.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:55:57 smithi188 podman[80190]: 2024-02-05 07:55:57.647223758 +0000 UTC m=+0.637309447 container remove 087d8997c522f9b47a98cdc98d1a72871c145f4a664c41ee251811185fb79792 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:471dc037e7bbfe27d19519404cf9282a911af42da176a0f19461b166165464b0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-iscsi-iscsi-a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-guits-testing-3-2024-02-04-2254-164d3be, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.2, CEPH_POINT_RELEASE=, GIT_COMMIT=14dafef590928bb89728de91784b87b8f9bbf275, org.label-schema.license=GPLv2, org.label-schema.build-date=20240131, GIT_BRANCH=HEAD) 2024-02-05T07:55:57.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:55:57 smithi188 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-02-05T07:55:57.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:55:57 smithi188 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-05T07:55:57.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:55:57 smithi188 systemd[1]: Stopped Ceph iscsi.iscsi.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:55:57.998 INFO:journalctl@ceph.iscsi.iscsi.a.smithi188.stdout:Feb 05 07:55:57 smithi188 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@iscsi.iscsi.a.service: Consumed 4.443s CPU time. 2024-02-05T07:55:59.552 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:55:59 smithi188 systemd[1]: Stopping Ceph grafana.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:55:59.847 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:55:59 smithi188 podman[80467]: 2024-02-05 07:55:59.551305551 +0000 UTC m=+0.126317048 container died a412a87495cad195f6392b37fdb58b410ab1011e034963ced44a054ec2c9e2f9 (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a, build-date=2022-04-29T11:48:11.055897, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, description=Ceph Grafana Container, com.redhat.component=ubi8-container, version=8.5, io.buildah.version=1.32.0, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.display-name=Red Hat Universal Base Image 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, maintainer=Paul Cuzner , vcs-type=git, vendor=Red Hat, Inc., distribution-scope=public, io.openshift.tags=base rhel8, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.openshift.expose-services=, release=239.1651231664, architecture=x86_64, name=ubi8) 2024-02-05T07:56:00.097 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:55:59 smithi188 podman[80467]: 2024-02-05 07:55:59.92917636 +0000 UTC m=+0.504187856 container cleanup a412a87495cad195f6392b37fdb58b410ab1011e034963ced44a054ec2c9e2f9 (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a, vendor=Red Hat, Inc., io.k8s.display-name=Red Hat Universal Base Image 8, vcs-type=git, com.redhat.component=ubi8-container, name=ubi8, build-date=2022-04-29T11:48:11.055897, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, io.openshift.tags=base rhel8, release=239.1651231664, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, description=Ceph Grafana Container, version=8.5, io.buildah.version=1.32.0, io.openshift.expose-services=, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, maintainer=Paul Cuzner , vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, architecture=x86_64, summary=Grafana Container configured for Ceph mgr/dashboard integration) 2024-02-05T07:56:00.097 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:55:59 smithi188 bash[80467]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a 2024-02-05T07:56:00.353 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:56:00 smithi188 podman[80486]: 2024-02-05 07:56:00.096819759 +0000 UTC m=+0.548607800 container remove a412a87495cad195f6392b37fdb58b410ab1011e034963ced44a054ec2c9e2f9 (image=quay.io/ceph/ceph-grafana:9.4.12, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-grafana-a, com.redhat.build-host=cpt-1007.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base rhel8, description=Ceph Grafana Container, summary=Grafana Container configured for Ceph mgr/dashboard integration, vendor=Red Hat, Inc., build-date=2022-04-29T11:48:11.055897, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=ubi8, architecture=x86_64, version=8.5, com.redhat.component=ubi8-container, distribution-scope=public, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.expose-services=, io.buildah.version=1.32.0, maintainer=Paul Cuzner , vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-239.1651231664, release=239.1651231664) 2024-02-05T07:56:00.353 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:56:00 smithi188 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@grafana.a.service: Main process exited, code=exited, status=143/n/a 2024-02-05T07:56:00.353 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:56:00 smithi188 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@grafana.a.service: Failed with result 'exit-code'. 2024-02-05T07:56:00.353 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:56:00 smithi188 systemd[1]: Stopped Ceph grafana.a for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:56:00.353 INFO:journalctl@ceph.grafana.a.smithi188.stdout:Feb 05 07:56:00 smithi188 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@grafana.a.service: Consumed 18.393s CPU time. 2024-02-05T07:56:00.748 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:56:00 smithi188 systemd[1]: Stopping Ceph node-exporter.b for ae38c7f2-c3f5-11ee-95b6-87774f69a715... 2024-02-05T07:56:01.059 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:56:00 smithi188 podman[80602]: 2024-02-05 07:56:00.804737771 +0000 UTC m=+0.120895003 container died 5e788acdaa7eda1a447f72192897b22c087e78c7be2f72053b0bd33f257489b8 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-02-05T07:56:01.451 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:56:01 smithi188 podman[80602]: 2024-02-05 07:56:01.149414548 +0000 UTC m=+0.465571779 container cleanup 5e788acdaa7eda1a447f72192897b22c087e78c7be2f72053b0bd33f257489b8 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-02-05T07:56:01.451 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:56:01 smithi188 bash[80602]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b 2024-02-05T07:56:01.711 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:56:01 smithi188 podman[80621]: 2024-02-05 07:56:01.450660105 +0000 UTC m=+0.648574692 container remove 5e788acdaa7eda1a447f72192897b22c087e78c7be2f72053b0bd33f257489b8 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715-node-exporter-b, maintainer=The Prometheus Authors ) 2024-02-05T07:56:01.711 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:56:01 smithi188 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-02-05T07:56:01.711 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:56:01 smithi188 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-02-05T07:56:01.711 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:56:01 smithi188 systemd[1]: Stopped Ceph node-exporter.b for ae38c7f2-c3f5-11ee-95b6-87774f69a715. 2024-02-05T07:56:01.711 INFO:journalctl@ceph.node-exporter.b.smithi188.stdout:Feb 05 07:56:01 smithi188 systemd[1]: ceph-ae38c7f2-c3f5-11ee-95b6-87774f69a715@node-exporter.b.service: Consumed 5.261s CPU time. 2024-02-05T07:56:02.208 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-05T07:56:02.243 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-05T07:56:02.273 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-05T07:56:02.275 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/crash to /home/teuthworker/archive/gabrioux-2024-02-05_05:57:01-orch:cephadm-wip-guits-testing-3-2024-02-04-2254-distro-default-smithi/7546722/remote/smithi184/crash 2024-02-05T07:56:02.276 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/crash -- . 2024-02-05T07:56:02.416 INFO:teuthology.orchestra.run.smithi184.stderr:tar: /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/crash: Cannot open: No such file or directory 2024-02-05T07:56:02.417 INFO:teuthology.orchestra.run.smithi184.stderr:tar: Error is not recoverable: exiting now 2024-02-05T07:56:02.418 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/crash to /home/teuthworker/archive/gabrioux-2024-02-05_05:57:01-orch:cephadm-wip-guits-testing-3-2024-02-04-2254-distro-default-smithi/7546722/remote/smithi188/crash 2024-02-05T07:56:02.419 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/crash -- . 2024-02-05T07:56:02.457 INFO:teuthology.orchestra.run.smithi188.stderr:tar: /var/lib/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/crash: Cannot open: No such file or directory 2024-02-05T07:56:02.457 INFO:teuthology.orchestra.run.smithi188.stderr:tar: Error is not recoverable: exiting now 2024-02-05T07:56:02.458 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-05T07:56:02.459 DEBUG:teuthology.orchestra.run.smithi184:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-02-05T07:56:02.494 INFO:teuthology.orchestra.run.smithi184.stdout:2024-02-05T07:30:00.000191+0000 mon.a (mon.0) 2928 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 5 pool(s) do not have an application enabled 2024-02-05T07:56:02.494 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-05T07:56:02.495 DEBUG:teuthology.orchestra.run.smithi184:> sudo egrep '\[SEC\]' /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-02-05T07:56:02.570 DEBUG:teuthology.orchestra.run.smithi184:> sudo egrep '\[ERR\]' /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-02-05T07:56:02.641 DEBUG:teuthology.orchestra.run.smithi184:> sudo egrep '\[WRN\]' /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-02-05T07:56:02.711 INFO:teuthology.orchestra.run.smithi184.stdout:2024-02-05T07:30:00.000191+0000 mon.a (mon.0) 2928 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 5 pool(s) do not have an application enabled 2024-02-05T07:56:02.711 INFO:tasks.cephadm:Compressing logs... 2024-02-05T07:56:02.711 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-05T07:56:02.753 DEBUG:teuthology.orchestra.run.smithi188:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-05T07:56:02.779 INFO:teuthology.orchestra.run.smithi184.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-05T07:56:02.779 INFO:teuthology.orchestra.run.smithi184.stderr:: No such file or directory 2024-02-05T07:56:02.779 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-mon.a.log 2024-02-05T07:56:02.779 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.audit.log 2024-02-05T07:56:02.779 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-client.rgw.foo.a.log 2024-02-05T07:56:02.779 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-mon.a.log: /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.1.log 2024-02-05T07:56:02.779 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.3.log 2024-02-05T07:56:02.781 INFO:teuthology.orchestra.run.smithi188.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-05T07:56:02.782 INFO:teuthology.orchestra.run.smithi188.stderr:: No such file or directory 2024-02-05T07:56:02.782 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.6.log 2024-02-05T07:56:02.782 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.audit.log 2024-02-05T07:56:02.782 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.4.log 2024-02-05T07:56:02.782 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.6.log: /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.7.log 2024-02-05T07:56:02.785 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.5.log 2024-02-05T07:56:02.785 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-mgr.x.log 2024-02-05T07:56:02.785 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/tcmu-runner.log 2024-02-05T07:56:02.785 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.cephadm.log 2024-02-05T07:56:02.786 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/tcmu-runner.log: 67.8% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/tcmu-runner.log.gz 2024-02-05T07:56:02.786 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.log 2024-02-05T07:56:02.786 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.cephadm.log: 81.7% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.cephadm.log.gz 85.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-05T07:56:02.786 INFO:teuthology.orchestra.run.smithi188.stderr: 2024-02-05T07:56:02.789 INFO:teuthology.orchestra.run.smithi188.stderr:gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-volume.log 2024-02-05T07:56:02.789 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-mon.b.log 2024-02-05T07:56:02.789 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-client.rgw.foo.a.log: gzip/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.1.log: -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-mgr.y.log 2024-02-05T07:56:02.789 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.3.log: /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.0.log 2024-02-05T07:56:02.789 INFO:teuthology.orchestra.run.smithi184.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-05T07:56:02.789 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.cephadm.log 2024-02-05T07:56:02.792 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-volume.log: 88.1% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.log.gz 2024-02-05T07:56:02.794 INFO:teuthology.orchestra.run.smithi188.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-mon.b.log: 92.3% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.audit.log.gz 2024-02-05T07:56:02.796 INFO:teuthology.orchestra.run.smithi188.stderr: 92.4% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-mgr.x.log.gz 2024-02-05T07:56:02.798 INFO:teuthology.orchestra.run.smithi188.stderr: 90.9% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-volume.log.gz 2024-02-05T07:56:02.799 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.0.log: 95.2% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.audit.log.gz 2024-02-05T07:56:02.800 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.log 2024-02-05T07:56:02.800 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.cephadm.log: 89.0% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.cephadm.log.gz 2024-02-05T07:56:02.801 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.2.log 2024-02-05T07:56:02.810 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.log: 93.4% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph.log.gz 2024-02-05T07:56:02.811 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-volume.log 2024-02-05T07:56:02.824 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-mon.c.log 2024-02-05T07:56:02.848 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-volume.log: /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-mon.c.log: 93.5% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-client.rgw.foo.a.log.gz 2024-02-05T07:56:02.852 INFO:teuthology.orchestra.run.smithi184.stderr: 90.9% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-volume.log.gz 2024-02-05T07:56:03.329 INFO:teuthology.orchestra.run.smithi184.stderr: 90.1% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-mgr.y.log.gz 2024-02-05T07:56:04.123 INFO:teuthology.orchestra.run.smithi188.stderr: 92.4% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-mon.b.log.gz 2024-02-05T07:56:04.656 INFO:teuthology.orchestra.run.smithi184.stderr: 92.3% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-mon.c.log.gz 2024-02-05T07:56:05.918 INFO:teuthology.orchestra.run.smithi184.stderr: 91.7% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-mon.a.log.gz 2024-02-05T07:56:10.800 INFO:teuthology.orchestra.run.smithi188.stderr: 93.9% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.6.log.gz 2024-02-05T07:56:11.141 INFO:teuthology.orchestra.run.smithi184.stderr: 93.9% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.0.log.gz 2024-02-05T07:56:11.504 INFO:teuthology.orchestra.run.smithi184.stderr: 93.9% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.2.log.gz 2024-02-05T07:56:11.914 INFO:teuthology.orchestra.run.smithi188.stderr: 94.0% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.5.log.gz 2024-02-05T07:56:12.223 INFO:teuthology.orchestra.run.smithi188.stderr: 93.9% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.7.log.gz 2024-02-05T07:56:12.334 INFO:teuthology.orchestra.run.smithi184.stderr: 94.0% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.1.log.gz 2024-02-05T07:56:12.520 INFO:teuthology.orchestra.run.smithi184.stderr: 94.0% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.3.log.gz 2024-02-05T07:56:12.522 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-05T07:56:12.522 INFO:teuthology.orchestra.run.smithi184.stderr:real 0m9.757s 2024-02-05T07:56:12.522 INFO:teuthology.orchestra.run.smithi184.stderr:user 0m40.467s 2024-02-05T07:56:12.522 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m1.390s 2024-02-05T07:56:12.626 INFO:teuthology.orchestra.run.smithi188.stderr: 94.0% -- replaced with /var/log/ceph/ae38c7f2-c3f5-11ee-95b6-87774f69a715/ceph-osd.4.log.gz 2024-02-05T07:56:12.628 INFO:teuthology.orchestra.run.smithi188.stderr: 2024-02-05T07:56:12.628 INFO:teuthology.orchestra.run.smithi188.stderr:real 0m9.860s 2024-02-05T07:56:12.628 INFO:teuthology.orchestra.run.smithi188.stderr:user 0m36.480s 2024-02-05T07:56:12.628 INFO:teuthology.orchestra.run.smithi188.stderr:sys 0m1.294s 2024-02-05T07:56:12.629 INFO:tasks.cephadm:Archiving logs... 2024-02-05T07:56:12.629 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-02-05_05:57:01-orch:cephadm-wip-guits-testing-3-2024-02-04-2254-distro-default-smithi/7546722/remote/smithi184/log 2024-02-05T07:56:12.630 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-05T07:56:17.845 DEBUG:teuthology.misc:Transferring archived files from smithi188:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-02-05_05:57:01-orch:cephadm-wip-guits-testing-3-2024-02-04-2254-distro-default-smithi/7546722/remote/smithi188/log 2024-02-05T07:56:17.846 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-05T07:56:23.253 INFO:tasks.cephadm:Removing cluster... 2024-02-05T07:56:23.253 DEBUG:teuthology.orchestra.run.smithi184:> sudo cephadm rm-cluster --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 --force 2024-02-05T07:56:23.446 INFO:teuthology.orchestra.run.smithi184.stdout:Deleting cluster with fsid: ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:56:23.744 DEBUG:teuthology.orchestra.run.smithi188:> sudo cephadm rm-cluster --fsid ae38c7f2-c3f5-11ee-95b6-87774f69a715 --force 2024-02-05T07:56:23.932 INFO:teuthology.orchestra.run.smithi188.stdout:Deleting cluster with fsid: ae38c7f2-c3f5-11ee-95b6-87774f69a715 2024-02-05T07:56:24.236 INFO:tasks.cephadm:Teardown complete 2024-02-05T07:56:24.237 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-05T07:56:24.248 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-05T07:56:24.248 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-05T07:56:24.251 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-05T07:56:24.333 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-05T07:56:24.342 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-05T07:56:24.343 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-05T07:56:24.345 DEBUG:teuthology.orchestra.run.smithi188:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-05T07:56:24.357 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-02-05T07:56:24.360 INFO:teuthology.orchestra.run.smithi188.stderr:bash: line 1: ntpq: command not found 2024-02-05T07:56:24.361 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-05T07:56:24.362 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-02-05T07:56:24.362 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 35 +817us[ +817us] +/- 84ms 2024-02-05T07:56:24.362 INFO:teuthology.orchestra.run.smithi184.stdout:^* hv02.front.sepia.ceph.com 3 7 377 95 -1056us[-1067us] +/- 73ms 2024-02-05T07:56:24.362 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +419us[ +419us] +/- 82ms 2024-02-05T07:56:24.362 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-05T07:56:24.364 INFO:teuthology.orchestra.run.smithi188.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-05T07:56:24.364 INFO:teuthology.orchestra.run.smithi188.stdout:=============================================================================== 2024-02-05T07:56:24.364 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 36 +783us[ +747us] +/- 84ms 2024-02-05T07:56:24.364 INFO:teuthology.orchestra.run.smithi188.stdout:^* hv02.front.sepia.ceph.com 3 6 377 34 -1077us[-1113us] +/- 74ms 2024-02-05T07:56:24.364 INFO:teuthology.orchestra.run.smithi188.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +405us[ +405us] +/- 82ms 2024-02-05T07:56:24.364 INFO:teuthology.orchestra.run.smithi188.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-05T07:56:24.365 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-05T07:56:24.375 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-05T07:56:24.376 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-05T07:56:24.386 DEBUG:teuthology.orchestra.run.smithi184:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-05T07:56:24.484 DEBUG:teuthology.orchestra.run.smithi188:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-05T07:56:24.562 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-05T07:56:24.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-05T07:56:24.592 DEBUG:teuthology.orchestra.run.smithi188:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-05T07:56:24.622 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-05T07:56:24.623 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-05T07:56:24.634 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-05T07:56:24.643 INFO:teuthology.task.internal:Duration was 3133.173790 seconds 2024-02-05T07:56:24.643 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-05T07:56:24.654 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-05T07:56:24.655 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-05T07:56:24.657 DEBUG:teuthology.orchestra.run.smithi188:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-05T07:56:24.698 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-05T07:56:24.706 INFO:teuthology.orchestra.run.smithi188.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-05T07:56:25.060 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-05T07:56:25.060 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2024-02-05T07:56:25.061 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-05T07:56:25.120 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi188.front.sepia.ceph.com 2024-02-05T07:56:25.121 DEBUG:teuthology.orchestra.run.smithi188:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-05T07:56:25.150 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-05T07:56:25.151 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-05T07:56:25.163 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-05T07:56:25.219 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-05T07:56:25.219 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-05T07:56:25.232 DEBUG:teuthology.orchestra.run.smithi188:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-05T07:56:25.673 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-05T07:56:25.683 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-05T07:56:25.683 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-05T07:56:25.710 DEBUG:teuthology.orchestra.run.smithi188:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-05T07:56:25.737 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-05T07:56:25.747 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-05T07:56:25.752 DEBUG:teuthology.orchestra.run.smithi188:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-05T07:56:25.775 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2024-02-05T07:56:25.802 INFO:teuthology.orchestra.run.smithi188.stdout:kernel.core_pattern = core 2024-02-05T07:56:25.829 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-05T07:56:25.846 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-05T07:56:25.847 DEBUG:teuthology.orchestra.run.smithi188:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-05T07:56:25.883 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-05T07:56:25.884 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-05T07:56:25.894 INFO:teuthology.task.internal:Transferring archived files... 2024-02-05T07:56:25.895 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-02-05_05:57:01-orch:cephadm-wip-guits-testing-3-2024-02-04-2254-distro-default-smithi/7546722/remote/smithi184 2024-02-05T07:56:25.895 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-05T07:56:25.960 DEBUG:teuthology.misc:Transferring archived files from smithi188:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-02-05_05:57:01-orch:cephadm-wip-guits-testing-3-2024-02-04-2254-distro-default-smithi/7546722/remote/smithi188 2024-02-05T07:56:25.960 DEBUG:teuthology.orchestra.run.smithi188:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-05T07:56:25.999 INFO:teuthology.task.internal:Removing archive directory... 2024-02-05T07:56:25.999 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-05T07:56:26.002 DEBUG:teuthology.orchestra.run.smithi188:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-05T07:56:26.048 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-05T07:56:26.060 INFO:teuthology.task.internal:Not uploading archives. 2024-02-05T07:56:26.061 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-05T07:56:26.075 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-05T07:56:26.075 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-05T07:56:26.078 DEBUG:teuthology.orchestra.run.smithi188:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-05T07:56:26.089 INFO:teuthology.orchestra.run.smithi184.stdout: 266021 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 5 07:56 /home/ubuntu/cephtest 2024-02-05T07:56:26.102 INFO:teuthology.orchestra.run.smithi188.stdout: 265293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 5 07:56 /home/ubuntu/cephtest 2024-02-05T07:56:26.103 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-05T07:56:26.113 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-05T07:56:26.144 INFO:teuthology.nuke:Checking targets against current locks 2024-02-05T07:56:26.170 DEBUG:teuthology.nuke:shortname: smithi184 2024-02-05T07:56:26.170 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-05T07:56:26.194 DEBUG:teuthology.nuke:shortname: smithi188 2024-02-05T07:56:26.195 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-05T07:56:26.198 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-02-05_05:57:01-orch:cephadm-wip-guits-testing-3-2024-02-04-2254-distro-default-smithi/7546722', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-05 06:55:54.557556', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMYlDwTmAq/gFbcKJYIcmZ0Yv8UqzlB90isJu5m6Sv6tnki+ynX4JxbfqI4w7fMTkRh9xN1h9eCo20Ct4XZbp+c='} 2024-02-05T07:56:26.224 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi188.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-02-05_05:57:01-orch:cephadm-wip-guits-testing-3-2024-02-04-2254-distro-default-smithi/7546722', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-05 06:55:54.556208', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHDl+fVWw9yXREQNWDJwG4zmbmkXjaD4WHDgq7nVWZpJ0TblbB44qr0danR1DS50pVAy7/ep0yUBKQLbl3qYBVY='} 2024-02-05T07:56:26.256 INFO:teuthology.orchestra.console.smithi184:Power off 2024-02-05T07:56:26.257 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-05T07:56:26.281 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2024-02-05T07:56:26.282 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T07:56:26.295 INFO:teuthology.orchestra.console.smithi188:Power off 2024-02-05T07:56:26.296 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-05T07:56:26.306 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-02-05T07:56:26.321 DEBUG:teuthology.orchestra.console.smithi188:power off output: Chassis Power Control: Down/Off 2024-02-05T07:56:26.321 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T07:56:26.342 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-02-05T07:56:30.307 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T07:56:30.343 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T07:56:30.417 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-02-05T07:56:30.453 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is on 2024-02-05T07:56:34.420 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T07:56:34.454 DEBUG:teuthology.orchestra.console.smithi188:pexpect command: ipmitool -H smithi188.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T07:56:34.534 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-02-05T07:56:34.563 DEBUG:teuthology.orchestra.console.smithi188:check power output: Chassis Power is off 2024-02-05T07:56:34.663 INFO:teuthology.orchestra.console.smithi188:Power off completed 2024-02-05T07:56:38.538 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-05T07:56:38.648 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-02-05T07:56:38.748 INFO:teuthology.orchestra.console.smithi184:Power off completed 2024-02-05T07:56:38.852 INFO:teuthology.run:Summary data: description: orch:cephadm/with-work/{0-distro/centos_9.stream_runc fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} duration: 3133.1737897396088 failure_reason: '"2024-02-05T07:30:00.000191+0000 mon.a (mon.0) 2928 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 5 pool(s) do not have an application enabled" in cluster log' flavor: default owner: scheduled_gabrioux@teuthology success: false 2024-02-05T07:56:38.853 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-05T07:56:38.928 INFO:teuthology.run:FAIL